-- Logs begin at Thu 2021-09-23 02:22:42 UTC, end at Thu 2021-09-23 03:49:37 UTC. -- Sep 23 02:54:10.250332 dv-cinder-768458-9-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Sep 23 02:54:10.258537 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 23 02:54:10.261566 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 23 02:54:10 2021] *** Sep 23 02:54:10.261566 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 23 02:54:10.261566 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 23 02:54:10.261566 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: nodename: dv-cinder-768458-9-iscsi Sep 23 02:54:10.261566 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: machine: x86_64 Sep 23 02:54:10.261566 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: clock source: unix Sep 23 02:54:10.261566 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: pcre jit disabled Sep 23 02:54:10.261566 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: detected number of CPU cores: 4 Sep 23 02:54:10.261566 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: current working directory: / Sep 23 02:54:10.261566 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: detected binary path: /usr/bin/uwsgi-core Sep 23 02:54:10.262131 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: your processes number limit is 47680 Sep 23 02:54:10.262131 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: your memory page size is 4096 bytes Sep 23 02:54:10.262131 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: detected max file descriptor number: 2048 Sep 23 02:54:10.262131 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: lock engine: pthread robust mutexes Sep 23 02:54:10.262131 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: thunder lock: enabled Sep 23 02:54:10.262131 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 23 02:54:10.262131 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 23 02:54:10.307824 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: Python main interpreter initialized at 0x55e1cf9ce9c0 Sep 23 02:54:10.307824 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: python threads support enabled Sep 23 02:54:10.307824 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: your server socket listen backlog is limited to 100 connections Sep 23 02:54:10.307824 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: your mercy for graceful operations on workers is 90 seconds Sep 23 02:54:10.308215 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: mapped 403077 bytes (393 KB) for 2 cores Sep 23 02:54:10.308293 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: *** Operational MODE: preforking *** Sep 23 02:54:10.308567 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: *** uWSGI is running in multiple interpreter mode *** Sep 23 02:54:10.308567 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: spawned uWSGI master process (pid: 73771) Sep 23 02:54:10.308778 dv-cinder-768458-9-iscsi systemd[1]: Started Devstack devstack@keystone.service. Sep 23 02:54:10.310399 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: spawned uWSGI worker 1 (pid: 73780, cores: 1) Sep 23 02:54:10.310399 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: spawned uWSGI worker 2 (pid: 73781, cores: 1) Sep 23 02:54:10.310399 dv-cinder-768458-9-iscsi devstack@keystone.service[73771]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 23 02:54:15.456101 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 02:54:15.456101 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: from cryptography.utils import int_from_bytes Sep 23 02:54:15.456920 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 02:54:15.456920 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: from cryptography.utils import int_from_bytes Sep 23 02:54:15.456920 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 02:54:15.456920 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: from cryptography.utils import int_from_bytes Sep 23 02:54:15.457430 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 02:54:15.457430 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: from cryptography.utils import int_from_bytes Sep 23 02:54:15.505254 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 02:54:15.505421 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 02:54:15.505500 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 02:54:15.505665 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 02:54:15.505748 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] command line args: [] {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 02:54:15.505825 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] command line args: [] {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 02:54:15.505902 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 02:54:15.505974 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 02:54:15.506051 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ================================================================================ {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 02:54:15.506124 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ================================================================================ {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 02:54:15.506282 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] admin_token = **** {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.506369 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] admin_token = **** {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.506527 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] config_dir = [] {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.506612 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] config_dir = [] {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.506720 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.506801 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.506902 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] config_source = [] {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.506977 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] config_source = [] {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.507084 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] debug = True {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.507180 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] debug = True {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.507282 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.507552 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.507643 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.507715 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.507853 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] insecure_debug = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.507961 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] insecure_debug = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.508064 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.508175 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.508300 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.508416 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.508583 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] list_limit = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.508699 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] list_limit = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.508831 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] log_config_append = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.508934 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] log_config_append = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.509031 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.509138 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.509247 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] log_dir = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.509357 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] log_dir = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.509467 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] log_file = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.509563 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] log_file = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.509678 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.509767 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.509845 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.509969 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.510050 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.510172 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.510254 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.510408 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.510485 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.510558 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.510683 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.510760 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.510886 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.510963 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.511083 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.511159 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.511275 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.511356 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.511439 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.511562 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.511638 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.511758 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.511839 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.511916 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.512043 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.512125 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.512270 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] notification_format = cadf {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.512363 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] notification_format = cadf {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.512557 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.512692 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.513044 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.513130 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.513211 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] publish_errors = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.513327 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] publish_errors = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.513448 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.513526 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.513681 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.513805 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.513889 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.513961 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.514080 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.514173 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.514312 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.514451 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.514544 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] standard_threads = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.514629 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] standard_threads = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.514771 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] strict_password_check = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.515102 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] strict_password_check = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.515269 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.515429 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.515429 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] use_eventlog = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.515615 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] use_eventlog = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.515690 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] use_journal = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.515760 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] use_journal = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.515841 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] use_json = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.515913 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] use_json = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.515984 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] use_stderr = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.516054 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] use_stderr = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.516130 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] use_syslog = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.516202 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] use_syslog = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.516331 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] watch_log_file = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.516408 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] watch_log_file = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 02:54:15.516572 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.516665 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.516816 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.516902 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.517076 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.517163 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.517338 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.517424 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.517589 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.517694 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.517824 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.517937 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.518072 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.518177 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.518306 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.518419 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.518542 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.518627 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.518787 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.518868 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.519033 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.519117 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.519265 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.519351 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.519508 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.519586 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.519746 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.519860 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.519991 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.520155 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.520231 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.520307 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.520463 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.520584 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.520744 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.520830 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.520986 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.521066 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.521221 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.521300 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.521473 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.521559 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.521728 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.521806 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.521982 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.522060 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.522231 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.522318 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.522463 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.522547 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.522693 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.522771 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.522923 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.523009 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.523156 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.523234 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.523405 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.523483 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.523650 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.523729 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.523881 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.523958 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.524110 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.524201 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.524356 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.524435 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.524628 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.524709 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.524867 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.524945 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.525115 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.525193 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.525345 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.525424 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.525579 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.525657 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.525808 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.525892 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.526044 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.526122 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.526272 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.526354 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.526502 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.526580 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.526731 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.526810 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.526965 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.527045 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.527214 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.527301 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.527443 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.527521 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.527675 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.527753 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.527905 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.527993 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.528138 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.528222 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.528370 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.528453 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.528643 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.528735 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.528878 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.528957 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.529115 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.529194 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.529350 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.529437 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.529585 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.529664 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.529820 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.529899 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.530052 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.530138 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.530281 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.530365 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.530529 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.530606 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.530761 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.530846 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.530994 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.531079 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.531225 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.531303 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.531480 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.531570 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.531713 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.531800 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.531944 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.532021 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.532177 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.532261 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.532411 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.532546 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.532702 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.532781 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.533461 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.533551 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.533710 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.533789 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.533943 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.534022 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.534188 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] cache.enabled = True {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.534272 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] cache.enabled = True {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.534422 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.534507 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.534655 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.534732 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.534887 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.534974 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.535119 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.535196 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.535350 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.535428 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.535583 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.535670 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.535840 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.535917 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.536077 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.536155 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.536313 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.536398 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.536567 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.536649 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.536799 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.536877 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.537029 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.537119 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.537261 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.537339 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.537491 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.537569 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.537727 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.537813 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.537959 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.538042 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.538205 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.538282 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.538437 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.538522 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.538691 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.538770 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.538946 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.539029 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.539184 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.539270 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.539413 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] auth.external = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.539491 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] auth.external = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.539642 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] auth.mapped = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.539719 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] auth.mapped = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.539935 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.540092 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.540169 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.540239 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.540386 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] auth.password = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.540465 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] auth.password = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.540640 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] auth.token = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.540731 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] auth.token = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.540878 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.540956 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.541109 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] catalog.caching = True {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.541188 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] catalog.caching = True {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.542674 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.542762 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.542931 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.543010 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.543205 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.543284 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.543466 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.543552 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.543711 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.543789 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.543957 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] credential.caching = True {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.544061 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] credential.caching = True {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.544218 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] credential.driver = sql {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.544298 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] credential.driver = sql {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.544478 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.544604 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.544761 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.544841 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.545003 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.545088 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.545251 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.545341 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.545490 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.545569 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.545743 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.545822 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.546002 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.546092 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.546242 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.546320 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.546499 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.546577 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.546783 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.546869 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.547031 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.547109 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.547292 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.547370 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.547537 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.547623 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.547797 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.547879 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.548034 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] federation.caching = True {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.548120 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] federation.caching = True {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.548270 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.548357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.548646 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] federation.driver = sql {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.549229 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] federation.driver = sql {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.549388 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.549469 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.549624 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.549705 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.549876 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.549955 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.550112 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.550190 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.550369 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.550449 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.550605 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.550683 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.550860 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.550938 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.551096 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.551181 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.551341 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.551420 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.551578 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] identity.caching = True {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.551657 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] identity.caching = True {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.551825 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.551905 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.552072 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.552150 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.552305 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.552384 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.552561 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.552643 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.552812 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] identity.driver = sql {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.552890 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] identity.driver = sql {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.553041 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.553119 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.553276 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.553362 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.553525 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.553604 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.553773 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.553852 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.554005 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.554085 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.554235 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.554313 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.554466 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.554551 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.554710 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.554789 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.554956 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.555035 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.555203 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.555281 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.555458 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.555540 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.555704 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.555789 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.555975 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.556053 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.556211 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.556291 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.556446 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.556571 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.556702 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.556792 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.556939 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.557019 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.557169 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.557246 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.557402 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.557480 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.557640 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.557720 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.557877 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.557955 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.558124 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.558273 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.558349 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.558420 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.558594 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.558674 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.558842 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.558928 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.559077 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.559161 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.559322 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.559401 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.559567 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.559654 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.559798 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.559877 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.560031 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.560110 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.560261 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.password = **** {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.560347 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.password = **** {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.560508 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.560601 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.560754 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.560835 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.560997 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.561085 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.561232 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.561310 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.561466 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.561543 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.561714 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.561807 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.561962 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.562040 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.562193 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.562278 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.562425 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.562511 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.562675 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.562753 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.562922 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.563000 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.563156 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.563243 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.563390 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.563468 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.563622 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.563701 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.563852 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.user = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.563939 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.user = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.564111 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.564195 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.564382 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.564461 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.564640 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.564733 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.564893 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.564973 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.565144 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.565223 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.565393 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.565482 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.565627 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.565705 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.565857 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.565935 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.566091 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.566177 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.566322 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.566401 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.566554 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.566632 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.566783 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.566869 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.567030 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.567109 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.567274 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.567445 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.567577 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.567664 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.567739 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.567812 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.567984 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.568064 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.568212 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.568300 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.568456 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.568586 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.568716 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.568807 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.568948 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.569036 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.569180 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.569259 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.569411 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.569490 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.569651 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.569738 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.569897 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.569983 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.570129 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.570209 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.570381 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] policy.driver = sql {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.570472 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] policy.driver = sql {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.570610 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.570688 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.570851 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.570930 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.571084 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.571170 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.571318 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] receipt.caching = True {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.571397 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] receipt.caching = True {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.571556 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.571636 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.571803 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.571890 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.572046 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.572125 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.572277 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.572356 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.572528 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.572622 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.572771 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] resource.caching = True {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.572850 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] resource.caching = True {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.573022 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.573101 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.573269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] resource.driver = sql {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.573357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] resource.driver = sql {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.573504 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.573584 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.573753 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.573833 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.573999 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.574079 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.574229 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] revoke.caching = True {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.574308 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] revoke.caching = True {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.574474 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.574552 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.574708 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.574787 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.574943 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] role.cache_time = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.575022 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] role.cache_time = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.575174 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] role.caching = True {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.575252 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] role.caching = True {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.575422 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] role.driver = sql {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.575509 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] role.driver = sql {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.575649 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] role.list_limit = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.575728 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] role.list_limit = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.575893 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.575971 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.576139 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.576220 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.576385 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.576464 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.576654 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.576734 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.576901 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.576982 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.577147 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.577225 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.577394 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.577473 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.577642 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.577722 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.577875 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.577954 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.578121 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.578199 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.578368 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.578448 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.578615 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.578694 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.578861 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.578940 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.579257 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.579336 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.579494 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.579579 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.579769 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.579939 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.580032 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.580107 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.580263 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.580344 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.580529 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.580629 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.580770 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.580851 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.581026 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.581106 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.581277 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.581435 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.581513 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.581592 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.581739 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.581821 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.581972 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.582059 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.582208 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.582287 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.582457 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.582535 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.582713 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.582801 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.582958 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.583037 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.583193 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.583271 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.583427 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.583513 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.583655 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] token.cache_time = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.583733 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] token.cache_time = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.583888 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] token.caching = True {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.583966 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] token.caching = True {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.584121 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.584208 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.584368 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] token.provider = fernet {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.584459 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] token.provider = fernet {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.584627 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.584707 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.584884 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.584977 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.585132 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.585210 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.585367 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.585447 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.585609 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.585696 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.585848 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.585928 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.586095 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] trust.driver = sql {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.586173 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] trust.driver = sql {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.586330 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.586416 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.586565 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.586644 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.586795 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.586874 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.587040 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.587127 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.587287 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.587366 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.587513 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.587592 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.587753 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.587840 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.588016 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.588096 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.588274 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] database.connection = **** {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.588353 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] database.connection = **** {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.588532 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.588626 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.588782 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.588862 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.589015 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.589094 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.589250 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.589341 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.589481 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.589560 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.589713 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.589791 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.589944 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.590031 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.590175 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.590254 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.590413 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.590492 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.590671 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.590758 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.590915 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.591004 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.591148 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.591236 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.591393 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.591472 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.591625 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.591704 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.591865 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.591945 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.592094 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.592173 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.592330 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.592409 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.592585 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.592668 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 02:54:15.592740 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 02:54:15.592812 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 02:54:15.621831 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.621993 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.622075 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.622151 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.622279 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.622365 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.631310 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.631406 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.660065 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.660290 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.660376 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.660543 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.714206 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.714561 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.763910 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.764142 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.764232 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.764382 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.917223 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.917421 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.917528 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.917642 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.917724 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.917799 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.917874 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.917947 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.918067 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.918161 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.918281 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.918364 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.942637 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.942862 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.942964 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.943091 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.943175 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.943318 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.943401 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.943539 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.943624 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.943756 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.943840 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.943970 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.944065 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.944185 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.955069 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.955354 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.967743 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.967949 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.968086 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.968173 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.968251 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.968377 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.968563 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.968725 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.968806 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.968880 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.968954 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.969027 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73780) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.969110 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.969254 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73781) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 02:54:15.986605 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:15.986815 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 23 02:54:15.987150 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:15.987233 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:15.987347 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 23 02:54:15.987431 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 23 02:54:15.987608 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:15.987691 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:15.987859 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 23 02:54:15.987950 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:15.988109 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:15.988190 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:15.988358 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:15.988440 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:15.988643 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:15.988897 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:15.998930 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:15.999205 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:15.999469 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:15.999587 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:15.999744 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:15.999835 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.000008 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.000284 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.008007 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=73780) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.008574 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=73781) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.011273 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=73780) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.011552 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.011792 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=73781) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.011875 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.012069 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.012159 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.012350 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.012433 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.012631 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.012899 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.013171 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.013439 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.014323 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.014323 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.014477 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.014685 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.015202 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.015472 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.015746 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.016019 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.016292 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.016598 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.041598 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.043183 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=73780) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.043458 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.043798 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.045420 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=73781) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.045696 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.048721 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=73780) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.049109 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.049667 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.051204 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=73781) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.051598 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.051876 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.056834 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=73780) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.057114 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.059044 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=73781) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.059321 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.061502 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=73780) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.061786 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.062066 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.062349 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.062621 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.062891 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.063156 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.063420 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.063717 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=73781) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.063999 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.064310 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.064620 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.064893 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.065163 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.065432 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.065695 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.082304 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.082577 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.084527 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.084804 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.087040 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=73780) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.089268 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=73781) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.090609 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.091001 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.092821 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.093215 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.095995 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=73780) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.098320 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=73781) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.099653 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=73780) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.101900 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=73781) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.103265 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.103562 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.103843 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.104124 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.104409 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.104719 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.105490 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.105784 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.106066 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.106352 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.106627 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.106913 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.124090 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=73780) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.124368 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.124668 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.124930 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.126320 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=73781) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.126625 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.127432 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.127692 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.133287 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.134985 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.135258 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.135464 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.137197 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.137470 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.139666 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=73780) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.140200 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.140476 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.140785 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.141068 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.142149 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=73781) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.142468 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.142748 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.143035 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.143317 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.154323 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=73780) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.154599 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.154875 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.155149 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.155521 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.155807 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.156080 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.156418 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=73781) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.156727 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.157010 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.157290 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.157658 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.157957 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.158232 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.174306 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=73780) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.176388 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=73781) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.177552 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=73780) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.179633 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=73781) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.180839 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.182566 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.182910 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.184189 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=73780) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.184464 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.184633 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.184773 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.186281 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=73781) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.186559 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.186837 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.191993 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.193599 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=73780) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.194068 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.195662 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=73781) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.196809 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.197097 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.197483 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.197759 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.198836 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.199124 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.199513 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.199790 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.207304 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=73780) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.207589 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.207867 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.209339 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=73781) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.209622 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.209898 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.215633 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=73780) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.215912 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.216189 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.216465 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.216766 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.217134 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.217414 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.217645 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=73781) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 02:54:16.217738 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.217973 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.218062 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.218198 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.218281 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.218479 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.218559 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.218737 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.218818 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.219005 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.219088 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.219263 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=73780) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.219366 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.219650 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.219927 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.220200 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.221050 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.221315 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.221577 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.221839 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=73781) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 02:54:16.257474 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e1cf9ce9c0 pid: 73780 (default app) Sep 23 02:54:16.259876 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e1cf9ce9c0 pid: 73781 (default app) Sep 23 02:54:16.260859 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c8782-c79f-4d12-a052-e848c96697b2 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:16.261156 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c8782-c79f-4d12-a052-e848c96697b2 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:16.261434 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c8782-c79f-4d12-a052-e848c96697b2 None None] PATH_INFO: `/v3` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:16.265867 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 792 bytes} [Thu Sep 23 02:54:16 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:24.802714 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6f7ec-3bf3-405c-be11-5aa9e5b6fa65 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:24.803275 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6f7ec-3bf3-405c-be11-5aa9e5b6fa65 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:24.803275 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6f7ec-3bf3-405c-be11-5aa9e5b6fa65 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:24.808387 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:24 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:24.814680 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88057b6-dc77-4744-afda-01d96119a5f7 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:24.815081 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88057b6-dc77-4744-afda-01d96119a5f7 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:24.815237 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88057b6-dc77-4744-afda-01d96119a5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:24.846940 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG oslo_db.sqlalchemy.engines [None req-c88057b6-dc77-4744-afda-01d96119a5f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 02:54:25.034502 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG passlib.handlers.bcrypt [None req-c88057b6-dc77-4744-afda-01d96119a5f7 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=73780) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 23 02:54:25.034922 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG passlib.handlers.bcrypt [None req-c88057b6-dc77-4744-afda-01d96119a5f7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=73780) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 23 02:54:25.089685 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-c88057b6-dc77-4744-afda-01d96119a5f7 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:25.091240 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-c88057b6-dc77-4744-afda-01d96119a5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:25.246644 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:54:25.374515 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6f7ec-3bf3-405c-be11-5aa9e5b6fa65 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:25.408824 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG oslo_db.sqlalchemy.engines [None req-b6d6f7ec-3bf3-405c-be11-5aa9e5b6fa65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73781) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 02:54:25.536044 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6f7ec-3bf3-405c-be11-5aa9e5b6fa65 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:25.540267 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb4765-c553-4001-bce6-0e7e23d25a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:25.540951 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb4765-c553-4001-bce6-0e7e23d25a71 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:25.541236 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb4765-c553-4001-bce6-0e7e23d25a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:25.541513 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb4765-c553-4001-bce6-0e7e23d25a71 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:25.549986 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb4765-c553-4001-bce6-0e7e23d25a71 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:25.599765 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.common.rbac_enforcer.enforcer [None req-dbfb4765-c553-4001-bce6-0e7e23d25a71 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 23 02:54:25.600101 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb4765-c553-4001-bce6-0e7e23d25a71 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:25.609158 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:54:25 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 02:54:25.616042 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88057b6-dc77-4744-afda-01d96119a5f7 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:25.630200 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88057b6-dc77-4744-afda-01d96119a5f7 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:25.634570 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643260f1-481c-40a5-a519-0c80503ec0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:25.635668 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643260f1-481c-40a5-a519-0c80503ec0fb admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:25.635955 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643260f1-481c-40a5-a519-0c80503ec0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:25.636229 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643260f1-481c-40a5-a519-0c80503ec0fb admin admin] PATH_INFO: `/v3/projects/c34432677fed4984bbce7291bad96cc8` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:25.637753 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643260f1-481c-40a5-a519-0c80503ec0fb admin admin] RBAC: Authorizing `identity:get_project(project_id=c34432677fed4984bbce7291bad96cc8)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:25.691631 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.common.rbac_enforcer.enforcer [None req-643260f1-481c-40a5-a519-0c80503ec0fb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 23 02:54:25.691972 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643260f1-481c-40a5-a519-0c80503ec0fb admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:25.696577 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:54:25 2021] GET /identity/v3/projects/c34432677fed4984bbce7291bad96cc8 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:27.826643 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c69066-36a9-48b6-8706-ea6e3173f4f6 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:27.827075 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c69066-36a9-48b6-8706-ea6e3173f4f6 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:27.827204 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c69066-36a9-48b6-8706-ea6e3173f4f6 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:27.832421 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:27 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:27.839703 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cf743-ec3c-4b88-a928-48df880b3a44 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:27.840119 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cf743-ec3c-4b88-a928-48df880b3a44 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:27.840257 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cf743-ec3c-4b88-a928-48df880b3a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:27.858539 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-099cf743-ec3c-4b88-a928-48df880b3a44 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:27.860054 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-099cf743-ec3c-4b88-a928-48df880b3a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:27.868328 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:54:27.891653 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c69066-36a9-48b6-8706-ea6e3173f4f6 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:27.903599 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c69066-36a9-48b6-8706-ea6e3173f4f6 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:27.907807 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f92e07-0cb4-4f71-b879-cd1af6eeb47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:27.908438 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f92e07-0cb4-4f71-b879-cd1af6eeb47c admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:27.908767 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f92e07-0cb4-4f71-b879-cd1af6eeb47c admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:27.909045 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f92e07-0cb4-4f71-b879-cd1af6eeb47c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:27.916481 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f92e07-0cb4-4f71-b879-cd1af6eeb47c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:27.918267 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f92e07-0cb4-4f71-b879-cd1af6eeb47c admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:27.927265 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:54:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:54:27.932792 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cf743-ec3c-4b88-a928-48df880b3a44 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:27.942029 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cf743-ec3c-4b88-a928-48df880b3a44 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:27.946427 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a384b14-d207-4bf5-b349-e9dbafbabc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:27.947274 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a384b14-d207-4bf5-b349-e9dbafbabc6b admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:27.947558 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a384b14-d207-4bf5-b349-e9dbafbabc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:27.947839 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a384b14-d207-4bf5-b349-e9dbafbabc6b admin admin] PATH_INFO: `/v3/users/2a7711e2d0394daf9335168cae6f091d` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:27.949250 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a384b14-d207-4bf5-b349-e9dbafbabc6b admin admin] RBAC: Authorizing `identity:get_user(user_id=2a7711e2d0394daf9335168cae6f091d)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:27.951052 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a384b14-d207-4bf5-b349-e9dbafbabc6b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:27.952600 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:54:27 2021] GET /identity/v3/users/2a7711e2d0394daf9335168cae6f091d => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:30.164512 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d1dba-85af-4231-967a-fb4bddc5ed77 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:30.164999 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d1dba-85af-4231-967a-fb4bddc5ed77 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:30.164999 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d1dba-85af-4231-967a-fb4bddc5ed77 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:30.166755 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:30.174425 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42012821-5fe3-485d-b5d7-a72523316b72 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:30.174824 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42012821-5fe3-485d-b5d7-a72523316b72 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:30.174988 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42012821-5fe3-485d-b5d7-a72523316b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:30.187258 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd844b-b782-4ff4-9af3-80353c2befca None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:30.187620 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd844b-b782-4ff4-9af3-80353c2befca None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:30.187905 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd844b-b782-4ff4-9af3-80353c2befca None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:30.190242 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 02:54:30.193063 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-42012821-5fe3-485d-b5d7-a72523316b72 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:30.194266 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-42012821-5fe3-485d-b5d7-a72523316b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:30.197424 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391c2c0-fc1f-4e28-bfe9-066acda27592 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:30.197768 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391c2c0-fc1f-4e28-bfe9-066acda27592 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:30.197989 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391c2c0-fc1f-4e28-bfe9-066acda27592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:30.202120 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:54:30.226036 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42012821-5fe3-485d-b5d7-a72523316b72 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:30.234726 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42012821-5fe3-485d-b5d7-a72523316b72 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:30.239170 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG passlib.handlers.bcrypt [None req-3391c2c0-fc1f-4e28-bfe9-066acda27592 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=73781) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 23 02:54:30.239582 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG passlib.handlers.bcrypt [None req-3391c2c0-fc1f-4e28-bfe9-066acda27592 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=73781) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 23 02:54:30.239684 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77381bbb-4381-46e3-8bf0-31810d28cfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:30.240449 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77381bbb-4381-46e3-8bf0-31810d28cfbe admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:30.240759 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77381bbb-4381-46e3-8bf0-31810d28cfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:30.241035 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77381bbb-4381-46e3-8bf0-31810d28cfbe admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:30.254073 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77381bbb-4381-46e3-8bf0-31810d28cfbe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:54:30.260775 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-77381bbb-4381-46e3-8bf0-31810d28cfbe admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:54:30.261930 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 7/13] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:54:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:54:30.268172 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77381bbb-4381-46e3-8bf0-31810d28cfbe admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:30.277069 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77381bbb-4381-46e3-8bf0-31810d28cfbe admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:30.281390 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e172d92-95d9-42a2-8b92-e7f4af403c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:30.281977 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e172d92-95d9-42a2-8b92-e7f4af403c5d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:30.282301 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e172d92-95d9-42a2-8b92-e7f4af403c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:30.282579 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e172d92-95d9-42a2-8b92-e7f4af403c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:30.283300 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e172d92-95d9-42a2-8b92-e7f4af403c5d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:30.283606 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e172d92-95d9-42a2-8b92-e7f4af403c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:30.285357 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING py.warnings [None req-1e172d92-95d9-42a2-8b92-e7f4af403c5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:54:30.285357 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: warnings.warn(msg) Sep 23 02:54:30.285357 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: Sep 23 02:54:30.286244 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e172d92-95d9-42a2-8b92-e7f4af403c5d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:30.286619 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-3391c2c0-fc1f-4e28-bfe9-066acda27592 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:30.288227 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-3391c2c0-fc1f-4e28-bfe9-066acda27592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:30.299209 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 8/14] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:54:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:54:30.304946 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e172d92-95d9-42a2-8b92-e7f4af403c5d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:30.314049 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e172d92-95d9-42a2-8b92-e7f4af403c5d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:30.318365 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2db6c5-fe89-4a26-81b2-6404035c68be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:30.319174 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2db6c5-fe89-4a26-81b2-6404035c68be admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:30.319456 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2db6c5-fe89-4a26-81b2-6404035c68be admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:30.319739 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2db6c5-fe89-4a26-81b2-6404035c68be admin admin] PATH_INFO: `/v3/users/2a7711e2d0394daf9335168cae6f091d` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:30.320945 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2db6c5-fe89-4a26-81b2-6404035c68be admin admin] RBAC: Authorizing `identity:get_user(user_id=2a7711e2d0394daf9335168cae6f091d)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:30.322722 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2db6c5-fe89-4a26-81b2-6404035c68be admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:30.324356 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 9/15] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:54:30 2021] GET /identity/v3/users/2a7711e2d0394daf9335168cae6f091d => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:54:30.325843 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 7/16] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:54:30.330059 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2db6c5-fe89-4a26-81b2-6404035c68be admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:30.339039 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2db6c5-fe89-4a26-81b2-6404035c68be admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:30.343334 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c11103-82e8-4dfb-b0e2-de75baffc855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:30.344043 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c11103-82e8-4dfb-b0e2-de75baffc855 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:30.344323 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c11103-82e8-4dfb-b0e2-de75baffc855 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:30.344644 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c11103-82e8-4dfb-b0e2-de75baffc855 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:30.346335 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c11103-82e8-4dfb-b0e2-de75baffc855 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:30.347966 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c11103-82e8-4dfb-b0e2-de75baffc855 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:30.349503 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 10/17] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:54:30 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:30.349706 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391c2c0-fc1f-4e28-bfe9-066acda27592 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:30.355161 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c11103-82e8-4dfb-b0e2-de75baffc855 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:30.358903 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391c2c0-fc1f-4e28-bfe9-066acda27592 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:30.363502 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177b1be-8d83-452c-b0d4-1d9c0683e118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:30.364418 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c11103-82e8-4dfb-b0e2-de75baffc855 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:30.364558 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177b1be-8d83-452c-b0d4-1d9c0683e118 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:30.364759 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177b1be-8d83-452c-b0d4-1d9c0683e118 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:30.365042 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177b1be-8d83-452c-b0d4-1d9c0683e118 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:30.368728 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b84316-d0e7-481a-acc8-da72a71f7f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:30.369334 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b84316-d0e7-481a-acc8-da72a71f7f7d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:30.369615 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b84316-d0e7-481a-acc8-da72a71f7f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:30.369893 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b84316-d0e7-481a-acc8-da72a71f7f7d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:30.370697 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b84316-d0e7-481a-acc8-da72a71f7f7d admin admin] RBAC: Adding query filter params (role.id=3e7d7427203a4a4097e2c9a642b9bf69, scope.domain.id=default, user.id=2a7711e2d0394daf9335168cae6f091d) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:30.371009 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b84316-d0e7-481a-acc8-da72a71f7f7d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:30.371959 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING py.warnings [None req-77b84316-d0e7-481a-acc8-da72a71f7f7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:54:30.371959 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: warnings.warn(msg) Sep 23 02:54:30.371959 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: Sep 23 02:54:30.373119 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b84316-d0e7-481a-acc8-da72a71f7f7d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:30.373224 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177b1be-8d83-452c-b0d4-1d9c0683e118 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:30.374982 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177b1be-8d83-452c-b0d4-1d9c0683e118 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:30.379562 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 11/18] 10.222.0.23 () {56 vars in 1344 bytes} [Thu Sep 23 02:54:30 2021] GET /identity/v3/role_assignments?user.id=2a7711e2d0394daf9335168cae6f091d&scope.domain.id=default&role.id=3e7d7427203a4a4097e2c9a642b9bf69 => generated 233 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:54:30.384026 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 8/19] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:54:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 02:54:30.390650 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b84316-d0e7-481a-acc8-da72a71f7f7d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:30.401532 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b84316-d0e7-481a-acc8-da72a71f7f7d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:30.406209 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb3dd5-c1ed-43de-9d26-65ff892da9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:30.407042 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb3dd5-c1ed-43de-9d26-65ff892da9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:30.407918 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb3dd5-c1ed-43de-9d26-65ff892da9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:30.408200 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb3dd5-c1ed-43de-9d26-65ff892da9e7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:30.409598 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb3dd5-c1ed-43de-9d26-65ff892da9e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:30.411351 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb3dd5-c1ed-43de-9d26-65ff892da9e7 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:30.413083 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 12/20] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:54:30 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:33.099044 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d58206-a0b1-4f14-aff3-503bcf4a242f None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:33.099547 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d58206-a0b1-4f14-aff3-503bcf4a242f None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:33.099547 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d58206-a0b1-4f14-aff3-503bcf4a242f None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:33.101711 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 9/21] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:33.124706 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421be54-8fab-4d1b-8dc0-f098589e4b4b None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:33.125361 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421be54-8fab-4d1b-8dc0-f098589e4b4b None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:33.125361 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421be54-8fab-4d1b-8dc0-f098589e4b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:33.139083 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27e9e2-678e-4a99-8890-d960dbe58916 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:33.139651 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27e9e2-678e-4a99-8890-d960dbe58916 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:33.139903 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27e9e2-678e-4a99-8890-d960dbe58916 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:33.142561 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 10/22] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 02:54:33.151060 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-8421be54-8fab-4d1b-8dc0-f098589e4b4b None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:33.154601 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-8421be54-8fab-4d1b-8dc0-f098589e4b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:33.154721 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ff968-47cb-44a3-b624-57a5d9d75368 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:33.154721 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ff968-47cb-44a3-b624-57a5d9d75368 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:33.154721 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ff968-47cb-44a3-b624-57a5d9d75368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:33.164607 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 13/23] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:54:33.185826 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-1d4ff968-47cb-44a3-b624-57a5d9d75368 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:33.187033 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-1d4ff968-47cb-44a3-b624-57a5d9d75368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:33.205204 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 11/24] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:54:33.223592 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600586c-8381-44bd-a5ec-a1d30f054602 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:33.224096 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600586c-8381-44bd-a5ec-a1d30f054602 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:33.224577 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600586c-8381-44bd-a5ec-a1d30f054602 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:33.225576 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ff968-47cb-44a3-b624-57a5d9d75368 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:33.227295 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 14/25] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:33.236386 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600586c-8381-44bd-a5ec-a1d30f054602 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:33.236562 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ff968-47cb-44a3-b624-57a5d9d75368 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:33.241514 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc46709-67b6-42c2-9f53-e9c314b22637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:33.242314 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc46709-67b6-42c2-9f53-e9c314b22637 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:33.242864 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc46709-67b6-42c2-9f53-e9c314b22637 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:33.243368 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc46709-67b6-42c2-9f53-e9c314b22637 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:33.244444 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc46709-67b6-42c2-9f53-e9c314b22637 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:33.246353 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING py.warnings [None req-fbc46709-67b6-42c2-9f53-e9c314b22637 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:54:33.246353 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: warnings.warn(msg) Sep 23 02:54:33.246353 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: Sep 23 02:54:33.247560 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc46709-67b6-42c2-9f53-e9c314b22637 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:33.258698 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600586c-8381-44bd-a5ec-a1d30f054602 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:33.263136 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f904f0f-ba23-4c04-9e11-b5a8e0a261b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:33.268401 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f904f0f-ba23-4c04-9e11-b5a8e0a261b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:33.268401 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f904f0f-ba23-4c04-9e11-b5a8e0a261b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:33.268401 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f904f0f-ba23-4c04-9e11-b5a8e0a261b2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:33.281584 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f904f0f-ba23-4c04-9e11-b5a8e0a261b2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:54:33.288773 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-5f904f0f-ba23-4c04-9e11-b5a8e0a261b2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:54:33.290409 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 15/26] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:54:33 2021] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:54:33.292044 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec24d6-aa24-49ae-9e4a-a3fa6c816225 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:33.292516 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec24d6-aa24-49ae-9e4a-a3fa6c816225 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:33.293002 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec24d6-aa24-49ae-9e4a-a3fa6c816225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:33.314664 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-58ec24d6-aa24-49ae-9e4a-a3fa6c816225 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:33.316163 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-58ec24d6-aa24-49ae-9e4a-a3fa6c816225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:33.324536 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 16/27] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:54:33.325481 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec24d6-aa24-49ae-9e4a-a3fa6c816225 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:33.341929 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec24d6-aa24-49ae-9e4a-a3fa6c816225 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:33.346770 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c7909-d798-46a4-8e25-b97404bbde31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:33.347597 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c7909-d798-46a4-8e25-b97404bbde31 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:33.348040 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c7909-d798-46a4-8e25-b97404bbde31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:33.348535 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c7909-d798-46a4-8e25-b97404bbde31 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:33.349481 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c7909-d798-46a4-8e25-b97404bbde31 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:33.349931 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c7909-d798-46a4-8e25-b97404bbde31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:33.351706 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c7909-d798-46a4-8e25-b97404bbde31 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:33.361610 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 17/28] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:54:33 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:33.371332 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c7909-d798-46a4-8e25-b97404bbde31 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:33.381543 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c7909-d798-46a4-8e25-b97404bbde31 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:33.392157 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e4978-506b-4d2d-b5e7-62d1d0b26797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:33.393077 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e4978-506b-4d2d-b5e7-62d1d0b26797 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:33.393527 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e4978-506b-4d2d-b5e7-62d1d0b26797 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:33.393960 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e4978-506b-4d2d-b5e7-62d1d0b26797 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:33.394910 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e4978-506b-4d2d-b5e7-62d1d0b26797 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:33.396064 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING py.warnings [None req-677e4978-506b-4d2d-b5e7-62d1d0b26797 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:54:33.396064 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: warnings.warn(msg) Sep 23 02:54:33.396064 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: Sep 23 02:54:33.397305 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e4978-506b-4d2d-b5e7-62d1d0b26797 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:33.576001 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 12/29] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 02:54:33 2021] POST /identity/v3/roles => generated 219 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 02:54:33.577153 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc46709-67b6-42c2-9f53-e9c314b22637 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:33.598865 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc46709-67b6-42c2-9f53-e9c314b22637 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:33.614482 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16c131-484f-447e-9ff6-460b0e51d152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:33.615317 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16c131-484f-447e-9ff6-460b0e51d152 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:33.615599 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16c131-484f-447e-9ff6-460b0e51d152 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:33.615879 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16c131-484f-447e-9ff6-460b0e51d152 admin admin] PATH_INFO: `/v3/users/2a7711e2d0394daf9335168cae6f091d` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:33.617735 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16c131-484f-447e-9ff6-460b0e51d152 admin admin] RBAC: Authorizing `identity:get_user(user_id=2a7711e2d0394daf9335168cae6f091d)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:33.619679 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16c131-484f-447e-9ff6-460b0e51d152 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:33.628092 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 13/30] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:54:33 2021] GET /identity/v3/users/2a7711e2d0394daf9335168cae6f091d => generated 247 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:33.629786 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc755576-3880-445b-8a92-755d50f1ba8e None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:33.630081 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc755576-3880-445b-8a92-755d50f1ba8e None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:33.630365 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc755576-3880-445b-8a92-755d50f1ba8e None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:33.640596 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 14/31] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:33.640596 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc755576-3880-445b-8a92-755d50f1ba8e None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:33.670230 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc755576-3880-445b-8a92-755d50f1ba8e None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:33.677386 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 18/32] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 02:54:33 2021] POST /identity/v3/roles => generated 225 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 02:54:33.679342 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b23cd-fdb9-449d-ad02-aa3fcbf98cec None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:33.679862 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b23cd-fdb9-449d-ad02-aa3fcbf98cec None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:33.680386 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b23cd-fdb9-449d-ad02-aa3fcbf98cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:33.686328 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96bf0f-76eb-4750-8869-6988a353a71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:33.687413 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96bf0f-76eb-4750-8869-6988a353a71d admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:33.689892 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96bf0f-76eb-4750-8869-6988a353a71d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:33.690358 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96bf0f-76eb-4750-8869-6988a353a71d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:33.692769 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96bf0f-76eb-4750-8869-6988a353a71d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:33.694722 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96bf0f-76eb-4750-8869-6988a353a71d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:33.699475 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 15/33] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:54:33 2021] GET /identity/v3/domains/default => generated 199 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:33.706745 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96bf0f-76eb-4750-8869-6988a353a71d admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:33.721030 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-086b23cd-fdb9-449d-ad02-aa3fcbf98cec None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:33.722889 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-086b23cd-fdb9-449d-ad02-aa3fcbf98cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:33.731001 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96bf0f-76eb-4750-8869-6988a353a71d admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:33.742745 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479c60e-046f-449a-8796-f9b26353d10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:33.743075 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 19/34] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:54:33.743933 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479c60e-046f-449a-8796-f9b26353d10f admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:33.744225 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479c60e-046f-449a-8796-f9b26353d10f admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:33.744547 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479c60e-046f-449a-8796-f9b26353d10f admin admin] PATH_INFO: `/v3/domains/default/users/2a7711e2d0394daf9335168cae6f091d/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:33.750288 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479c60e-046f-449a-8796-f9b26353d10f admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2a7711e2d0394daf9335168cae6f091d, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:33.751461 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING py.warnings [None req-d479c60e-046f-449a-8796-f9b26353d10f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:54:33.751461 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: warnings.warn(msg) Sep 23 02:54:33.751461 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: Sep 23 02:54:33.753481 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479c60e-046f-449a-8796-f9b26353d10f admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:33.781611 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b23cd-fdb9-449d-ad02-aa3fcbf98cec None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:33.792441 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b23cd-fdb9-449d-ad02-aa3fcbf98cec None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:33.806654 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda141b-46c1-4c12-b976-e8f0ddb9acc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:33.807869 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda141b-46c1-4c12-b976-e8f0ddb9acc4 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:33.808326 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda141b-46c1-4c12-b976-e8f0ddb9acc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:33.808795 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda141b-46c1-4c12-b976-e8f0ddb9acc4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:33.825424 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda141b-46c1-4c12-b976-e8f0ddb9acc4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:33.827530 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda141b-46c1-4c12-b976-e8f0ddb9acc4 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:33.851145 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-cbda141b-46c1-4c12-b976-e8f0ddb9acc4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:54:33.852414 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 20/35] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:54:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:54:33.859060 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda141b-46c1-4c12-b976-e8f0ddb9acc4 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:33.867705 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 16/36] 10.222.0.23 () {58 vars in 1383 bytes} [Thu Sep 23 02:54:33 2021] PUT /identity/v3/domains/default/users/2a7711e2d0394daf9335168cae6f091d/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 02:54:33.870563 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda141b-46c1-4c12-b976-e8f0ddb9acc4 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:33.944743 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbea50-6f3b-4bc8-bd68-d561ca8897f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:33.945455 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbea50-6f3b-4bc8-bd68-d561ca8897f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:33.945755 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbea50-6f3b-4bc8-bd68-d561ca8897f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:33.946035 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbea50-6f3b-4bc8-bd68-d561ca8897f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:33.946792 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbea50-6f3b-4bc8-bd68-d561ca8897f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:33.947113 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbea50-6f3b-4bc8-bd68-d561ca8897f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:33.948250 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING py.warnings [None req-ffdbea50-6f3b-4bc8-bd68-d561ca8897f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:54:33.948250 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: warnings.warn(msg) Sep 23 02:54:33.948250 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: Sep 23 02:54:33.949433 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbea50-6f3b-4bc8-bd68-d561ca8897f7 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:33.975340 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 21/37] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:54:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:54:33.982371 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479c60e-046f-449a-8796-f9b26353d10f admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:33.995584 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479c60e-046f-449a-8796-f9b26353d10f admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:34.006990 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964e0b8-60ee-49ee-9c4f-2a8a73e4304b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:34.007692 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964e0b8-60ee-49ee-9c4f-2a8a73e4304b admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:34.007983 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964e0b8-60ee-49ee-9c4f-2a8a73e4304b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:34.008270 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964e0b8-60ee-49ee-9c4f-2a8a73e4304b admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:34.009039 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964e0b8-60ee-49ee-9c4f-2a8a73e4304b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:34.010104 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING py.warnings [None req-f964e0b8-60ee-49ee-9c4f-2a8a73e4304b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:54:34.010104 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: warnings.warn(msg) Sep 23 02:54:34.010104 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: Sep 23 02:54:34.011361 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964e0b8-60ee-49ee-9c4f-2a8a73e4304b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:34.154997 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 17/38] 10.222.0.23 () {60 vars in 1163 bytes} [Thu Sep 23 02:54:33 2021] POST /identity/v3/projects => generated 301 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 02:54:34.339754 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ae37e-83eb-471e-bbb2-1d597e68ae24 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:34.340256 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ae37e-83eb-471e-bbb2-1d597e68ae24 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:34.340632 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ae37e-83eb-471e-bbb2-1d597e68ae24 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:34.342848 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 22/39] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:34.351011 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a1277-a5cd-434a-bf26-0d7ce0916ab0 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:34.351296 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a1277-a5cd-434a-bf26-0d7ce0916ab0 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:34.351590 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a1277-a5cd-434a-bf26-0d7ce0916ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:34.370642 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-b98a1277-a5cd-434a-bf26-0d7ce0916ab0 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:34.372647 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-b98a1277-a5cd-434a-bf26-0d7ce0916ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:34.443441 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 18/40] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:54:34.476670 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ae37e-83eb-471e-bbb2-1d597e68ae24 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:34.489598 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ae37e-83eb-471e-bbb2-1d597e68ae24 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:34.493841 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe231e2f-9bc3-4204-93f0-289ac5b4ad37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:34.494510 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe231e2f-9bc3-4204-93f0-289ac5b4ad37 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:34.494801 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe231e2f-9bc3-4204-93f0-289ac5b4ad37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:34.495085 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe231e2f-9bc3-4204-93f0-289ac5b4ad37 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:34.495834 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe231e2f-9bc3-4204-93f0-289ac5b4ad37 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:34.497477 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe231e2f-9bc3-4204-93f0-289ac5b4ad37 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:34.589318 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 23/41] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 02:54:34 2021] POST /identity/v3/roles => generated 223 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 02:54:34.624530 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884d8e7-4e10-4e0d-b33f-c952d00dec8e None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:34.624874 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884d8e7-4e10-4e0d-b33f-c952d00dec8e None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:34.625120 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884d8e7-4e10-4e0d-b33f-c952d00dec8e None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:34.627776 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 19/42] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:34.635563 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f3f9f-7252-46f2-9f4c-13fcf080aecf None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:34.635865 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f3f9f-7252-46f2-9f4c-13fcf080aecf None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:34.636154 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f3f9f-7252-46f2-9f4c-13fcf080aecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:34.655751 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-720f3f9f-7252-46f2-9f4c-13fcf080aecf None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:34.657055 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-720f3f9f-7252-46f2-9f4c-13fcf080aecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:34.665221 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 24/43] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:54:34.690014 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884d8e7-4e10-4e0d-b33f-c952d00dec8e None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:34.702785 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884d8e7-4e10-4e0d-b33f-c952d00dec8e None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:34.707843 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c39b35-0413-4bd4-987a-b0960fd2845d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:34.708711 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c39b35-0413-4bd4-987a-b0960fd2845d admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:34.709006 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c39b35-0413-4bd4-987a-b0960fd2845d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:34.709291 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c39b35-0413-4bd4-987a-b0960fd2845d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:34.710527 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c39b35-0413-4bd4-987a-b0960fd2845d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:34.712303 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c39b35-0413-4bd4-987a-b0960fd2845d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:34.714265 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 20/44] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:54:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:34.720632 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f3f9f-7252-46f2-9f4c-13fcf080aecf None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:34.730325 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f3f9f-7252-46f2-9f4c-13fcf080aecf None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:34.735597 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c92e8f-57d9-4eaf-8402-52d2ca034279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:34.736436 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c92e8f-57d9-4eaf-8402-52d2ca034279 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:34.736843 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c92e8f-57d9-4eaf-8402-52d2ca034279 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:34.737199 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c92e8f-57d9-4eaf-8402-52d2ca034279 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:34.738019 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c92e8f-57d9-4eaf-8402-52d2ca034279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:34.739065 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING py.warnings [None req-e3c92e8f-57d9-4eaf-8402-52d2ca034279 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:54:34.739065 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: warnings.warn(msg) Sep 23 02:54:34.739065 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: Sep 23 02:54:34.740357 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c92e8f-57d9-4eaf-8402-52d2ca034279 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:34.830381 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 25/45] 10.222.0.23 () {60 vars in 1163 bytes} [Thu Sep 23 02:54:34 2021] POST /identity/v3/projects => generated 312 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 02:54:36.082764 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5605f6-2a57-4195-9513-b664a19a2902 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:36.083248 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5605f6-2a57-4195-9513-b664a19a2902 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:36.083248 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5605f6-2a57-4195-9513-b664a19a2902 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:36.085059 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 21/46] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:36.092540 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20307a6-7df5-4013-9772-bb995c3d0318 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:36.092985 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20307a6-7df5-4013-9772-bb995c3d0318 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:36.093114 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20307a6-7df5-4013-9772-bb995c3d0318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:36.111880 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-c20307a6-7df5-4013-9772-bb995c3d0318 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:36.113134 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-c20307a6-7df5-4013-9772-bb995c3d0318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:36.173484 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 26/47] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:54:36.197644 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5605f6-2a57-4195-9513-b664a19a2902 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:36.209963 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5605f6-2a57-4195-9513-b664a19a2902 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:36.214159 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b4afb-8331-4096-a7a1-665c969fcd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:36.214940 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b4afb-8331-4096-a7a1-665c969fcd94 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:36.215224 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b4afb-8331-4096-a7a1-665c969fcd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:36.215497 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b4afb-8331-4096-a7a1-665c969fcd94 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:36.228143 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b4afb-8331-4096-a7a1-665c969fcd94 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:54:36.234844 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-8f6b4afb-8331-4096-a7a1-665c969fcd94 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:54:36.236047 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 22/48] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:54:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:54:36.242467 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20307a6-7df5-4013-9772-bb995c3d0318 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:36.251458 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20307a6-7df5-4013-9772-bb995c3d0318 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:36.255853 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cb380-5d0b-42be-93ff-998b9f01de6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:36.256538 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cb380-5d0b-42be-93ff-998b9f01de6b admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:36.256831 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cb380-5d0b-42be-93ff-998b9f01de6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:36.257110 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cb380-5d0b-42be-93ff-998b9f01de6b admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:36.257861 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0cb380-5d0b-42be-93ff-998b9f01de6b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:36.258169 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0cb380-5d0b-42be-93ff-998b9f01de6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:36.259790 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0cb380-5d0b-42be-93ff-998b9f01de6b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:36.268692 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 27/49] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:54:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:36.274489 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b4afb-8331-4096-a7a1-665c969fcd94 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:36.284822 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b4afb-8331-4096-a7a1-665c969fcd94 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:36.289204 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f215d-d31a-4efe-8365-afdd87953cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:36.290059 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f215d-d31a-4efe-8365-afdd87953cec admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:36.290345 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f215d-d31a-4efe-8365-afdd87953cec admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:36.290628 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f215d-d31a-4efe-8365-afdd87953cec admin admin] PATH_INFO: `/v3/users/2a7711e2d0394daf9335168cae6f091d` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:36.291830 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f215d-d31a-4efe-8365-afdd87953cec admin admin] RBAC: Authorizing `identity:get_user(user_id=2a7711e2d0394daf9335168cae6f091d)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:36.293688 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f215d-d31a-4efe-8365-afdd87953cec admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:36.295252 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 23/50] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:54:36 2021] GET /identity/v3/users/2a7711e2d0394daf9335168cae6f091d => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:36.301301 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cb380-5d0b-42be-93ff-998b9f01de6b admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:36.310658 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cb380-5d0b-42be-93ff-998b9f01de6b admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:36.315597 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e2302-b45a-4a9c-990c-12dfd8afbdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:36.316372 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e2302-b45a-4a9c-990c-12dfd8afbdb5 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:36.316695 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e2302-b45a-4a9c-990c-12dfd8afbdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:36.316976 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e2302-b45a-4a9c-990c-12dfd8afbdb5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:36.318154 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e2302-b45a-4a9c-990c-12dfd8afbdb5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:36.319818 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e2302-b45a-4a9c-990c-12dfd8afbdb5 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:36.321404 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 28/51] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:54:36 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:36.327223 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f215d-d31a-4efe-8365-afdd87953cec admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:36.336938 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f215d-d31a-4efe-8365-afdd87953cec admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:36.341425 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177d0c4-a2ff-4ac8-8728-b31d1ae45dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:36.342145 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177d0c4-a2ff-4ac8-8728-b31d1ae45dbd admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:36.342437 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177d0c4-a2ff-4ac8-8728-b31d1ae45dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:36.342719 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177d0c4-a2ff-4ac8-8728-b31d1ae45dbd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:36.343543 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177d0c4-a2ff-4ac8-8728-b31d1ae45dbd admin admin] RBAC: Adding query filter params (role.id=3e7d7427203a4a4097e2c9a642b9bf69, scope.domain.id=default, user.id=2a7711e2d0394daf9335168cae6f091d) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:36.343859 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177d0c4-a2ff-4ac8-8728-b31d1ae45dbd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:36.344897 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING py.warnings [None req-6177d0c4-a2ff-4ac8-8728-b31d1ae45dbd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:54:36.344897 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: warnings.warn(msg) Sep 23 02:54:36.344897 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: Sep 23 02:54:36.346059 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177d0c4-a2ff-4ac8-8728-b31d1ae45dbd admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:36.353255 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 24/52] 10.222.0.23 () {56 vars in 1344 bytes} [Thu Sep 23 02:54:36 2021] GET /identity/v3/role_assignments?user.id=2a7711e2d0394daf9335168cae6f091d&scope.domain.id=default&role.id=3e7d7427203a4a4097e2c9a642b9bf69 => generated 530 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:37.065456 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c08423-10a3-46bc-89b9-a354e9ed01f3 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:37.065750 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c08423-10a3-46bc-89b9-a354e9ed01f3 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:37.066037 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c08423-10a3-46bc-89b9-a354e9ed01f3 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:37.067836 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 29/53] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:37.075921 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c57c87-c0e9-4d07-a79a-1e266a329afc None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:37.076163 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c57c87-c0e9-4d07-a79a-1e266a329afc None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:37.076447 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c57c87-c0e9-4d07-a79a-1e266a329afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:37.098627 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-d0c57c87-c0e9-4d07-a79a-1e266a329afc None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:37.099874 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-d0c57c87-c0e9-4d07-a79a-1e266a329afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:37.107453 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 25/54] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:54:37.131417 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c08423-10a3-46bc-89b9-a354e9ed01f3 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:37.144444 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c08423-10a3-46bc-89b9-a354e9ed01f3 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:37.148752 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e756583-7a49-4529-8bf5-8fe312d64aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:37.149536 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e756583-7a49-4529-8bf5-8fe312d64aec admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:37.149824 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e756583-7a49-4529-8bf5-8fe312d64aec admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:37.150100 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e756583-7a49-4529-8bf5-8fe312d64aec admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:37.151270 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e756583-7a49-4529-8bf5-8fe312d64aec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:37.153001 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e756583-7a49-4529-8bf5-8fe312d64aec admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:37.154580 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 30/55] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:54:37 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:37.163384 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c57c87-c0e9-4d07-a79a-1e266a329afc None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:37.172115 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c57c87-c0e9-4d07-a79a-1e266a329afc None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:37.176508 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489319a9-02ff-42f4-9230-adc5efc41d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:37.177158 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489319a9-02ff-42f4-9230-adc5efc41d4d admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:37.177448 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489319a9-02ff-42f4-9230-adc5efc41d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:37.177726 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489319a9-02ff-42f4-9230-adc5efc41d4d admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:37.178422 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489319a9-02ff-42f4-9230-adc5efc41d4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:37.180326 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489319a9-02ff-42f4-9230-adc5efc41d4d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:37.267330 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 26/56] 10.222.0.23 () {60 vars in 1162 bytes} [Thu Sep 23 02:54:37 2021] POST /identity/v3/projects => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 02:54:39.433281 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165a81c-c46c-4733-b524-67939206bd4f None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:39.433802 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165a81c-c46c-4733-b524-67939206bd4f None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:39.433882 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165a81c-c46c-4733-b524-67939206bd4f None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:39.435624 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 31/57] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:39.443509 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d9d38-4b05-4b1b-b07e-43ddeb7ec313 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:39.443899 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d9d38-4b05-4b1b-b07e-43ddeb7ec313 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:39.444084 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d9d38-4b05-4b1b-b07e-43ddeb7ec313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:39.461397 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-b67d9d38-4b05-4b1b-b07e-43ddeb7ec313 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:39.462598 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-b67d9d38-4b05-4b1b-b07e-43ddeb7ec313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:39.517369 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 27/58] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:54:39.543034 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165a81c-c46c-4733-b524-67939206bd4f None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:39.555621 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165a81c-c46c-4733-b524-67939206bd4f None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:39.559914 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc97a2-c2e0-4c7e-aeb8-8bdcc9c4b622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:39.560732 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc97a2-c2e0-4c7e-aeb8-8bdcc9c4b622 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:39.561022 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc97a2-c2e0-4c7e-aeb8-8bdcc9c4b622 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:39.561300 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc97a2-c2e0-4c7e-aeb8-8bdcc9c4b622 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:39.562471 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc97a2-c2e0-4c7e-aeb8-8bdcc9c4b622 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:39.564167 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc97a2-c2e0-4c7e-aeb8-8bdcc9c4b622 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:39.565759 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 32/59] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:54:39 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:39.571394 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d9d38-4b05-4b1b-b07e-43ddeb7ec313 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:39.580024 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d9d38-4b05-4b1b-b07e-43ddeb7ec313 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:39.584360 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca78609-6041-4456-8066-d55c99c819db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:39.585050 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca78609-6041-4456-8066-d55c99c819db admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:39.585340 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca78609-6041-4456-8066-d55c99c819db admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:39.585621 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca78609-6041-4456-8066-d55c99c819db admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:39.586338 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca78609-6041-4456-8066-d55c99c819db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:39.587347 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING py.warnings [None req-0ca78609-6041-4456-8066-d55c99c819db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:54:39.587347 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: warnings.warn(msg) Sep 23 02:54:39.587347 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: Sep 23 02:54:39.588597 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca78609-6041-4456-8066-d55c99c819db admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:39.702331 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 28/60] 10.222.0.23 () {60 vars in 1154 bytes} [Thu Sep 23 02:54:39 2021] POST /identity/v3/users => generated 275 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 02:54:43.026901 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c929d-b3ff-4343-8eee-b7281d80dcb6 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.027784 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c929d-b3ff-4343-8eee-b7281d80dcb6 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.028209 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c929d-b3ff-4343-8eee-b7281d80dcb6 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.030689 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 33/61] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:43.038442 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f3eb2-9fa4-4b56-bbd1-815c6e172be4 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.039342 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f3eb2-9fa4-4b56-bbd1-815c6e172be4 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.039772 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f3eb2-9fa4-4b56-bbd1-815c6e172be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.069588 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-be1f3eb2-9fa4-4b56-bbd1-815c6e172be4 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:43.071140 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-be1f3eb2-9fa4-4b56-bbd1-815c6e172be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:43.080577 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 29/62] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:54:43.117934 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c929d-b3ff-4343-8eee-b7281d80dcb6 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:43.126553 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa60ce7-2283-4825-a8a0-225ad99caad0 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.131386 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa60ce7-2283-4825-a8a0-225ad99caad0 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.131828 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa60ce7-2283-4825-a8a0-225ad99caad0 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.135580 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c929d-b3ff-4343-8eee-b7281d80dcb6 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:43.136405 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 30/63] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:43 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:43.142703 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130a639-e2bf-4891-9c40-be3f2fda5b6e None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.143466 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130a639-e2bf-4891-9c40-be3f2fda5b6e None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.144365 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130a639-e2bf-4891-9c40-be3f2fda5b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.149876 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce8455-58a0-4506-8c34-efcb3be93cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:43.150894 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce8455-58a0-4506-8c34-efcb3be93cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.151318 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce8455-58a0-4506-8c34-efcb3be93cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.151733 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce8455-58a0-4506-8c34-efcb3be93cb6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.173132 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce8455-58a0-4506-8c34-efcb3be93cb6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:54:43.181104 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-7130a639-e2bf-4891-9c40-be3f2fda5b6e None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:43.182584 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-7130a639-e2bf-4891-9c40-be3f2fda5b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:43.183420 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-27ce8455-58a0-4506-8c34-efcb3be93cb6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 02:54:43.184966 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 34/64] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Sep 23 02:54:43 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:54:43.186426 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c2ba4-b1ed-4bbf-a6f7-77aebbed033d None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.186929 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c2ba4-b1ed-4bbf-a6f7-77aebbed033d None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.188060 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c2ba4-b1ed-4bbf-a6f7-77aebbed033d None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.190331 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 35/65] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:43.191059 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c2ba4-b1ed-4bbf-a6f7-77aebbed033d None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:43.199792 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 31/66] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:54:43.201372 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f8e95-6c6d-4a6d-8452-fa8753bf4897 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.201894 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f8e95-6c6d-4a6d-8452-fa8753bf4897 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.202376 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f8e95-6c6d-4a6d-8452-fa8753bf4897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.204378 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c2ba4-b1ed-4bbf-a6f7-77aebbed033d None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:43.209093 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f2b23-3a72-420c-aa50-55fcc0b74e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:43.210024 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f2b23-3a72-420c-aa50-55fcc0b74e59 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.210591 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f2b23-3a72-420c-aa50-55fcc0b74e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.211065 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f2b23-3a72-420c-aa50-55fcc0b74e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.212005 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f2b23-3a72-420c-aa50-55fcc0b74e59 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:43.212531 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f2b23-3a72-420c-aa50-55fcc0b74e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:43.214421 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f2b23-3a72-420c-aa50-55fcc0b74e59 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:43.224024 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 36/67] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:54:43 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:43.232521 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f2b23-3a72-420c-aa50-55fcc0b74e59 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:43.237414 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-b15f8e95-6c6d-4a6d-8452-fa8753bf4897 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:43.237535 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f2b23-3a72-420c-aa50-55fcc0b74e59 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:43.238647 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-b15f8e95-6c6d-4a6d-8452-fa8753bf4897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:43.242158 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cb921-3483-4fb4-83f7-6f572dee4720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:43.243050 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cb921-3483-4fb4-83f7-6f572dee4720 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.243335 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cb921-3483-4fb4-83f7-6f572dee4720 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.243616 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cb921-3483-4fb4-83f7-6f572dee4720 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.246864 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 32/68] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:54:43.247677 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f8e95-6c6d-4a6d-8452-fa8753bf4897 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:43.257037 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f8e95-6c6d-4a6d-8452-fa8753bf4897 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:43.261810 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2b0d3-bcea-4502-b24c-061b441e1fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:43.262732 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2b0d3-bcea-4502-b24c-061b441e1fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.263026 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2b0d3-bcea-4502-b24c-061b441e1fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.263308 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2b0d3-bcea-4502-b24c-061b441e1fb5 admin admin] PATH_INFO: `/v3/users/2dab58951d01463b8f6d621dcf653d30` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.263407 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6cb921-3483-4fb4-83f7-6f572dee4720 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:54:43.270339 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-5c6cb921-3483-4fb4-83f7-6f572dee4720 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 02:54:43.271813 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 37/69] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:54:43 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:54:43.278104 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cb921-3483-4fb4-83f7-6f572dee4720 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:43.279028 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2b0d3-bcea-4502-b24c-061b441e1fb5 admin admin] RBAC: Authorizing `identity:get_user(user_id=2dab58951d01463b8f6d621dcf653d30)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:43.281257 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2b0d3-bcea-4502-b24c-061b441e1fb5 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:43.283819 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 33/70] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:54:43 2021] GET /identity/v3/users/2dab58951d01463b8f6d621dcf653d30 => generated 275 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:43.287163 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2b0d3-bcea-4502-b24c-061b441e1fb5 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:43.292761 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cb921-3483-4fb4-83f7-6f572dee4720 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:43.298364 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde1b1a-16ba-4f57-a767-1623d7d68da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:43.299526 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde1b1a-16ba-4f57-a767-1623d7d68da8 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.299961 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde1b1a-16ba-4f57-a767-1623d7d68da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.300383 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde1b1a-16ba-4f57-a767-1623d7d68da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.301131 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2b0d3-bcea-4502-b24c-061b441e1fb5 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:43.301501 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde1b1a-16ba-4f57-a767-1623d7d68da8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:43.301955 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde1b1a-16ba-4f57-a767-1623d7d68da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:43.303991 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde1b1a-16ba-4f57-a767-1623d7d68da8 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:43.312039 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34bdbd-9810-4746-9367-6871177a25a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:43.313634 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34bdbd-9810-4746-9367-6871177a25a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.314076 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 38/71] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Sep 23 02:54:43 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:43.314345 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34bdbd-9810-4746-9367-6871177a25a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.314636 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34bdbd-9810-4746-9367-6871177a25a0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.315372 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde1b1a-16ba-4f57-a767-1623d7d68da8 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:43.326084 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde1b1a-16ba-4f57-a767-1623d7d68da8 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:43.331159 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34bdbd-9810-4746-9367-6871177a25a0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:54:43.331487 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370df768-3d66-48e0-84c9-7e86ddd2d60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:43.332156 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370df768-3d66-48e0-84c9-7e86ddd2d60a admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.332445 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370df768-3d66-48e0-84c9-7e86ddd2d60a admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.332768 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370df768-3d66-48e0-84c9-7e86ddd2d60a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.338740 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-de34bdbd-9810-4746-9367-6871177a25a0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:54:43.340425 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 34/72] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:54:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:54:43.341376 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370df768-3d66-48e0-84c9-7e86ddd2d60a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:43.341576 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34bdbd-9810-4746-9367-6871177a25a0 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:43.345341 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370df768-3d66-48e0-84c9-7e86ddd2d60a admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:43.359099 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34bdbd-9810-4746-9367-6871177a25a0 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:43.365806 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 39/73] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:54:43 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:54:43.365806 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370df768-3d66-48e0-84c9-7e86ddd2d60a admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:43.369166 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11015edd-c4e9-4a47-a44c-0f4f95699c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:43.370271 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11015edd-c4e9-4a47-a44c-0f4f95699c04 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.370738 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11015edd-c4e9-4a47-a44c-0f4f95699c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.371186 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11015edd-c4e9-4a47-a44c-0f4f95699c04 admin admin] PATH_INFO: `/v3/users/2dab58951d01463b8f6d621dcf653d30` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.371285 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370df768-3d66-48e0-84c9-7e86ddd2d60a admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:43.372718 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11015edd-c4e9-4a47-a44c-0f4f95699c04 admin admin] RBAC: Authorizing `identity:get_user(user_id=2dab58951d01463b8f6d621dcf653d30)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:43.375984 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11015edd-c4e9-4a47-a44c-0f4f95699c04 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:43.376335 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89441cfa-7eda-4688-b3fd-73d45eaedc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:43.377026 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89441cfa-7eda-4688-b3fd-73d45eaedc2f admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.377313 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89441cfa-7eda-4688-b3fd-73d45eaedc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.377594 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89441cfa-7eda-4688-b3fd-73d45eaedc2f admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.378352 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89441cfa-7eda-4688-b3fd-73d45eaedc2f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:43.378675 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89441cfa-7eda-4688-b3fd-73d45eaedc2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:43.379168 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 35/74] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:54:43 2021] GET /identity/v3/users/2dab58951d01463b8f6d621dcf653d30 => generated 275 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:43.384046 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89441cfa-7eda-4688-b3fd-73d45eaedc2f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:43.385317 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11015edd-c4e9-4a47-a44c-0f4f95699c04 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:43.389809 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 40/75] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:54:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:43.390645 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89441cfa-7eda-4688-b3fd-73d45eaedc2f admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:43.400846 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11015edd-c4e9-4a47-a44c-0f4f95699c04 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:43.405597 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0b5fb-6018-4eea-88d5-5fe124e39808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:43.406341 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89441cfa-7eda-4688-b3fd-73d45eaedc2f admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:43.407454 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0b5fb-6018-4eea-88d5-5fe124e39808 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.407928 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0b5fb-6018-4eea-88d5-5fe124e39808 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.408404 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0b5fb-6018-4eea-88d5-5fe124e39808 admin admin] PATH_INFO: `/v3/projects/edbaae8686104e0483eccd80dd7b042d` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.410098 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0b5fb-6018-4eea-88d5-5fe124e39808 admin admin] RBAC: Authorizing `identity:get_project(project_id=edbaae8686104e0483eccd80dd7b042d)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:43.411493 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95064d4c-c8ca-48c6-acc3-0125c311b546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:43.412141 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95064d4c-c8ca-48c6-acc3-0125c311b546 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.412433 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95064d4c-c8ca-48c6-acc3-0125c311b546 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.412758 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95064d4c-c8ca-48c6-acc3-0125c311b546 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.413371 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0b5fb-6018-4eea-88d5-5fe124e39808 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:43.415243 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 36/76] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:54:43 2021] GET /identity/v3/projects/edbaae8686104e0483eccd80dd7b042d => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:43.421306 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0b5fb-6018-4eea-88d5-5fe124e39808 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:43.421539 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95064d4c-c8ca-48c6-acc3-0125c311b546 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:43.423492 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95064d4c-c8ca-48c6-acc3-0125c311b546 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:43.433076 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0b5fb-6018-4eea-88d5-5fe124e39808 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:43.434115 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 41/77] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:54:43 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:54:43.435080 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95064d4c-c8ca-48c6-acc3-0125c311b546 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:43.445386 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95064d4c-c8ca-48c6-acc3-0125c311b546 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:43.446003 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2e36a-769e-495f-9236-84ddde487384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:43.447216 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2e36a-769e-495f-9236-84ddde487384 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.447799 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2e36a-769e-495f-9236-84ddde487384 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.448384 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2e36a-769e-495f-9236-84ddde487384 admin admin] PATH_INFO: `/v3/users/2a7711e2d0394daf9335168cae6f091d` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.449908 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2e36a-769e-495f-9236-84ddde487384 admin admin] RBAC: Authorizing `identity:get_user(user_id=2a7711e2d0394daf9335168cae6f091d)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:43.450105 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005132d-25c7-4151-808a-832dc0e958f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:43.450761 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005132d-25c7-4151-808a-832dc0e958f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.451051 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005132d-25c7-4151-808a-832dc0e958f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.451335 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005132d-25c7-4151-808a-832dc0e958f5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.452178 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005132d-25c7-4151-808a-832dc0e958f5 admin admin] RBAC: Adding query filter params (role.id=1e311eea15274107873f2490f2cbc7b4, scope.project.id=edbaae8686104e0483eccd80dd7b042d, user.id=2dab58951d01463b8f6d621dcf653d30) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:43.452516 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005132d-25c7-4151-808a-832dc0e958f5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:43.453164 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2e36a-769e-495f-9236-84ddde487384 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:43.454957 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005132d-25c7-4151-808a-832dc0e958f5 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:43.455770 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 37/78] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:54:43 2021] GET /identity/v3/users/2a7711e2d0394daf9335168cae6f091d => generated 247 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:43.456770 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2e36a-769e-495f-9236-84ddde487384 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:43.465619 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 42/79] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:54:43 2021] GET /identity/v3/role_assignments?user.id=2dab58951d01463b8f6d621dcf653d30&scope.project.id=edbaae8686104e0483eccd80dd7b042d&role.id=1e311eea15274107873f2490f2cbc7b4 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:43.472531 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005132d-25c7-4151-808a-832dc0e958f5 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:43.477247 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005132d-25c7-4151-808a-832dc0e958f5 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:43.482566 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2e36a-769e-495f-9236-84ddde487384 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:43.482839 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27b06b-bf8c-448b-9f09-3e0baf0341e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:43.483505 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27b06b-bf8c-448b-9f09-3e0baf0341e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.483803 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27b06b-bf8c-448b-9f09-3e0baf0341e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.484075 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27b06b-bf8c-448b-9f09-3e0baf0341e2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.493218 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27b06b-bf8c-448b-9f09-3e0baf0341e2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:43.495012 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe6d31-0a37-47d3-b7ec-269b2e62c112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:43.495138 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27b06b-bf8c-448b-9f09-3e0baf0341e2 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:43.496197 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe6d31-0a37-47d3-b7ec-269b2e62c112 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.496731 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe6d31-0a37-47d3-b7ec-269b2e62c112 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.497204 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe6d31-0a37-47d3-b7ec-269b2e62c112 admin admin] PATH_INFO: `/v3/projects/edbaae8686104e0483eccd80dd7b042d` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.501609 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe6d31-0a37-47d3-b7ec-269b2e62c112 admin admin] RBAC: Authorizing `identity:get_project(project_id=edbaae8686104e0483eccd80dd7b042d)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:43.503999 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe6d31-0a37-47d3-b7ec-269b2e62c112 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:43.505890 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 43/80] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:54:43 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:54:43.506224 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 38/81] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:54:43 2021] GET /identity/v3/projects/edbaae8686104e0483eccd80dd7b042d => generated 298 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:43.512695 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27b06b-bf8c-448b-9f09-3e0baf0341e2 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:43.513139 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe6d31-0a37-47d3-b7ec-269b2e62c112 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:43.523226 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27b06b-bf8c-448b-9f09-3e0baf0341e2 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:43.528876 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a790c-344e-4a77-87a7-9efa86725545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:43.529893 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a790c-344e-4a77-87a7-9efa86725545 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.530183 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a790c-344e-4a77-87a7-9efa86725545 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.530467 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a790c-344e-4a77-87a7-9efa86725545 admin admin] PATH_INFO: `/v3/projects/edbaae8686104e0483eccd80dd7b042d` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.531724 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a790c-344e-4a77-87a7-9efa86725545 admin admin] RBAC: Authorizing `identity:get_project(project_id=edbaae8686104e0483eccd80dd7b042d)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:43.532454 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe6d31-0a37-47d3-b7ec-269b2e62c112 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:43.536547 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a790c-344e-4a77-87a7-9efa86725545 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:43.536547 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 44/82] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:54:43 2021] GET /identity/v3/projects/edbaae8686104e0483eccd80dd7b042d => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:43.542628 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a790c-344e-4a77-87a7-9efa86725545 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:43.544170 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23403374-83ff-46f1-b17a-e0851c15d346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:43.544909 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23403374-83ff-46f1-b17a-e0851c15d346 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.545200 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23403374-83ff-46f1-b17a-e0851c15d346 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.545485 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23403374-83ff-46f1-b17a-e0851c15d346 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.546367 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23403374-83ff-46f1-b17a-e0851c15d346 admin admin] RBAC: Adding query filter params (role.id=99e1944a08bf4c13b6c228cd63b66bcb, scope.project.id=edbaae8686104e0483eccd80dd7b042d, user.id=2dab58951d01463b8f6d621dcf653d30) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:43.546691 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23403374-83ff-46f1-b17a-e0851c15d346 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:43.548750 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23403374-83ff-46f1-b17a-e0851c15d346 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:43.553330 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a790c-344e-4a77-87a7-9efa86725545 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:43.565439 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 39/83] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:54:43 2021] GET /identity/v3/role_assignments?user.id=2dab58951d01463b8f6d621dcf653d30&scope.project.id=edbaae8686104e0483eccd80dd7b042d&role.id=99e1944a08bf4c13b6c228cd63b66bcb => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:54:43.579963 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b96fa0-85e9-4685-934c-2d4ea81845e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:43.579963 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b96fa0-85e9-4685-934c-2d4ea81845e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.579963 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b96fa0-85e9-4685-934c-2d4ea81845e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.579963 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b96fa0-85e9-4685-934c-2d4ea81845e9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.580332 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b96fa0-85e9-4685-934c-2d4ea81845e9 admin admin] RBAC: Adding query filter params (role.id=3e7d7427203a4a4097e2c9a642b9bf69, scope.project.id=edbaae8686104e0483eccd80dd7b042d, user.id=2a7711e2d0394daf9335168cae6f091d) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:43.580332 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b96fa0-85e9-4685-934c-2d4ea81845e9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:43.581953 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b96fa0-85e9-4685-934c-2d4ea81845e9 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:43.602842 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 45/84] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:54:43 2021] GET /identity/v3/role_assignments?user.id=2a7711e2d0394daf9335168cae6f091d&scope.project.id=edbaae8686104e0483eccd80dd7b042d&role.id=3e7d7427203a4a4097e2c9a642b9bf69 => generated 259 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:54:43.723156 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650e9dc-4482-4e13-907e-7fcc5ef4c808 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.723452 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650e9dc-4482-4e13-907e-7fcc5ef4c808 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.723748 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650e9dc-4482-4e13-907e-7fcc5ef4c808 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.725641 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 40/85] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:43.734524 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660b29c-7f57-46a7-9e0d-ea10b4a50583 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.735494 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660b29c-7f57-46a7-9e0d-ea10b4a50583 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.735874 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660b29c-7f57-46a7-9e0d-ea10b4a50583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.759981 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-3660b29c-7f57-46a7-9e0d-ea10b4a50583 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:43.761296 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-3660b29c-7f57-46a7-9e0d-ea10b4a50583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:43.770039 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 46/86] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:54:43.792472 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864aaf0-14e5-451f-a979-b1ecc55eed00 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.792840 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864aaf0-14e5-451f-a979-b1ecc55eed00 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.793132 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864aaf0-14e5-451f-a979-b1ecc55eed00 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.795079 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 41/87] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:43.795699 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660b29c-7f57-46a7-9e0d-ea10b4a50583 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:43.805976 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660b29c-7f57-46a7-9e0d-ea10b4a50583 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:43.812536 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2af9bc-82ae-4d9a-96a1-7acdcdc16cea None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.813455 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2af9bc-82ae-4d9a-96a1-7acdcdc16cea None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.813750 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2af9bc-82ae-4d9a-96a1-7acdcdc16cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.822977 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d2027-8e00-45dd-9688-522b98e96ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:43.824051 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d2027-8e00-45dd-9688-522b98e96ffc admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.824339 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d2027-8e00-45dd-9688-522b98e96ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.824657 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d2027-8e00-45dd-9688-522b98e96ffc admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.836243 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-bc2af9bc-82ae-4d9a-96a1-7acdcdc16cea None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:43.836467 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-bc2af9bc-82ae-4d9a-96a1-7acdcdc16cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:43.837443 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d2027-8e00-45dd-9688-522b98e96ffc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:54:43.844618 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-eb4d2027-8e00-45dd-9688-522b98e96ffc admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 02:54:43.845977 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 47/88] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:54:43 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:54:43.852390 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d2027-8e00-45dd-9688-522b98e96ffc admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:43.863130 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d2027-8e00-45dd-9688-522b98e96ffc admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:43.865781 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 42/89] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:54:43.869860 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af8888-7fbd-4d90-85a8-7420df444202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:43.870695 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af8888-7fbd-4d90-85a8-7420df444202 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.871113 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af8888-7fbd-4d90-85a8-7420df444202 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.871545 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af8888-7fbd-4d90-85a8-7420df444202 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.872428 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af8888-7fbd-4d90-85a8-7420df444202 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:43.872897 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af8888-7fbd-4d90-85a8-7420df444202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:43.874635 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af8888-7fbd-4d90-85a8-7420df444202 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:43.884506 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 48/90] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Sep 23 02:54:43 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:43.893543 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2af9bc-82ae-4d9a-96a1-7acdcdc16cea None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:43.909805 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2af9bc-82ae-4d9a-96a1-7acdcdc16cea None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:43.914014 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af8888-7fbd-4d90-85a8-7420df444202 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:43.922942 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670c989-3985-4ef2-88c7-a217d4a8ce8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:43.924052 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670c989-3985-4ef2-88c7-a217d4a8ce8f admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.925497 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670c989-3985-4ef2-88c7-a217d4a8ce8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.925921 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670c989-3985-4ef2-88c7-a217d4a8ce8f admin admin] PATH_INFO: `/v3/users/2dab58951d01463b8f6d621dcf653d30` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.927387 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670c989-3985-4ef2-88c7-a217d4a8ce8f admin admin] RBAC: Authorizing `identity:get_user(user_id=2dab58951d01463b8f6d621dcf653d30)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:43.929543 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af8888-7fbd-4d90-85a8-7420df444202 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:43.931870 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670c989-3985-4ef2-88c7-a217d4a8ce8f admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:43.934365 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 43/91] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:54:43 2021] GET /identity/v3/users/2dab58951d01463b8f6d621dcf653d30 => generated 275 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:43.943963 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b3e80-dc65-4fcf-9217-f8a589bc5174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:43.944854 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b3e80-dc65-4fcf-9217-f8a589bc5174 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.945138 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b3e80-dc65-4fcf-9217-f8a589bc5174 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.945413 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b3e80-dc65-4fcf-9217-f8a589bc5174 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.946708 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b3e80-dc65-4fcf-9217-f8a589bc5174 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:43.947371 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670c989-3985-4ef2-88c7-a217d4a8ce8f admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:43.948418 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b3e80-dc65-4fcf-9217-f8a589bc5174 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:43.950441 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 49/92] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:54:43 2021] GET /identity/v3/domains/default => generated 199 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:43.961686 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670c989-3985-4ef2-88c7-a217d4a8ce8f admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:43.965269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b3e80-dc65-4fcf-9217-f8a589bc5174 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:43.970155 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1882af4-0fd9-4bc3-8a39-7240f434962b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:43.971051 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1882af4-0fd9-4bc3-8a39-7240f434962b admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.971345 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1882af4-0fd9-4bc3-8a39-7240f434962b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.972206 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1882af4-0fd9-4bc3-8a39-7240f434962b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.975384 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b3e80-dc65-4fcf-9217-f8a589bc5174 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:43.987400 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1882af4-0fd9-4bc3-8a39-7240f434962b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:43.988444 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b747aff-142b-4eca-9440-5513e3d08c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:43.989190 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b747aff-142b-4eca-9440-5513e3d08c3a admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:43.989481 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b747aff-142b-4eca-9440-5513e3d08c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:43.989764 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b747aff-142b-4eca-9440-5513e3d08c3a admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:43.990493 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b747aff-142b-4eca-9440-5513e3d08c3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:43.992420 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b747aff-142b-4eca-9440-5513e3d08c3a admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:43.995107 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1882af4-0fd9-4bc3-8a39-7240f434962b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:44.011484 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 44/93] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:54:43 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 02:54:44.020216 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1882af4-0fd9-4bc3-8a39-7240f434962b admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:44.032892 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1882af4-0fd9-4bc3-8a39-7240f434962b admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:44.037486 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90130abb-1181-4d38-9677-e25bc8f0b1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:44.038351 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90130abb-1181-4d38-9677-e25bc8f0b1aa admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:44.038690 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90130abb-1181-4d38-9677-e25bc8f0b1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:44.039206 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90130abb-1181-4d38-9677-e25bc8f0b1aa admin admin] PATH_INFO: `/v3/projects/0df6b3a453954ff0bf75829697616d35` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:44.040157 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90130abb-1181-4d38-9677-e25bc8f0b1aa admin admin] RBAC: Authorizing `identity:get_project(project_id=0df6b3a453954ff0bf75829697616d35)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:44.042317 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90130abb-1181-4d38-9677-e25bc8f0b1aa admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:44.050458 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 45/94] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:54:44 2021] GET /identity/v3/projects/0df6b3a453954ff0bf75829697616d35 => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:44.050983 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90130abb-1181-4d38-9677-e25bc8f0b1aa admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:44.060885 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90130abb-1181-4d38-9677-e25bc8f0b1aa admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:44.065530 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d92c7-19b6-4388-a026-9bef9a109c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:44.066233 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d92c7-19b6-4388-a026-9bef9a109c82 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:44.066518 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d92c7-19b6-4388-a026-9bef9a109c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:44.066800 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d92c7-19b6-4388-a026-9bef9a109c82 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:44.067674 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d92c7-19b6-4388-a026-9bef9a109c82 admin admin] RBAC: Adding query filter params (role.id=99e1944a08bf4c13b6c228cd63b66bcb, scope.project.id=0df6b3a453954ff0bf75829697616d35, user.id=2dab58951d01463b8f6d621dcf653d30) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:44.067990 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d92c7-19b6-4388-a026-9bef9a109c82 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:44.069854 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d92c7-19b6-4388-a026-9bef9a109c82 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:44.075499 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 46/95] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:54:44 2021] GET /identity/v3/role_assignments?user.id=2dab58951d01463b8f6d621dcf653d30&scope.project.id=0df6b3a453954ff0bf75829697616d35&role.id=99e1944a08bf4c13b6c228cd63b66bcb => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:54:44.111661 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 50/96] 10.222.0.23 () {60 vars in 1163 bytes} [Thu Sep 23 02:54:43 2021] POST /identity/v3/projects => generated 302 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 02:54:46.032632 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b93d55-fb81-411c-bf0e-750e748da809 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:46.033130 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b93d55-fb81-411c-bf0e-750e748da809 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:46.033236 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b93d55-fb81-411c-bf0e-750e748da809 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:46.035127 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 47/97] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:46.053850 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcb4e2-2507-457a-b88c-b3c74432dd1b None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:46.054360 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcb4e2-2507-457a-b88c-b3c74432dd1b None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:46.054433 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcb4e2-2507-457a-b88c-b3c74432dd1b None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:46.056196 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 51/98] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:46.059401 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da38a06-7ae4-4fc5-9e3c-25eb9b1a5608 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:46.059700 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da38a06-7ae4-4fc5-9e3c-25eb9b1a5608 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:46.059984 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da38a06-7ae4-4fc5-9e3c-25eb9b1a5608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:46.063780 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ddd469-fdc4-4668-91c2-31a62f0fc62a None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:46.064069 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ddd469-fdc4-4668-91c2-31a62f0fc62a None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:46.064352 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ddd469-fdc4-4668-91c2-31a62f0fc62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:46.096040 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-3da38a06-7ae4-4fc5-9e3c-25eb9b1a5608 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:46.097192 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-3da38a06-7ae4-4fc5-9e3c-25eb9b1a5608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:46.098882 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-51ddd469-fdc4-4668-91c2-31a62f0fc62a None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:46.100048 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-51ddd469-fdc4-4668-91c2-31a62f0fc62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:46.175172 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 48/99] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:54:46.198596 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da38a06-7ae4-4fc5-9e3c-25eb9b1a5608 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:46.207382 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 52/100] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:54:46.209412 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da38a06-7ae4-4fc5-9e3c-25eb9b1a5608 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:46.213957 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68636ad3-b3a6-4896-9f12-5ea449629f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:46.214765 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68636ad3-b3a6-4896-9f12-5ea449629f39 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:46.215049 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68636ad3-b3a6-4896-9f12-5ea449629f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:46.215325 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68636ad3-b3a6-4896-9f12-5ea449629f39 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:46.226012 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68636ad3-b3a6-4896-9f12-5ea449629f39 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:54:46.233447 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-68636ad3-b3a6-4896-9f12-5ea449629f39 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 02:54:46.235384 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 49/101] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Sep 23 02:54:46 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:54:46.240949 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ddd469-fdc4-4668-91c2-31a62f0fc62a None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:46.247487 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68636ad3-b3a6-4896-9f12-5ea449629f39 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:46.251249 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ddd469-fdc4-4668-91c2-31a62f0fc62a None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:46.262515 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc14704-db26-4e19-9918-d1d9da0d4505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:46.263387 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc14704-db26-4e19-9918-d1d9da0d4505 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:46.263671 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc14704-db26-4e19-9918-d1d9da0d4505 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:46.264265 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc14704-db26-4e19-9918-d1d9da0d4505 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:46.269490 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68636ad3-b3a6-4896-9f12-5ea449629f39 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:46.281292 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feede729-33fb-4c35-935a-e2b412004736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:46.282502 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feede729-33fb-4c35-935a-e2b412004736 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:46.282781 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feede729-33fb-4c35-935a-e2b412004736 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:46.283056 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feede729-33fb-4c35-935a-e2b412004736 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:46.283808 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feede729-33fb-4c35-935a-e2b412004736 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:46.284115 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feede729-33fb-4c35-935a-e2b412004736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:46.285155 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING py.warnings [None req-feede729-33fb-4c35-935a-e2b412004736 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:54:46.285155 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: warnings.warn(msg) Sep 23 02:54:46.285155 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: Sep 23 02:54:46.286072 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feede729-33fb-4c35-935a-e2b412004736 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:46.288356 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc14704-db26-4e19-9918-d1d9da0d4505 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:54:46.295952 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-0dc14704-db26-4e19-9918-d1d9da0d4505 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:54:46.300532 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 53/102] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:54:46 2021] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:54:46.303872 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc14704-db26-4e19-9918-d1d9da0d4505 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:46.309922 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 50/103] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:54:46 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:54:46.318652 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc14704-db26-4e19-9918-d1d9da0d4505 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:46.322773 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feede729-33fb-4c35-935a-e2b412004736 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:46.334378 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feede729-33fb-4c35-935a-e2b412004736 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:46.336533 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6c58f-f056-47e8-9655-d20bc36bc82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:46.337275 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6c58f-f056-47e8-9655-d20bc36bc82d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:46.337563 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6c58f-f056-47e8-9655-d20bc36bc82d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:46.337840 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6c58f-f056-47e8-9655-d20bc36bc82d admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:46.338601 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6c58f-f056-47e8-9655-d20bc36bc82d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:46.338910 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6c58f-f056-47e8-9655-d20bc36bc82d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:46.340580 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6c58f-f056-47e8-9655-d20bc36bc82d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:46.347144 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fd446-e839-47bd-8032-55a386f25d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:46.347968 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fd446-e839-47bd-8032-55a386f25d23 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:46.348250 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fd446-e839-47bd-8032-55a386f25d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:46.348555 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fd446-e839-47bd-8032-55a386f25d23 admin admin] PATH_INFO: `/v3/users/2dab58951d01463b8f6d621dcf653d30` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:46.350562 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fd446-e839-47bd-8032-55a386f25d23 admin admin] RBAC: Authorizing `identity:get_user(user_id=2dab58951d01463b8f6d621dcf653d30)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:46.352811 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fd446-e839-47bd-8032-55a386f25d23 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:46.362289 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 51/104] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:54:46 2021] GET /identity/v3/users/2dab58951d01463b8f6d621dcf653d30 => generated 275 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:46.364380 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fd446-e839-47bd-8032-55a386f25d23 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:46.372689 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 54/105] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:54:46 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:46.381724 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6c58f-f056-47e8-9655-d20bc36bc82d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:46.389165 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fd446-e839-47bd-8032-55a386f25d23 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:46.396010 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6c58f-f056-47e8-9655-d20bc36bc82d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:46.400166 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81cce2-2cb4-4d43-973f-cca9a7632cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:46.401076 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81cce2-2cb4-4d43-973f-cca9a7632cea admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:46.401359 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81cce2-2cb4-4d43-973f-cca9a7632cea admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:46.401637 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81cce2-2cb4-4d43-973f-cca9a7632cea admin admin] PATH_INFO: `/v3/projects/edbaae8686104e0483eccd80dd7b042d` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:46.403278 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81cce2-2cb4-4d43-973f-cca9a7632cea admin admin] RBAC: Authorizing `identity:get_project(project_id=edbaae8686104e0483eccd80dd7b042d)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:46.405416 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81cce2-2cb4-4d43-973f-cca9a7632cea admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:46.405708 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc7a20-0fa5-431b-875b-d4d9f47b638e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:46.406627 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc7a20-0fa5-431b-875b-d4d9f47b638e admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:46.406916 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc7a20-0fa5-431b-875b-d4d9f47b638e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:46.407203 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc7a20-0fa5-431b-875b-d4d9f47b638e admin admin] PATH_INFO: `/v3/users/2a7711e2d0394daf9335168cae6f091d` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:46.407421 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 52/106] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:54:46 2021] GET /identity/v3/projects/edbaae8686104e0483eccd80dd7b042d => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:46.408499 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc7a20-0fa5-431b-875b-d4d9f47b638e admin admin] RBAC: Authorizing `identity:get_user(user_id=2a7711e2d0394daf9335168cae6f091d)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:46.408691 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ffbe1-1475-4275-bd2b-77d8e66908b6 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:46.408938 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ffbe1-1475-4275-bd2b-77d8e66908b6 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:46.409215 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ffbe1-1475-4275-bd2b-77d8e66908b6 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:46.410373 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc7a20-0fa5-431b-875b-d4d9f47b638e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:46.410843 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 53/107] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:46.412342 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 55/108] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:54:46 2021] GET /identity/v3/users/2a7711e2d0394daf9335168cae6f091d => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:54:46.418059 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815a0df-ae44-40f7-b227-1771ad8d24d8 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:46.418353 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815a0df-ae44-40f7-b227-1771ad8d24d8 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:46.418517 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc7a20-0fa5-431b-875b-d4d9f47b638e admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:46.418666 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815a0df-ae44-40f7-b227-1771ad8d24d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:46.429632 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc7a20-0fa5-431b-875b-d4d9f47b638e admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:46.434426 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b931c-b83d-4edf-9fe1-e6826fa3ce3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:46.435382 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b931c-b83d-4edf-9fe1-e6826fa3ce3b admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:46.435821 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b931c-b83d-4edf-9fe1-e6826fa3ce3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:46.436106 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b931c-b83d-4edf-9fe1-e6826fa3ce3b admin admin] PATH_INFO: `/v3/projects/edbaae8686104e0483eccd80dd7b042d/users/2dab58951d01463b8f6d621dcf653d30/roles/1e311eea15274107873f2490f2cbc7b4` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:46.436632 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-d815a0df-ae44-40f7-b227-1771ad8d24d8 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:46.438349 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-d815a0df-ae44-40f7-b227-1771ad8d24d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:46.438997 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b931c-b83d-4edf-9fe1-e6826fa3ce3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=edbaae8686104e0483eccd80dd7b042d, user_id=2dab58951d01463b8f6d621dcf653d30, role_id=1e311eea15274107873f2490f2cbc7b4)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:46.440236 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING py.warnings [None req-d12b931c-b83d-4edf-9fe1-e6826fa3ce3b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:54:46.440236 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: warnings.warn(msg) Sep 23 02:54:46.440236 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: Sep 23 02:54:46.442791 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b931c-b83d-4edf-9fe1-e6826fa3ce3b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:46.446201 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 54/109] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:54:46.446992 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815a0df-ae44-40f7-b227-1771ad8d24d8 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:46.462693 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815a0df-ae44-40f7-b227-1771ad8d24d8 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:46.467434 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587e0fa-40cc-44ae-a84f-e227bbc6a1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:46.468357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587e0fa-40cc-44ae-a84f-e227bbc6a1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:46.477638 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587e0fa-40cc-44ae-a84f-e227bbc6a1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:46.477638 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587e0fa-40cc-44ae-a84f-e227bbc6a1f7 admin admin] PATH_INFO: `/v3/projects/edbaae8686104e0483eccd80dd7b042d` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:46.477638 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587e0fa-40cc-44ae-a84f-e227bbc6a1f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=edbaae8686104e0483eccd80dd7b042d)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:46.477638 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587e0fa-40cc-44ae-a84f-e227bbc6a1f7 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:46.477638 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 55/110] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:54:46 2021] GET /identity/v3/projects/edbaae8686104e0483eccd80dd7b042d => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:46.477638 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587e0fa-40cc-44ae-a84f-e227bbc6a1f7 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:46.484570 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587e0fa-40cc-44ae-a84f-e227bbc6a1f7 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:46.488867 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba78b77-08d3-4673-9b4d-10b00f1ae0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:46.489646 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba78b77-08d3-4673-9b4d-10b00f1ae0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:46.489987 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba78b77-08d3-4673-9b4d-10b00f1ae0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:46.490271 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba78b77-08d3-4673-9b4d-10b00f1ae0d1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:46.501073 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba78b77-08d3-4673-9b4d-10b00f1ae0d1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:54:46.508121 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-aba78b77-08d3-4673-9b4d-10b00f1ae0d1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 02:54:46.509483 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 56/111] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:54:46 2021] GET /identity/v3/roles/member => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:54:46.512635 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba78b77-08d3-4673-9b4d-10b00f1ae0d1 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:46.531408 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 56/112] 10.222.0.23 () {58 vars in 1461 bytes} [Thu Sep 23 02:54:46 2021] PUT /identity/v3/projects/edbaae8686104e0483eccd80dd7b042d/users/2dab58951d01463b8f6d621dcf653d30/roles/1e311eea15274107873f2490f2cbc7b4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 02:54:46.532267 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b931c-b83d-4edf-9fe1-e6826fa3ce3b admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:46.535783 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba78b77-08d3-4673-9b4d-10b00f1ae0d1 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:46.602591 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22844b28-4e2b-4d7f-89bf-b107332d6193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:46.603857 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22844b28-4e2b-4d7f-89bf-b107332d6193 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:46.604401 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22844b28-4e2b-4d7f-89bf-b107332d6193 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:46.604893 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22844b28-4e2b-4d7f-89bf-b107332d6193 admin admin] PATH_INFO: `/v3/projects/edbaae8686104e0483eccd80dd7b042d/users/2a7711e2d0394daf9335168cae6f091d/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:46.607690 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22844b28-4e2b-4d7f-89bf-b107332d6193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edbaae8686104e0483eccd80dd7b042d, user_id=2a7711e2d0394daf9335168cae6f091d, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:46.611020 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22844b28-4e2b-4d7f-89bf-b107332d6193 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:46.664193 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b931c-b83d-4edf-9fe1-e6826fa3ce3b admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:46.669393 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42dde3f-a414-41ad-a80e-3a047aec2d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:46.670141 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42dde3f-a414-41ad-a80e-3a047aec2d9d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:46.670434 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42dde3f-a414-41ad-a80e-3a047aec2d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:46.670715 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42dde3f-a414-41ad-a80e-3a047aec2d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:46.671489 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42dde3f-a414-41ad-a80e-3a047aec2d9d admin admin] RBAC: Adding query filter params (name=member) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:46.671799 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42dde3f-a414-41ad-a80e-3a047aec2d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:46.674147 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42dde3f-a414-41ad-a80e-3a047aec2d9d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:46.684210 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 57/113] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Sep 23 02:54:46 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:46.690996 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42dde3f-a414-41ad-a80e-3a047aec2d9d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:46.702186 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42dde3f-a414-41ad-a80e-3a047aec2d9d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:46.707987 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da941a-5121-4514-a953-bd2dc67c77ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:46.709012 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da941a-5121-4514-a953-bd2dc67c77ef admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:46.709357 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da941a-5121-4514-a953-bd2dc67c77ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:46.709643 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da941a-5121-4514-a953-bd2dc67c77ef admin admin] PATH_INFO: `/v3/users/2dab58951d01463b8f6d621dcf653d30` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:46.711085 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da941a-5121-4514-a953-bd2dc67c77ef admin admin] RBAC: Authorizing `identity:get_user(user_id=2dab58951d01463b8f6d621dcf653d30)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:46.713656 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da941a-5121-4514-a953-bd2dc67c77ef admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:46.715862 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 58/114] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:54:46 2021] GET /identity/v3/users/2dab58951d01463b8f6d621dcf653d30 => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:46.725956 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da941a-5121-4514-a953-bd2dc67c77ef admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:46.731933 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 57/115] 10.222.0.23 () {58 vars in 1461 bytes} [Thu Sep 23 02:54:46 2021] PUT /identity/v3/projects/edbaae8686104e0483eccd80dd7b042d/users/2a7711e2d0394daf9335168cae6f091d/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 02:54:46.737621 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da941a-5121-4514-a953-bd2dc67c77ef admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:46.791228 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e45924-beb9-4252-947b-2f8ef1daf466 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:46.791750 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e45924-beb9-4252-947b-2f8ef1daf466 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:46.792173 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e45924-beb9-4252-947b-2f8ef1daf466 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:46.794355 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 58/116] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 02:54:46.803411 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d61e90-54da-4242-8aea-8b9a1917fc2f None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:46.803707 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d61e90-54da-4242-8aea-8b9a1917fc2f None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:46.804053 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d61e90-54da-4242-8aea-8b9a1917fc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:46.810216 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3be91-9b3d-469c-8230-c26f75f4be7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:46.811110 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3be91-9b3d-469c-8230-c26f75f4be7f admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:46.812127 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3be91-9b3d-469c-8230-c26f75f4be7f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:46.812127 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3be91-9b3d-469c-8230-c26f75f4be7f admin admin] PATH_INFO: `/v3/projects/edbaae8686104e0483eccd80dd7b042d` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:46.814533 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3be91-9b3d-469c-8230-c26f75f4be7f admin admin] RBAC: Authorizing `identity:get_project(project_id=edbaae8686104e0483eccd80dd7b042d)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:46.817899 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3be91-9b3d-469c-8230-c26f75f4be7f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:46.818607 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 59/117] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:54:46 2021] GET /identity/v3/projects/edbaae8686104e0483eccd80dd7b042d => generated 298 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:46.831851 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3be91-9b3d-469c-8230-c26f75f4be7f admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:46.843589 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-77d61e90-54da-4242-8aea-8b9a1917fc2f None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:46.845611 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-77d61e90-54da-4242-8aea-8b9a1917fc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:46.846484 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3be91-9b3d-469c-8230-c26f75f4be7f admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:46.854310 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 59/118] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:54:46.857949 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f91546-0973-4039-9683-26ac69a3eccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:46.859141 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f91546-0973-4039-9683-26ac69a3eccc admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:46.860166 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f91546-0973-4039-9683-26ac69a3eccc admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:46.860673 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f91546-0973-4039-9683-26ac69a3eccc admin admin] PATH_INFO: `/v3/projects/edbaae8686104e0483eccd80dd7b042d/users/2dab58951d01463b8f6d621dcf653d30/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:46.862854 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f91546-0973-4039-9683-26ac69a3eccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=edbaae8686104e0483eccd80dd7b042d, user_id=2dab58951d01463b8f6d621dcf653d30, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:46.865742 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f91546-0973-4039-9683-26ac69a3eccc admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:46.878607 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d61e90-54da-4242-8aea-8b9a1917fc2f None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:46.889758 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d61e90-54da-4242-8aea-8b9a1917fc2f None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:46.894843 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf392705-148f-4f72-91cf-6e3006c7fe61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:46.895725 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf392705-148f-4f72-91cf-6e3006c7fe61 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:46.896071 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf392705-148f-4f72-91cf-6e3006c7fe61 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:46.896357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf392705-148f-4f72-91cf-6e3006c7fe61 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:46.908527 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf392705-148f-4f72-91cf-6e3006c7fe61 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:54:46.915933 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-bf392705-148f-4f72-91cf-6e3006c7fe61 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 02:54:46.919332 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 60/119] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:54:46 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:54:46.924823 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf392705-148f-4f72-91cf-6e3006c7fe61 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:46.935855 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf392705-148f-4f72-91cf-6e3006c7fe61 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:46.947105 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 60/120] 10.222.0.23 () {58 vars in 1461 bytes} [Thu Sep 23 02:54:46 2021] PUT /identity/v3/projects/edbaae8686104e0483eccd80dd7b042d/users/2dab58951d01463b8f6d621dcf653d30/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 02:54:46.948891 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37b7e6-4cd8-4f8c-8dd7-9cb237abf811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:46.949594 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37b7e6-4cd8-4f8c-8dd7-9cb237abf811 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:46.949881 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37b7e6-4cd8-4f8c-8dd7-9cb237abf811 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:46.950215 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37b7e6-4cd8-4f8c-8dd7-9cb237abf811 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:46.951006 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37b7e6-4cd8-4f8c-8dd7-9cb237abf811 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:46.951317 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37b7e6-4cd8-4f8c-8dd7-9cb237abf811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:46.954097 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37b7e6-4cd8-4f8c-8dd7-9cb237abf811 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:46.966356 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 61/121] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Sep 23 02:54:46 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:54:46.972236 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f91546-0973-4039-9683-26ac69a3eccc admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:47.049759 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f91546-0973-4039-9683-26ac69a3eccc admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:47.057350 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9e6ec-259b-4a99-ae29-d3696bc239a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:47.058262 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9e6ec-259b-4a99-ae29-d3696bc239a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:47.058553 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9e6ec-259b-4a99-ae29-d3696bc239a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:47.058837 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9e6ec-259b-4a99-ae29-d3696bc239a3 admin admin] PATH_INFO: `/v3/users/2dab58951d01463b8f6d621dcf653d30` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:47.060121 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9e6ec-259b-4a99-ae29-d3696bc239a3 admin admin] RBAC: Authorizing `identity:get_user(user_id=2dab58951d01463b8f6d621dcf653d30)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:47.062385 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9e6ec-259b-4a99-ae29-d3696bc239a3 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:47.064942 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 61/122] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:54:46 2021] GET /identity/v3/users/2dab58951d01463b8f6d621dcf653d30 => generated 275 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:47.071267 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37b7e6-4cd8-4f8c-8dd7-9cb237abf811 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:47.081039 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696a66c-5044-459a-8d2b-92542c2fd10c None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:47.081497 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696a66c-5044-459a-8d2b-92542c2fd10c None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:47.081688 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696a66c-5044-459a-8d2b-92542c2fd10c None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:47.083667 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 62/123] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 02:54:47.088867 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37b7e6-4cd8-4f8c-8dd7-9cb237abf811 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:47.092009 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213977b-4e61-4f54-8fa8-cbb8f11b56f5 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:47.092303 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213977b-4e61-4f54-8fa8-cbb8f11b56f5 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:47.092635 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213977b-4e61-4f54-8fa8-cbb8f11b56f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:47.096710 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd1c6e-33a7-4ab6-9b1b-879752055347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:47.097602 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd1c6e-33a7-4ab6-9b1b-879752055347 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:47.097887 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd1c6e-33a7-4ab6-9b1b-879752055347 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:47.098170 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd1c6e-33a7-4ab6-9b1b-879752055347 admin admin] PATH_INFO: `/v3/projects/0df6b3a453954ff0bf75829697616d35` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:47.105574 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd1c6e-33a7-4ab6-9b1b-879752055347 admin admin] RBAC: Authorizing `identity:get_project(project_id=0df6b3a453954ff0bf75829697616d35)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:47.107636 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd1c6e-33a7-4ab6-9b1b-879752055347 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:47.109744 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 62/124] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:54:47 2021] GET /identity/v3/projects/0df6b3a453954ff0bf75829697616d35 => generated 312 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:47.113458 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-3213977b-4e61-4f54-8fa8-cbb8f11b56f5 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:47.114762 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-3213977b-4e61-4f54-8fa8-cbb8f11b56f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:47.116732 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd1c6e-33a7-4ab6-9b1b-879752055347 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:47.123282 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 63/125] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:54:47.138038 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd1c6e-33a7-4ab6-9b1b-879752055347 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:47.145040 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9bad5-e624-4b82-8450-b603b575156a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:47.146186 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9bad5-e624-4b82-8450-b603b575156a admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:47.146525 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9bad5-e624-4b82-8450-b603b575156a admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:47.146808 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9bad5-e624-4b82-8450-b603b575156a admin admin] PATH_INFO: `/v3/projects/0df6b3a453954ff0bf75829697616d35/users/2dab58951d01463b8f6d621dcf653d30/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:47.149032 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9bad5-e624-4b82-8450-b603b575156a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0df6b3a453954ff0bf75829697616d35, user_id=2dab58951d01463b8f6d621dcf653d30, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:47.151849 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9bad5-e624-4b82-8450-b603b575156a admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:47.166184 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213977b-4e61-4f54-8fa8-cbb8f11b56f5 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:47.176662 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213977b-4e61-4f54-8fa8-cbb8f11b56f5 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:47.181878 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48e670-1e93-423b-9429-138424066f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:47.182743 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48e670-1e93-423b-9429-138424066f85 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:47.183014 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48e670-1e93-423b-9429-138424066f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:47.183290 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48e670-1e93-423b-9429-138424066f85 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:47.184531 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48e670-1e93-423b-9429-138424066f85 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:47.186514 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48e670-1e93-423b-9429-138424066f85 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:47.189685 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 64/126] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:54:47 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:54:47.195852 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48e670-1e93-423b-9429-138424066f85 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:47.206753 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48e670-1e93-423b-9429-138424066f85 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:47.211241 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c19d55-e766-48b6-b264-e63472e8a904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:47.211971 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c19d55-e766-48b6-b264-e63472e8a904 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:47.212259 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c19d55-e766-48b6-b264-e63472e8a904 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:47.212558 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c19d55-e766-48b6-b264-e63472e8a904 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:47.213272 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c19d55-e766-48b6-b264-e63472e8a904 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:47.214291 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING py.warnings [None req-e9c19d55-e766-48b6-b264-e63472e8a904 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:54:47.214291 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: warnings.warn(msg) Sep 23 02:54:47.214291 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: Sep 23 02:54:47.215509 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c19d55-e766-48b6-b264-e63472e8a904 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:47.348940 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 63/127] 10.222.0.23 () {58 vars in 1461 bytes} [Thu Sep 23 02:54:47 2021] PUT /identity/v3/projects/0df6b3a453954ff0bf75829697616d35/users/2dab58951d01463b8f6d621dcf653d30/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 02:54:47.389761 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 65/128] 10.222.0.23 () {60 vars in 1154 bytes} [Thu Sep 23 02:54:47 2021] POST /identity/v3/users => generated 283 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 02:54:49.012369 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff31f5-3d64-40d9-85e0-f21d6a902166 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:49.013398 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff31f5-3d64-40d9-85e0-f21d6a902166 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:49.014147 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff31f5-3d64-40d9-85e0-f21d6a902166 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:49.016716 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 64/129] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:49 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:49.024544 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0559d1-0478-4089-9218-34336bdb1a2c None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:49.025008 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0559d1-0478-4089-9218-34336bdb1a2c None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:49.025192 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0559d1-0478-4089-9218-34336bdb1a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:49.044668 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-2e0559d1-0478-4089-9218-34336bdb1a2c None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:49.046239 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-2e0559d1-0478-4089-9218-34336bdb1a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:49.122919 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 66/130] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:54:49.163102 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff31f5-3d64-40d9-85e0-f21d6a902166 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:49.178764 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff31f5-3d64-40d9-85e0-f21d6a902166 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:49.185773 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7628f0-4083-4949-b54c-574d1ef32fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:49.186886 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7628f0-4083-4949-b54c-574d1ef32fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:49.187363 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7628f0-4083-4949-b54c-574d1ef32fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:49.187862 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7628f0-4083-4949-b54c-574d1ef32fc9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:49.201828 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7628f0-4083-4949-b54c-574d1ef32fc9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:54:49.202472 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123420f6-918b-439c-8a6b-f93cb2b3ec07 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:49.202770 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123420f6-918b-439c-8a6b-f93cb2b3ec07 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:49.203058 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123420f6-918b-439c-8a6b-f93cb2b3ec07 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:49.205733 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 67/131] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:49 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:49.210815 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-aa7628f0-4083-4949-b54c-574d1ef32fc9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 02:54:49.212325 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 65/132] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Sep 23 02:54:49 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:54:49.214409 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69558473-1792-4758-9a3a-5c6f7d989f52 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:49.214652 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69558473-1792-4758-9a3a-5c6f7d989f52 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:49.214939 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69558473-1792-4758-9a3a-5c6f7d989f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:49.227945 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7628f0-4083-4949-b54c-574d1ef32fc9 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:49.241827 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7628f0-4083-4949-b54c-574d1ef32fc9 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:49.242545 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-69558473-1792-4758-9a3a-5c6f7d989f52 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:49.243832 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-69558473-1792-4758-9a3a-5c6f7d989f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:49.254245 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e718e2-7662-4bf1-ad85-8abcc69e52cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:49.255363 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e718e2-7662-4bf1-ad85-8abcc69e52cb admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:49.255953 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e718e2-7662-4bf1-ad85-8abcc69e52cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:49.256424 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e718e2-7662-4bf1-ad85-8abcc69e52cb admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:49.257591 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e718e2-7662-4bf1-ad85-8abcc69e52cb admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:49.258132 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e718e2-7662-4bf1-ad85-8abcc69e52cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:49.259403 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 68/133] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:54:49.260293 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e718e2-7662-4bf1-ad85-8abcc69e52cb admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:49.274717 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 66/134] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:54:49 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:54:49.281161 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69558473-1792-4758-9a3a-5c6f7d989f52 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:49.295915 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69558473-1792-4758-9a3a-5c6f7d989f52 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:49.304666 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54982c-989b-4048-ac84-7a38556bfba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:49.305561 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54982c-989b-4048-ac84-7a38556bfba1 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:49.305848 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54982c-989b-4048-ac84-7a38556bfba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:49.306131 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54982c-989b-4048-ac84-7a38556bfba1 admin admin] PATH_INFO: `/v3/users/2dab58951d01463b8f6d621dcf653d30` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:49.307343 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a54982c-989b-4048-ac84-7a38556bfba1 admin admin] RBAC: Authorizing `identity:get_user(user_id=2dab58951d01463b8f6d621dcf653d30)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:49.309940 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e718e2-7662-4bf1-ad85-8abcc69e52cb admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:49.311731 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a54982c-989b-4048-ac84-7a38556bfba1 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:49.315004 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 69/135] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:54:49 2021] GET /identity/v3/users/2dab58951d01463b8f6d621dcf653d30 => generated 275 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:49.321106 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54982c-989b-4048-ac84-7a38556bfba1 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:49.328254 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e718e2-7662-4bf1-ad85-8abcc69e52cb admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:49.334376 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54982c-989b-4048-ac84-7a38556bfba1 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:49.338017 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8ee48-b1b6-4d8e-a1c1-3fb19623bb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:49.339185 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8ee48-b1b6-4d8e-a1c1-3fb19623bb58 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:49.339740 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8ee48-b1b6-4d8e-a1c1-3fb19623bb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:49.340232 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8ee48-b1b6-4d8e-a1c1-3fb19623bb58 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:49.340465 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2fda2-32c4-4a1b-b11f-044e735b71bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:49.341142 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2fda2-32c4-4a1b-b11f-044e735b71bd admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:49.341436 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2fda2-32c4-4a1b-b11f-044e735b71bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:49.341718 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2fda2-32c4-4a1b-b11f-044e735b71bd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:49.354576 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2fda2-32c4-4a1b-b11f-044e735b71bd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:49.356090 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8ee48-b1b6-4d8e-a1c1-3fb19623bb58 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:54:49.356739 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2fda2-32c4-4a1b-b11f-044e735b71bd admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:49.365901 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-0bf8ee48-b1b6-4d8e-a1c1-3fb19623bb58 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:54:49.367524 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 67/136] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:54:49 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:54:49.368320 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 70/137] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:54:49 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 02:54:49.374583 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8ee48-b1b6-4d8e-a1c1-3fb19623bb58 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:49.374716 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2fda2-32c4-4a1b-b11f-044e735b71bd admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:49.385542 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2fda2-32c4-4a1b-b11f-044e735b71bd admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:49.395497 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8ee48-b1b6-4d8e-a1c1-3fb19623bb58 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:49.398692 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c4e51-a784-4185-9317-0dc73f1b098a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:49.399961 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c4e51-a784-4185-9317-0dc73f1b098a admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:49.401194 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c4e51-a784-4185-9317-0dc73f1b098a admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:49.401823 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c4e51-a784-4185-9317-0dc73f1b098a admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:49.403251 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c4e51-a784-4185-9317-0dc73f1b098a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:49.404913 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c4e51-a784-4185-9317-0dc73f1b098a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:49.413260 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a599c7-e3ca-4f2d-b93f-38bd4c0fe924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:49.414492 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c4e51-a784-4185-9317-0dc73f1b098a admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:49.415580 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a599c7-e3ca-4f2d-b93f-38bd4c0fe924 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:49.416529 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a599c7-e3ca-4f2d-b93f-38bd4c0fe924 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:49.417860 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a599c7-e3ca-4f2d-b93f-38bd4c0fe924 admin admin] PATH_INFO: `/v3/projects/edbaae8686104e0483eccd80dd7b042d` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:49.419848 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a599c7-e3ca-4f2d-b93f-38bd4c0fe924 admin admin] RBAC: Authorizing `identity:get_project(project_id=edbaae8686104e0483eccd80dd7b042d)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:49.425450 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a599c7-e3ca-4f2d-b93f-38bd4c0fe924 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:49.433419 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 68/138] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:54:49 2021] GET /identity/v3/projects/edbaae8686104e0483eccd80dd7b042d => generated 298 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:49.436078 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 71/139] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:54:49 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:49.440359 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a599c7-e3ca-4f2d-b93f-38bd4c0fe924 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:49.443524 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c4e51-a784-4185-9317-0dc73f1b098a admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:49.458719 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a599c7-e3ca-4f2d-b93f-38bd4c0fe924 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:49.462623 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c4e51-a784-4185-9317-0dc73f1b098a admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:49.469490 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97937a-4c68-47e8-827c-67b5de08c7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:49.470862 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97937a-4c68-47e8-827c-67b5de08c7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:49.471052 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69aecf-7f5d-4f98-a204-bbf8359a75c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:49.471531 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97937a-4c68-47e8-827c-67b5de08c7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:49.471698 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69aecf-7f5d-4f98-a204-bbf8359a75c5 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:49.471998 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69aecf-7f5d-4f98-a204-bbf8359a75c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:49.472283 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69aecf-7f5d-4f98-a204-bbf8359a75c5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:49.472594 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97937a-4c68-47e8-827c-67b5de08c7c6 admin admin] PATH_INFO: `/v3/users/2a7711e2d0394daf9335168cae6f091d` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:49.473154 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69aecf-7f5d-4f98-a204-bbf8359a75c5 admin admin] RBAC: Adding query filter params (role.id=1e311eea15274107873f2490f2cbc7b4, scope.project.id=edbaae8686104e0483eccd80dd7b042d, user.id=2dab58951d01463b8f6d621dcf653d30) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:49.473472 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69aecf-7f5d-4f98-a204-bbf8359a75c5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:49.475387 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69aecf-7f5d-4f98-a204-bbf8359a75c5 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:49.476375 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97937a-4c68-47e8-827c-67b5de08c7c6 admin admin] RBAC: Authorizing `identity:get_user(user_id=2a7711e2d0394daf9335168cae6f091d)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:49.478499 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97937a-4c68-47e8-827c-67b5de08c7c6 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:49.480394 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 72/140] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:54:49 2021] GET /identity/v3/users/2a7711e2d0394daf9335168cae6f091d => generated 247 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:49.486634 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97937a-4c68-47e8-827c-67b5de08c7c6 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:49.487892 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 69/141] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:54:49 2021] GET /identity/v3/role_assignments?user.id=2dab58951d01463b8f6d621dcf653d30&scope.project.id=edbaae8686104e0483eccd80dd7b042d&role.id=1e311eea15274107873f2490f2cbc7b4 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:54:49.502743 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97937a-4c68-47e8-827c-67b5de08c7c6 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:49.515435 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485f716-e79a-485c-bdf4-4042c4c5ce06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:49.516471 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485f716-e79a-485c-bdf4-4042c4c5ce06 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:49.516928 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485f716-e79a-485c-bdf4-4042c4c5ce06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:49.517309 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6df14-2df0-4787-8e77-68a466849e59 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:49.517532 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485f716-e79a-485c-bdf4-4042c4c5ce06 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:49.517656 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6df14-2df0-4787-8e77-68a466849e59 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:49.517885 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6df14-2df0-4787-8e77-68a466849e59 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:49.519797 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 70/142] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 02:54:49.527954 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68b22e-7835-49a6-8f4a-d45aef98b246 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:49.528203 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68b22e-7835-49a6-8f4a-d45aef98b246 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:49.528515 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68b22e-7835-49a6-8f4a-d45aef98b246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:49.533270 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485f716-e79a-485c-bdf4-4042c4c5ce06 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:49.535580 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485f716-e79a-485c-bdf4-4042c4c5ce06 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:49.551052 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 73/143] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:54:49 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 02:54:49.557650 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485f716-e79a-485c-bdf4-4042c4c5ce06 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:49.568094 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485f716-e79a-485c-bdf4-4042c4c5ce06 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:49.576004 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-cf68b22e-7835-49a6-8f4a-d45aef98b246 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:49.576855 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83137a76-d200-41da-9a66-b985b6a2598b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:49.578013 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83137a76-d200-41da-9a66-b985b6a2598b admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:49.578558 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83137a76-d200-41da-9a66-b985b6a2598b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:49.579002 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83137a76-d200-41da-9a66-b985b6a2598b admin admin] PATH_INFO: `/v3/projects/edbaae8686104e0483eccd80dd7b042d` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:49.581542 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83137a76-d200-41da-9a66-b985b6a2598b admin admin] RBAC: Authorizing `identity:get_project(project_id=edbaae8686104e0483eccd80dd7b042d)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:49.581671 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-cf68b22e-7835-49a6-8f4a-d45aef98b246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:49.584075 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83137a76-d200-41da-9a66-b985b6a2598b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:49.586491 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 74/144] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:54:49 2021] GET /identity/v3/projects/edbaae8686104e0483eccd80dd7b042d => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:49.592813 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83137a76-d200-41da-9a66-b985b6a2598b admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:49.598826 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 71/145] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 23 02:54:49.607975 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83137a76-d200-41da-9a66-b985b6a2598b admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:49.621300 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dbc279-b8bf-40ca-a3aa-55a151e1b983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:49.622221 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbc279-b8bf-40ca-a3aa-55a151e1b983 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:49.622670 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbc279-b8bf-40ca-a3aa-55a151e1b983 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:49.623088 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbc279-b8bf-40ca-a3aa-55a151e1b983 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:49.624080 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dbc279-b8bf-40ca-a3aa-55a151e1b983 admin admin] RBAC: Adding query filter params (role.id=3e7d7427203a4a4097e2c9a642b9bf69, scope.project.id=edbaae8686104e0483eccd80dd7b042d, user.id=2a7711e2d0394daf9335168cae6f091d) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:49.624554 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dbc279-b8bf-40ca-a3aa-55a151e1b983 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:49.626634 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dbc279-b8bf-40ca-a3aa-55a151e1b983 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:49.633380 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 75/146] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:54:49 2021] GET /identity/v3/role_assignments?user.id=2a7711e2d0394daf9335168cae6f091d&scope.project.id=edbaae8686104e0483eccd80dd7b042d&role.id=3e7d7427203a4a4097e2c9a642b9bf69 => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:54:49.634471 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68b22e-7835-49a6-8f4a-d45aef98b246 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:49.655343 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68b22e-7835-49a6-8f4a-d45aef98b246 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:49.664642 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620333fe-ce1b-4ac9-bbeb-7e43e95b5c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:49.665493 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620333fe-ce1b-4ac9-bbeb-7e43e95b5c48 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:49.665781 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620333fe-ce1b-4ac9-bbeb-7e43e95b5c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:49.666064 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620333fe-ce1b-4ac9-bbeb-7e43e95b5c48 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:49.690036 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620333fe-ce1b-4ac9-bbeb-7e43e95b5c48 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:54:49.697083 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-620333fe-ce1b-4ac9-bbeb-7e43e95b5c48 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 02:54:49.698363 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 72/147] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:54:49 2021] GET /identity/v3/roles/member => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:54:49.705753 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dbc279-b8bf-40ca-a3aa-55a151e1b983 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:49.718129 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dbc279-b8bf-40ca-a3aa-55a151e1b983 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:49.728616 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc69a78-f970-4f7f-a554-afef90caed52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:49.729597 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc69a78-f970-4f7f-a554-afef90caed52 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:49.730040 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc69a78-f970-4f7f-a554-afef90caed52 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:49.730455 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc69a78-f970-4f7f-a554-afef90caed52 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:49.731394 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc69a78-f970-4f7f-a554-afef90caed52 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:49.731851 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc69a78-f970-4f7f-a554-afef90caed52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:49.737900 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc69a78-f970-4f7f-a554-afef90caed52 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:49.747811 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 76/148] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Sep 23 02:54:49 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:49.754671 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620333fe-ce1b-4ac9-bbeb-7e43e95b5c48 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:49.770564 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620333fe-ce1b-4ac9-bbeb-7e43e95b5c48 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:49.776862 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75142ab5-1700-432c-9781-f0ea66b2c41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:49.777763 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75142ab5-1700-432c-9781-f0ea66b2c41f admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:49.778045 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75142ab5-1700-432c-9781-f0ea66b2c41f admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:49.778323 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75142ab5-1700-432c-9781-f0ea66b2c41f admin admin] PATH_INFO: `/v3/users/2dab58951d01463b8f6d621dcf653d30` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:49.781270 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75142ab5-1700-432c-9781-f0ea66b2c41f admin admin] RBAC: Authorizing `identity:get_user(user_id=2dab58951d01463b8f6d621dcf653d30)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:49.783514 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75142ab5-1700-432c-9781-f0ea66b2c41f admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:49.785458 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 73/149] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:54:49 2021] GET /identity/v3/users/2dab58951d01463b8f6d621dcf653d30 => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:49.791860 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc69a78-f970-4f7f-a554-afef90caed52 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:49.806031 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc69a78-f970-4f7f-a554-afef90caed52 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:49.830092 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7eeb76-9652-43d2-b9d1-48a37a6d7c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:49.831038 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7eeb76-9652-43d2-b9d1-48a37a6d7c51 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:49.831466 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7eeb76-9652-43d2-b9d1-48a37a6d7c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:49.831885 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7eeb76-9652-43d2-b9d1-48a37a6d7c51 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:49.844899 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7eeb76-9652-43d2-b9d1-48a37a6d7c51 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:49.846935 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7eeb76-9652-43d2-b9d1-48a37a6d7c51 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:49.864022 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 77/150] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:54:49 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:54:49.870322 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75142ab5-1700-432c-9781-f0ea66b2c41f admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:49.895250 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75142ab5-1700-432c-9781-f0ea66b2c41f admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:49.904863 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95dd1ba-4c56-4e87-aa19-9201db195b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:49.905758 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95dd1ba-4c56-4e87-aa19-9201db195b16 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:49.906042 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95dd1ba-4c56-4e87-aa19-9201db195b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:49.906387 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95dd1ba-4c56-4e87-aa19-9201db195b16 admin admin] PATH_INFO: `/v3/projects/edbaae8686104e0483eccd80dd7b042d` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:49.908967 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95dd1ba-4c56-4e87-aa19-9201db195b16 admin admin] RBAC: Authorizing `identity:get_project(project_id=edbaae8686104e0483eccd80dd7b042d)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:49.911082 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95dd1ba-4c56-4e87-aa19-9201db195b16 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:49.913915 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 74/151] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:54:49 2021] GET /identity/v3/projects/edbaae8686104e0483eccd80dd7b042d => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:49.919473 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7eeb76-9652-43d2-b9d1-48a37a6d7c51 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:49.933832 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7eeb76-9652-43d2-b9d1-48a37a6d7c51 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:49.944337 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b1674-a75b-4333-a835-e2d1ab642e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:49.945242 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b1674-a75b-4333-a835-e2d1ab642e3c admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:49.945761 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b1674-a75b-4333-a835-e2d1ab642e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:49.946170 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b1674-a75b-4333-a835-e2d1ab642e3c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:49.947141 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b1674-a75b-4333-a835-e2d1ab642e3c admin admin] RBAC: Adding query filter params (role.id=99e1944a08bf4c13b6c228cd63b66bcb, scope.project.id=edbaae8686104e0483eccd80dd7b042d, user.id=2dab58951d01463b8f6d621dcf653d30) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:49.947604 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b1674-a75b-4333-a835-e2d1ab642e3c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:49.949678 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b1674-a75b-4333-a835-e2d1ab642e3c admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:49.961166 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 78/152] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:54:49 2021] GET /identity/v3/role_assignments?user.id=2dab58951d01463b8f6d621dcf653d30&scope.project.id=edbaae8686104e0483eccd80dd7b042d&role.id=99e1944a08bf4c13b6c228cd63b66bcb => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:50.547876 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046ebfd-89aa-43bb-b74b-260559e7fea6 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:50.548399 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046ebfd-89aa-43bb-b74b-260559e7fea6 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:50.548471 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046ebfd-89aa-43bb-b74b-260559e7fea6 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:50.550559 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 75/153] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:50.558195 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7df4ac-76d8-4b43-a4ff-cc15abfde3ff None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:50.558626 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7df4ac-76d8-4b43-a4ff-cc15abfde3ff None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:50.558792 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7df4ac-76d8-4b43-a4ff-cc15abfde3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:50.580775 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-bf7df4ac-76d8-4b43-a4ff-cc15abfde3ff None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:50.582172 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-bf7df4ac-76d8-4b43-a4ff-cc15abfde3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:50.597001 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 79/154] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:54:50.637645 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046ebfd-89aa-43bb-b74b-260559e7fea6 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:50.654263 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046ebfd-89aa-43bb-b74b-260559e7fea6 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:50.661952 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fd4bb-87b2-40c2-8551-675fb2d2a904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:50.662752 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fd4bb-87b2-40c2-8551-675fb2d2a904 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:50.663036 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fd4bb-87b2-40c2-8551-675fb2d2a904 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:50.663315 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fd4bb-87b2-40c2-8551-675fb2d2a904 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:50.678294 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95fd4bb-87b2-40c2-8551-675fb2d2a904 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:54:50.685088 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-f95fd4bb-87b2-40c2-8551-675fb2d2a904 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 02:54:50.686465 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 76/155] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:54:50 2021] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:54:50.692798 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7df4ac-76d8-4b43-a4ff-cc15abfde3ff None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:50.702068 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7df4ac-76d8-4b43-a4ff-cc15abfde3ff None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:50.712857 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54be631-b7b7-4978-9136-67fe507ef9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:50.713551 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54be631-b7b7-4978-9136-67fe507ef9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:50.713889 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54be631-b7b7-4978-9136-67fe507ef9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:50.714167 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54be631-b7b7-4978-9136-67fe507ef9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:50.714934 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54be631-b7b7-4978-9136-67fe507ef9e7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:50.715245 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54be631-b7b7-4978-9136-67fe507ef9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:50.716983 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54be631-b7b7-4978-9136-67fe507ef9e7 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:50.729573 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 80/156] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Sep 23 02:54:50 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:50.736284 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fd4bb-87b2-40c2-8551-675fb2d2a904 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:50.749598 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fd4bb-87b2-40c2-8551-675fb2d2a904 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:50.760789 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd570b4-f99b-4257-bd84-009a7f95ff13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:50.761696 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd570b4-f99b-4257-bd84-009a7f95ff13 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:50.761986 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd570b4-f99b-4257-bd84-009a7f95ff13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:50.762269 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd570b4-f99b-4257-bd84-009a7f95ff13 admin admin] PATH_INFO: `/v3/users/2dab58951d01463b8f6d621dcf653d30` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:50.769295 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd570b4-f99b-4257-bd84-009a7f95ff13 admin admin] RBAC: Authorizing `identity:get_user(user_id=2dab58951d01463b8f6d621dcf653d30)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:50.771474 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd570b4-f99b-4257-bd84-009a7f95ff13 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:50.773211 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 77/157] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:54:50 2021] GET /identity/v3/users/2dab58951d01463b8f6d621dcf653d30 => generated 275 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:50.779477 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54be631-b7b7-4978-9136-67fe507ef9e7 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:50.790572 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54be631-b7b7-4978-9136-67fe507ef9e7 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:50.800841 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688612d-d444-4092-b31f-64a990e44d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:50.801501 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688612d-d444-4092-b31f-64a990e44d7b admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:50.801838 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688612d-d444-4092-b31f-64a990e44d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:50.802118 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688612d-d444-4092-b31f-64a990e44d7b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:50.818511 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b688612d-d444-4092-b31f-64a990e44d7b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:50.819905 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b688612d-d444-4092-b31f-64a990e44d7b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:50.833870 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 81/158] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:54:50 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:54:50.840285 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd570b4-f99b-4257-bd84-009a7f95ff13 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:50.862989 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd570b4-f99b-4257-bd84-009a7f95ff13 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:50.872685 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d915de-64b7-4507-b3be-1c90c096c6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:50.873590 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d915de-64b7-4507-b3be-1c90c096c6cf admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:50.873873 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d915de-64b7-4507-b3be-1c90c096c6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:50.874152 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d915de-64b7-4507-b3be-1c90c096c6cf admin admin] PATH_INFO: `/v3/projects/0df6b3a453954ff0bf75829697616d35` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:50.881332 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d915de-64b7-4507-b3be-1c90c096c6cf admin admin] RBAC: Authorizing `identity:get_project(project_id=0df6b3a453954ff0bf75829697616d35)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:50.883448 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d915de-64b7-4507-b3be-1c90c096c6cf admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:50.885624 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 78/159] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:54:50 2021] GET /identity/v3/projects/0df6b3a453954ff0bf75829697616d35 => generated 312 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:50.892190 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688612d-d444-4092-b31f-64a990e44d7b admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:50.902999 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688612d-d444-4092-b31f-64a990e44d7b admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:50.914068 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd24dc-720a-47c8-9f81-05385f417cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:50.914788 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd24dc-720a-47c8-9f81-05385f417cef admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:50.915126 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd24dc-720a-47c8-9f81-05385f417cef admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:50.915409 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd24dc-720a-47c8-9f81-05385f417cef admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:50.916375 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd24dc-720a-47c8-9f81-05385f417cef admin admin] RBAC: Adding query filter params (role.id=99e1944a08bf4c13b6c228cd63b66bcb, scope.project.id=0df6b3a453954ff0bf75829697616d35, user.id=2dab58951d01463b8f6d621dcf653d30) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:50.916710 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd24dc-720a-47c8-9f81-05385f417cef admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:50.918617 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd24dc-720a-47c8-9f81-05385f417cef admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:50.925300 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 82/160] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:54:50 2021] GET /identity/v3/role_assignments?user.id=2dab58951d01463b8f6d621dcf653d30&scope.project.id=0df6b3a453954ff0bf75829697616d35&role.id=99e1944a08bf4c13b6c228cd63b66bcb => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:51.397239 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0c8b2-6978-420a-aea3-d2721f92dcf2 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:51.397608 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0c8b2-6978-420a-aea3-d2721f92dcf2 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:51.397801 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0c8b2-6978-420a-aea3-d2721f92dcf2 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:51.399885 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 79/161] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:51.407783 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47668e33-6087-487d-ac5e-2ba75705093e None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:51.408063 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47668e33-6087-487d-ac5e-2ba75705093e None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:51.408349 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47668e33-6087-487d-ac5e-2ba75705093e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:51.428615 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-47668e33-6087-487d-ac5e-2ba75705093e None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:51.429820 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-47668e33-6087-487d-ac5e-2ba75705093e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:51.442515 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 83/162] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:54:51.468396 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0c8b2-6978-420a-aea3-d2721f92dcf2 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:51.482379 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0c8b2-6978-420a-aea3-d2721f92dcf2 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:51.488583 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8b9a6-25aa-46f3-81cd-f42a456f73c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:51.489402 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8b9a6-25aa-46f3-81cd-f42a456f73c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:51.489689 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8b9a6-25aa-46f3-81cd-f42a456f73c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:51.489968 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8b9a6-25aa-46f3-81cd-f42a456f73c9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:51.514897 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8b9a6-25aa-46f3-81cd-f42a456f73c9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:54:51.522306 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-57a8b9a6-25aa-46f3-81cd-f42a456f73c9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 02:54:51.528649 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 80/163] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:54:51 2021] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:54:51.530592 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47668e33-6087-487d-ac5e-2ba75705093e None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:51.540448 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47668e33-6087-487d-ac5e-2ba75705093e None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:51.550871 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee1a5b-4e2c-4bbf-849e-2242452f3f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:51.551550 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee1a5b-4e2c-4bbf-849e-2242452f3f5f admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:51.551827 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee1a5b-4e2c-4bbf-849e-2242452f3f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:51.552097 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee1a5b-4e2c-4bbf-849e-2242452f3f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:51.552877 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee1a5b-4e2c-4bbf-849e-2242452f3f5f admin admin] RBAC: Adding query filter params (name=member) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:51.553182 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee1a5b-4e2c-4bbf-849e-2242452f3f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:51.554803 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee1a5b-4e2c-4bbf-849e-2242452f3f5f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:51.563889 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 84/164] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Sep 23 02:54:51 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:54:51.571826 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8b9a6-25aa-46f3-81cd-f42a456f73c9 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:51.584624 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8b9a6-25aa-46f3-81cd-f42a456f73c9 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:51.593169 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd5517-3e31-4ab8-8a2e-e7e5d2c4daae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:51.594574 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd5517-3e31-4ab8-8a2e-e7e5d2c4daae admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:51.594858 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd5517-3e31-4ab8-8a2e-e7e5d2c4daae admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:51.595137 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd5517-3e31-4ab8-8a2e-e7e5d2c4daae admin admin] PATH_INFO: `/v3/users/16d1a714a7ba40a2997ccaedc5163b95` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:51.612593 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd5517-3e31-4ab8-8a2e-e7e5d2c4daae admin admin] RBAC: Authorizing `identity:get_user(user_id=16d1a714a7ba40a2997ccaedc5163b95)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:51.614766 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd5517-3e31-4ab8-8a2e-e7e5d2c4daae admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:51.617714 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 81/165] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:54:51 2021] GET /identity/v3/users/16d1a714a7ba40a2997ccaedc5163b95 => generated 283 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:51.623784 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee1a5b-4e2c-4bbf-849e-2242452f3f5f admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:51.634217 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee1a5b-4e2c-4bbf-849e-2242452f3f5f admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:51.638700 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a62d78-f6fb-4f25-84d0-654a82d85f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:51.639597 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a62d78-f6fb-4f25-84d0-654a82d85f8d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:51.639878 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a62d78-f6fb-4f25-84d0-654a82d85f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:51.640153 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a62d78-f6fb-4f25-84d0-654a82d85f8d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:51.648474 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a62d78-f6fb-4f25-84d0-654a82d85f8d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:51.650291 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a62d78-f6fb-4f25-84d0-654a82d85f8d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:51.659879 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 85/166] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:54:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:54:51.666181 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd5517-3e31-4ab8-8a2e-e7e5d2c4daae admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:51.676596 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd5517-3e31-4ab8-8a2e-e7e5d2c4daae admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:51.681430 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1e9fd-6a3c-4f21-b581-80c0b1407929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:51.682354 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1e9fd-6a3c-4f21-b581-80c0b1407929 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:51.682649 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1e9fd-6a3c-4f21-b581-80c0b1407929 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:51.682979 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1e9fd-6a3c-4f21-b581-80c0b1407929 admin admin] PATH_INFO: `/v3/projects/fc55a3bab8cf46219f282e51c510171b` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:51.684379 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1e9fd-6a3c-4f21-b581-80c0b1407929 admin admin] RBAC: Authorizing `identity:get_project(project_id=fc55a3bab8cf46219f282e51c510171b)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:51.686655 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1e9fd-6a3c-4f21-b581-80c0b1407929 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:51.689166 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 82/167] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:54:51 2021] GET /identity/v3/projects/fc55a3bab8cf46219f282e51c510171b => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:51.695571 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a62d78-f6fb-4f25-84d0-654a82d85f8d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:51.704848 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a62d78-f6fb-4f25-84d0-654a82d85f8d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:51.709413 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5bc16-773d-44df-b056-c1185aef2a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:51.710123 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5bc16-773d-44df-b056-c1185aef2a2f admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:51.710405 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5bc16-773d-44df-b056-c1185aef2a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:51.710679 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5bc16-773d-44df-b056-c1185aef2a2f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:51.711564 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5bc16-773d-44df-b056-c1185aef2a2f admin admin] RBAC: Adding query filter params (role.id=99e1944a08bf4c13b6c228cd63b66bcb, scope.project.id=fc55a3bab8cf46219f282e51c510171b, user.id=16d1a714a7ba40a2997ccaedc5163b95) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:51.711931 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5bc16-773d-44df-b056-c1185aef2a2f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:51.713865 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5bc16-773d-44df-b056-c1185aef2a2f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:51.720747 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 86/168] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:54:51 2021] GET /identity/v3/role_assignments?user.id=16d1a714a7ba40a2997ccaedc5163b95&scope.project.id=fc55a3bab8cf46219f282e51c510171b&role.id=99e1944a08bf4c13b6c228cd63b66bcb => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:52.136918 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632accf0-d4b9-48a0-8c23-2963866f0844 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:52.137301 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632accf0-d4b9-48a0-8c23-2963866f0844 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:52.137482 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632accf0-d4b9-48a0-8c23-2963866f0844 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:52.139665 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 83/169] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:52.148319 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c490543-ab2c-4dcc-908d-dcd2dc34d3cc None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:52.148319 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c490543-ab2c-4dcc-908d-dcd2dc34d3cc None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:52.148319 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c490543-ab2c-4dcc-908d-dcd2dc34d3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:52.168178 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-0c490543-ab2c-4dcc-908d-dcd2dc34d3cc None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:52.170066 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-0c490543-ab2c-4dcc-908d-dcd2dc34d3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:52.179364 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 87/170] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:54:52.205575 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632accf0-d4b9-48a0-8c23-2963866f0844 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:52.217707 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632accf0-d4b9-48a0-8c23-2963866f0844 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:52.222582 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cc6d1-7315-482f-892d-f073e51b5ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:52.223363 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cc6d1-7315-482f-892d-f073e51b5ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:52.223644 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cc6d1-7315-482f-892d-f073e51b5ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:52.223918 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cc6d1-7315-482f-892d-f073e51b5ae1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:52.237389 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cc6d1-7315-482f-892d-f073e51b5ae1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:54:52.244304 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-e52cc6d1-7315-482f-892d-f073e51b5ae1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:54:52.245627 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 84/171] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:54:52 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:54:52.252597 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c490543-ab2c-4dcc-908d-dcd2dc34d3cc None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:52.262428 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c490543-ab2c-4dcc-908d-dcd2dc34d3cc None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:52.269136 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bad73-dac1-4e74-bc1c-546339962b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:52.269829 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bad73-dac1-4e74-bc1c-546339962b86 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:52.270105 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bad73-dac1-4e74-bc1c-546339962b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:52.270379 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bad73-dac1-4e74-bc1c-546339962b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:52.271142 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1bad73-dac1-4e74-bc1c-546339962b86 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:52.271445 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1bad73-dac1-4e74-bc1c-546339962b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:52.273215 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1bad73-dac1-4e74-bc1c-546339962b86 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:52.282893 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 88/172] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:54:52 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:52.290070 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cc6d1-7315-482f-892d-f073e51b5ae1 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:52.300975 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cc6d1-7315-482f-892d-f073e51b5ae1 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:52.305424 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87791f3-105c-4001-b384-513611cb23cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:52.306289 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87791f3-105c-4001-b384-513611cb23cb admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:52.306572 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87791f3-105c-4001-b384-513611cb23cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:52.306849 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87791f3-105c-4001-b384-513611cb23cb admin admin] PATH_INFO: `/v3/users/2a7711e2d0394daf9335168cae6f091d` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:52.308042 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87791f3-105c-4001-b384-513611cb23cb admin admin] RBAC: Authorizing `identity:get_user(user_id=2a7711e2d0394daf9335168cae6f091d)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:52.310119 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87791f3-105c-4001-b384-513611cb23cb admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:52.313390 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 85/173] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:54:52 2021] GET /identity/v3/users/2a7711e2d0394daf9335168cae6f091d => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:52.320098 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bad73-dac1-4e74-bc1c-546339962b86 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:52.331558 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bad73-dac1-4e74-bc1c-546339962b86 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:52.335930 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dff6e-0dba-4558-89cf-6c75d2e703c6 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:52.336293 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dff6e-0dba-4558-89cf-6c75d2e703c6 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:52.336601 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dff6e-0dba-4558-89cf-6c75d2e703c6 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:52.337478 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8410f-a9c5-4f97-92bd-8247f9d24658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:52.338144 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8410f-a9c5-4f97-92bd-8247f9d24658 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:52.338423 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8410f-a9c5-4f97-92bd-8247f9d24658 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:52.338744 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8410f-a9c5-4f97-92bd-8247f9d24658 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:52.338927 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 86/174] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:52.348310 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088cb68-a754-4db8-931f-444c1cc34ae4 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:52.348760 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088cb68-a754-4db8-931f-444c1cc34ae4 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:52.349216 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088cb68-a754-4db8-931f-444c1cc34ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:52.356609 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8410f-a9c5-4f97-92bd-8247f9d24658 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:52.358385 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8410f-a9c5-4f97-92bd-8247f9d24658 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:52.368264 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 89/175] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:54:52 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:54:52.371752 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-7088cb68-a754-4db8-931f-444c1cc34ae4 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:52.373273 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-7088cb68-a754-4db8-931f-444c1cc34ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:52.376709 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8410f-a9c5-4f97-92bd-8247f9d24658 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:52.382697 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 87/176] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:54:52.388672 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8410f-a9c5-4f97-92bd-8247f9d24658 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:52.392731 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28559e6a-ddaf-48e3-9048-6ec623245764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:52.393586 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28559e6a-ddaf-48e3-9048-6ec623245764 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:52.393858 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28559e6a-ddaf-48e3-9048-6ec623245764 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:52.394130 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28559e6a-ddaf-48e3-9048-6ec623245764 admin admin] PATH_INFO: `/v3/projects/fc55a3bab8cf46219f282e51c510171b` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:52.395299 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28559e6a-ddaf-48e3-9048-6ec623245764 admin admin] RBAC: Authorizing `identity:get_project(project_id=fc55a3bab8cf46219f282e51c510171b)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:52.397373 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28559e6a-ddaf-48e3-9048-6ec623245764 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:52.399026 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 90/177] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:54:52 2021] GET /identity/v3/projects/fc55a3bab8cf46219f282e51c510171b => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:54:52.408202 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088cb68-a754-4db8-931f-444c1cc34ae4 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:52.410949 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28559e6a-ddaf-48e3-9048-6ec623245764 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:52.418115 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088cb68-a754-4db8-931f-444c1cc34ae4 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:52.422964 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28559e6a-ddaf-48e3-9048-6ec623245764 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:52.423442 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1530f49-75fd-4e5e-83f7-3fbe6ba8e555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:52.424095 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1530f49-75fd-4e5e-83f7-3fbe6ba8e555 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:52.424376 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1530f49-75fd-4e5e-83f7-3fbe6ba8e555 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:52.424677 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1530f49-75fd-4e5e-83f7-3fbe6ba8e555 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:52.425507 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1530f49-75fd-4e5e-83f7-3fbe6ba8e555 admin admin] RBAC: Adding query filter params (role.id=3e7d7427203a4a4097e2c9a642b9bf69, scope.project.id=fc55a3bab8cf46219f282e51c510171b, user.id=2a7711e2d0394daf9335168cae6f091d) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:52.425818 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1530f49-75fd-4e5e-83f7-3fbe6ba8e555 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:52.427922 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1530f49-75fd-4e5e-83f7-3fbe6ba8e555 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:52.429647 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb5072-629a-43fb-8eee-a976ada2b01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:52.430700 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb5072-629a-43fb-8eee-a976ada2b01c admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:52.431135 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb5072-629a-43fb-8eee-a976ada2b01c admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:52.431439 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb5072-629a-43fb-8eee-a976ada2b01c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:52.435612 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 88/178] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:54:52 2021] GET /identity/v3/role_assignments?user.id=2a7711e2d0394daf9335168cae6f091d&scope.project.id=fc55a3bab8cf46219f282e51c510171b&role.id=3e7d7427203a4a4097e2c9a642b9bf69 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:52.437008 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d6dcd-e315-4b5d-b19b-8e9411694bf2 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:52.437289 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d6dcd-e315-4b5d-b19b-8e9411694bf2 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:52.438185 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d6dcd-e315-4b5d-b19b-8e9411694bf2 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:52.440036 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 89/179] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:52.447594 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb5072-629a-43fb-8eee-a976ada2b01c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:54:52.447969 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709ce89-6368-4a4e-ade3-4e3193958bdd None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:52.448256 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709ce89-6368-4a4e-ade3-4e3193958bdd None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:52.448572 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709ce89-6368-4a4e-ade3-4e3193958bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:52.456906 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-cccb5072-629a-43fb-8eee-a976ada2b01c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 02:54:52.464180 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 91/180] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Sep 23 02:54:52 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:54:52.465535 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb5072-629a-43fb-8eee-a976ada2b01c admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:52.470607 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-8709ce89-6368-4a4e-ade3-4e3193958bdd None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:52.472049 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-8709ce89-6368-4a4e-ade3-4e3193958bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:52.477926 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb5072-629a-43fb-8eee-a976ada2b01c admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:52.480599 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 90/181] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:54:52.483060 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a5e08-2f52-4808-beb1-071849090b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:52.483923 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a5e08-2f52-4808-beb1-071849090b6b admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:52.484427 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a5e08-2f52-4808-beb1-071849090b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:52.484863 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a5e08-2f52-4808-beb1-071849090b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:52.485799 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a5e08-2f52-4808-beb1-071849090b6b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:52.486234 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a5e08-2f52-4808-beb1-071849090b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:52.487995 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a5e08-2f52-4808-beb1-071849090b6b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:52.498001 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 92/182] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:54:52 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:52.505025 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709ce89-6368-4a4e-ade3-4e3193958bdd None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:52.509849 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a5e08-2f52-4808-beb1-071849090b6b admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:52.515825 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709ce89-6368-4a4e-ade3-4e3193958bdd None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:52.520969 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55eb03-2f26-4cf5-96f2-28b15c7402fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:52.521766 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a5e08-2f52-4808-beb1-071849090b6b admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:52.522196 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55eb03-2f26-4cf5-96f2-28b15c7402fc admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:52.522722 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55eb03-2f26-4cf5-96f2-28b15c7402fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:52.523185 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55eb03-2f26-4cf5-96f2-28b15c7402fc admin admin] PATH_INFO: `/v3/users/16d1a714a7ba40a2997ccaedc5163b95` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:52.525496 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55eb03-2f26-4cf5-96f2-28b15c7402fc admin admin] RBAC: Authorizing `identity:get_user(user_id=16d1a714a7ba40a2997ccaedc5163b95)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:52.527292 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b3c24-9e86-4789-a7e7-cbd9c565beb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:52.528324 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b3c24-9e86-4789-a7e7-cbd9c565beb3 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:52.528780 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b3c24-9e86-4789-a7e7-cbd9c565beb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:52.529188 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b3c24-9e86-4789-a7e7-cbd9c565beb3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:52.529382 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55eb03-2f26-4cf5-96f2-28b15c7402fc admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:52.530844 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b3c24-9e86-4789-a7e7-cbd9c565beb3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:52.532538 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 91/183] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:54:52 2021] GET /identity/v3/users/16d1a714a7ba40a2997ccaedc5163b95 => generated 283 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:52.538152 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55eb03-2f26-4cf5-96f2-28b15c7402fc admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:52.538521 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b3c24-9e86-4789-a7e7-cbd9c565beb3 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:52.540296 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 93/184] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:54:52 2021] GET /identity/v3/domains/default => generated 199 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:54:52.546713 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b3c24-9e86-4789-a7e7-cbd9c565beb3 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:52.550674 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55eb03-2f26-4cf5-96f2-28b15c7402fc admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:52.556095 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b070ab9-7ad8-4120-9d14-1567c07b9749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:52.557157 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b070ab9-7ad8-4120-9d14-1567c07b9749 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:52.557284 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b3c24-9e86-4789-a7e7-cbd9c565beb3 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:52.557793 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b070ab9-7ad8-4120-9d14-1567c07b9749 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:52.558361 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b070ab9-7ad8-4120-9d14-1567c07b9749 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:52.561859 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccacca8-96a2-4db9-9c56-d9cd2fbcecbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:52.563071 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccacca8-96a2-4db9-9c56-d9cd2fbcecbb admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:52.563350 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccacca8-96a2-4db9-9c56-d9cd2fbcecbb admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:52.563638 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccacca8-96a2-4db9-9c56-d9cd2fbcecbb admin admin] PATH_INFO: `/v3/groups` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:52.564400 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccacca8-96a2-4db9-9c56-d9cd2fbcecbb admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:52.565481 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING py.warnings [None req-fccacca8-96a2-4db9-9c56-d9cd2fbcecbb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:54:52.565481 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: warnings.warn(msg) Sep 23 02:54:52.565481 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: Sep 23 02:54:52.566689 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccacca8-96a2-4db9-9c56-d9cd2fbcecbb admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:52.571532 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b070ab9-7ad8-4120-9d14-1567c07b9749 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:52.573777 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b070ab9-7ad8-4120-9d14-1567c07b9749 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:52.586288 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 92/185] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:54:52 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:54:52.594338 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b070ab9-7ad8-4120-9d14-1567c07b9749 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:52.604387 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b070ab9-7ad8-4120-9d14-1567c07b9749 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:52.609037 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902fd63-7d73-48f4-9c7c-20ed927b5646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:52.610533 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902fd63-7d73-48f4-9c7c-20ed927b5646 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:52.610818 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902fd63-7d73-48f4-9c7c-20ed927b5646 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:52.611085 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902fd63-7d73-48f4-9c7c-20ed927b5646 admin admin] PATH_INFO: `/v3/projects/fc55a3bab8cf46219f282e51c510171b` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:52.612699 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902fd63-7d73-48f4-9c7c-20ed927b5646 admin admin] RBAC: Authorizing `identity:get_project(project_id=fc55a3bab8cf46219f282e51c510171b)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:52.616312 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902fd63-7d73-48f4-9c7c-20ed927b5646 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:52.618521 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 93/186] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:54:52 2021] GET /identity/v3/projects/fc55a3bab8cf46219f282e51c510171b => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:52.624610 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902fd63-7d73-48f4-9c7c-20ed927b5646 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:52.635977 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902fd63-7d73-48f4-9c7c-20ed927b5646 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:52.641378 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d78b6-ca83-4938-ab7a-2cabf5b6ea52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:52.642020 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d78b6-ca83-4938-ab7a-2cabf5b6ea52 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:52.642305 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d78b6-ca83-4938-ab7a-2cabf5b6ea52 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:52.642581 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d78b6-ca83-4938-ab7a-2cabf5b6ea52 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:52.643402 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d78b6-ca83-4938-ab7a-2cabf5b6ea52 admin admin] RBAC: Adding query filter params (role.id=1e311eea15274107873f2490f2cbc7b4, scope.project.id=fc55a3bab8cf46219f282e51c510171b, user.id=16d1a714a7ba40a2997ccaedc5163b95) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:52.643710 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d78b6-ca83-4938-ab7a-2cabf5b6ea52 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:52.645567 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d78b6-ca83-4938-ab7a-2cabf5b6ea52 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:52.648434 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 94/187] 10.222.0.23 () {60 vars in 1156 bytes} [Thu Sep 23 02:54:52 2021] POST /identity/v3/groups => generated 229 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 02:54:52.661110 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 94/188] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:54:52 2021] GET /identity/v3/role_assignments?user.id=16d1a714a7ba40a2997ccaedc5163b95&scope.project.id=fc55a3bab8cf46219f282e51c510171b&role.id=1e311eea15274107873f2490f2cbc7b4 => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:53.923327 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736002d5-ae2e-470e-8235-61d8e6a6a07a None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:53.923913 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736002d5-ae2e-470e-8235-61d8e6a6a07a None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:53.923913 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736002d5-ae2e-470e-8235-61d8e6a6a07a None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:53.925754 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 95/189] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:53.934013 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a3edf-2061-40d9-a6f8-dd4707dc9c8d None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:53.934574 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a3edf-2061-40d9-a6f8-dd4707dc9c8d None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:53.934574 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a3edf-2061-40d9-a6f8-dd4707dc9c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:53.952821 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-7c9a3edf-2061-40d9-a6f8-dd4707dc9c8d None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:53.954069 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-7c9a3edf-2061-40d9-a6f8-dd4707dc9c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:53.962080 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 95/190] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:54:53.985721 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736002d5-ae2e-470e-8235-61d8e6a6a07a None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:53.998058 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736002d5-ae2e-470e-8235-61d8e6a6a07a None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:54.003009 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79cef1-73ed-40df-9476-8bcfb4149f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:54.003811 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79cef1-73ed-40df-9476-8bcfb4149f85 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:54.004093 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79cef1-73ed-40df-9476-8bcfb4149f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:54.004373 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79cef1-73ed-40df-9476-8bcfb4149f85 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:54.015988 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79cef1-73ed-40df-9476-8bcfb4149f85 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:54:54.022744 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-2c79cef1-73ed-40df-9476-8bcfb4149f85 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 02:54:54.023952 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 96/191] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:54:53 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:54:54.030436 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a3edf-2061-40d9-a6f8-dd4707dc9c8d None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:54.040546 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a3edf-2061-40d9-a6f8-dd4707dc9c8d None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:54.045903 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7053817-68b2-411c-9266-562d5729a1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:54.045903 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7053817-68b2-411c-9266-562d5729a1af admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:54.046260 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7053817-68b2-411c-9266-562d5729a1af admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:54.046695 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7053817-68b2-411c-9266-562d5729a1af admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:54.047522 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7053817-68b2-411c-9266-562d5729a1af admin admin] RBAC: Adding query filter params (name=member) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:54.047902 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7053817-68b2-411c-9266-562d5729a1af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:54.049615 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7053817-68b2-411c-9266-562d5729a1af admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:54.058570 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 96/192] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Sep 23 02:54:54 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:54.065208 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79cef1-73ed-40df-9476-8bcfb4149f85 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:54.075643 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79cef1-73ed-40df-9476-8bcfb4149f85 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:54.080130 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8010a-0405-4613-9142-9a110a2103ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:54.081156 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8010a-0405-4613-9142-9a110a2103ea admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:54.081265 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8010a-0405-4613-9142-9a110a2103ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:54.081546 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8010a-0405-4613-9142-9a110a2103ea admin admin] PATH_INFO: `/v3/users/16d1a714a7ba40a2997ccaedc5163b95` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:54.082754 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8010a-0405-4613-9142-9a110a2103ea admin admin] RBAC: Authorizing `identity:get_user(user_id=16d1a714a7ba40a2997ccaedc5163b95)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:54.084939 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8010a-0405-4613-9142-9a110a2103ea admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:54.086816 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 97/193] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:54:54 2021] GET /identity/v3/users/16d1a714a7ba40a2997ccaedc5163b95 => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:54.092916 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7053817-68b2-411c-9266-562d5729a1af admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:54.109448 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7053817-68b2-411c-9266-562d5729a1af admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:54.120766 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1047b-6815-430c-8237-e30301e9394b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:54.121905 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1047b-6815-430c-8237-e30301e9394b admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:54.122399 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1047b-6815-430c-8237-e30301e9394b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:54.122892 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1047b-6815-430c-8237-e30301e9394b admin admin] PATH_INFO: `/v3/projects/fc55a3bab8cf46219f282e51c510171b` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:54.124392 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1047b-6815-430c-8237-e30301e9394b admin admin] RBAC: Authorizing `identity:get_project(project_id=fc55a3bab8cf46219f282e51c510171b)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:54.126820 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1047b-6815-430c-8237-e30301e9394b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:54.128999 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 97/194] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:54:54 2021] GET /identity/v3/projects/fc55a3bab8cf46219f282e51c510171b => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:54.135303 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8010a-0405-4613-9142-9a110a2103ea admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:54.145793 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8010a-0405-4613-9142-9a110a2103ea admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:54.150186 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c55a52-ca01-4067-becf-ff73da49acaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:54.151066 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c55a52-ca01-4067-becf-ff73da49acaf admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:54.151348 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c55a52-ca01-4067-becf-ff73da49acaf admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:54.151623 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c55a52-ca01-4067-becf-ff73da49acaf admin admin] PATH_INFO: `/v3/projects/fc55a3bab8cf46219f282e51c510171b/users/16d1a714a7ba40a2997ccaedc5163b95/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:54.153629 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c55a52-ca01-4067-becf-ff73da49acaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc55a3bab8cf46219f282e51c510171b, user_id=16d1a714a7ba40a2997ccaedc5163b95, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:54.156833 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c55a52-ca01-4067-becf-ff73da49acaf admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:54.229359 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 98/195] 10.222.0.23 () {58 vars in 1461 bytes} [Thu Sep 23 02:54:54 2021] PUT /identity/v3/projects/fc55a3bab8cf46219f282e51c510171b/users/16d1a714a7ba40a2997ccaedc5163b95/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 02:54:54.633693 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60c6e8-5c32-4a6e-9bb5-61698549bf8d None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:54.634379 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60c6e8-5c32-4a6e-9bb5-61698549bf8d None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:54.634920 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60c6e8-5c32-4a6e-9bb5-61698549bf8d None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:54.636972 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 98/196] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:54.644841 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5805ef-a92c-4b7a-9b91-59a6ee374ae2 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:54.645130 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5805ef-a92c-4b7a-9b91-59a6ee374ae2 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:54.645413 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5805ef-a92c-4b7a-9b91-59a6ee374ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:54.663779 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-8c5805ef-a92c-4b7a-9b91-59a6ee374ae2 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:54.665016 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-8c5805ef-a92c-4b7a-9b91-59a6ee374ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:54.721776 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 99/197] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:54:54.744613 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60c6e8-5c32-4a6e-9bb5-61698549bf8d None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:54.757785 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60c6e8-5c32-4a6e-9bb5-61698549bf8d None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:54.765423 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a378e-cf5d-41d4-bec8-1f4888b5156f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:54.765585 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a378e-cf5d-41d4-bec8-1f4888b5156f admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:54.765793 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a378e-cf5d-41d4-bec8-1f4888b5156f admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:54.766074 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a378e-cf5d-41d4-bec8-1f4888b5156f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:54.780740 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a378e-cf5d-41d4-bec8-1f4888b5156f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:54:54.788054 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-a43a378e-cf5d-41d4-bec8-1f4888b5156f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:54:54.789276 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 99/198] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:54:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:54:54.795599 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5805ef-a92c-4b7a-9b91-59a6ee374ae2 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:54.809616 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5805ef-a92c-4b7a-9b91-59a6ee374ae2 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:54.815870 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e13d61-03e5-4e15-b0eb-cc62d1325193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:54.818869 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e13d61-03e5-4e15-b0eb-cc62d1325193 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:54.818869 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e13d61-03e5-4e15-b0eb-cc62d1325193 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:54.818869 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e13d61-03e5-4e15-b0eb-cc62d1325193 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:54.818869 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e13d61-03e5-4e15-b0eb-cc62d1325193 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:54.818869 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e13d61-03e5-4e15-b0eb-cc62d1325193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:54.819881 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e13d61-03e5-4e15-b0eb-cc62d1325193 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:54.829370 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 100/199] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:54:54 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:54.835114 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a378e-cf5d-41d4-bec8-1f4888b5156f admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:54.846097 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a378e-cf5d-41d4-bec8-1f4888b5156f admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:54.851177 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf8c05-73ee-4cd3-8c25-92bb4b01f27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:54.852044 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf8c05-73ee-4cd3-8c25-92bb4b01f27a admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:54.852327 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf8c05-73ee-4cd3-8c25-92bb4b01f27a admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:54.852640 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf8c05-73ee-4cd3-8c25-92bb4b01f27a admin admin] PATH_INFO: `/v3/users/2a7711e2d0394daf9335168cae6f091d` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:54.853953 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf8c05-73ee-4cd3-8c25-92bb4b01f27a admin admin] RBAC: Authorizing `identity:get_user(user_id=2a7711e2d0394daf9335168cae6f091d)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:54.855766 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf8c05-73ee-4cd3-8c25-92bb4b01f27a admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:54.857719 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 100/200] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:54:54 2021] GET /identity/v3/users/2a7711e2d0394daf9335168cae6f091d => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:54.864721 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e13d61-03e5-4e15-b0eb-cc62d1325193 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:54.875223 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e13d61-03e5-4e15-b0eb-cc62d1325193 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:54.879915 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e485ec0-3b70-4307-b838-dca88aeea25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:54.880888 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e485ec0-3b70-4307-b838-dca88aeea25d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:54.881168 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e485ec0-3b70-4307-b838-dca88aeea25d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:54.881446 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e485ec0-3b70-4307-b838-dca88aeea25d admin admin] PATH_INFO: `/v3/projects/fc55a3bab8cf46219f282e51c510171b` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:54.882831 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e485ec0-3b70-4307-b838-dca88aeea25d admin admin] RBAC: Authorizing `identity:get_project(project_id=fc55a3bab8cf46219f282e51c510171b)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:54.885154 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e485ec0-3b70-4307-b838-dca88aeea25d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:54.887219 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 101/201] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:54:54 2021] GET /identity/v3/projects/fc55a3bab8cf46219f282e51c510171b => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:54.894411 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf8c05-73ee-4cd3-8c25-92bb4b01f27a admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:54.904928 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf8c05-73ee-4cd3-8c25-92bb4b01f27a admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:54.909648 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc38fae-ae4e-4ab7-ae40-74788633be41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:54.910634 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc38fae-ae4e-4ab7-ae40-74788633be41 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:54.910918 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc38fae-ae4e-4ab7-ae40-74788633be41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:54.911243 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc38fae-ae4e-4ab7-ae40-74788633be41 admin admin] PATH_INFO: `/v3/projects/fc55a3bab8cf46219f282e51c510171b/users/2a7711e2d0394daf9335168cae6f091d/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:54.913397 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc38fae-ae4e-4ab7-ae40-74788633be41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc55a3bab8cf46219f282e51c510171b, user_id=2a7711e2d0394daf9335168cae6f091d, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:54.916237 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc38fae-ae4e-4ab7-ae40-74788633be41 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:54.965342 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ea87c-f059-4123-848f-283bd558685c None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:54.965890 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ea87c-f059-4123-848f-283bd558685c None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:54.965972 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ea87c-f059-4123-848f-283bd558685c None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:54.967837 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 102/202] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 02:54:54.975474 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c733b30-27f7-4f1e-96fe-14656c6f3a7c None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:54.975759 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c733b30-27f7-4f1e-96fe-14656c6f3a7c None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:54.976036 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c733b30-27f7-4f1e-96fe-14656c6f3a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:54.992922 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 101/203] 10.222.0.23 () {58 vars in 1461 bytes} [Thu Sep 23 02:54:54 2021] PUT /identity/v3/projects/fc55a3bab8cf46219f282e51c510171b/users/2a7711e2d0394daf9335168cae6f091d/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 02:54:55.001076 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-8c733b30-27f7-4f1e-96fe-14656c6f3a7c None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:55.005740 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-8c733b30-27f7-4f1e-96fe-14656c6f3a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:55.022351 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676a06d-96d2-465b-952e-31d08e541754 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:55.022686 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676a06d-96d2-465b-952e-31d08e541754 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:55.022911 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676a06d-96d2-465b-952e-31d08e541754 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:55.024797 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 102/204] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 02:54:55.033869 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ac401-e422-4eed-90f9-7d7eb04a8636 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:55.034206 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ac401-e422-4eed-90f9-7d7eb04a8636 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:55.034569 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ac401-e422-4eed-90f9-7d7eb04a8636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:55.055649 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-835ac401-e422-4eed-90f9-7d7eb04a8636 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:55.057496 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-835ac401-e422-4eed-90f9-7d7eb04a8636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:55.073590 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 103/205] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:54:55.107510 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c733b30-27f7-4f1e-96fe-14656c6f3a7c None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:55.120177 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c733b30-27f7-4f1e-96fe-14656c6f3a7c None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:55.125921 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d682e9-d1b4-477f-b9fc-b2071f1fc086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:55.127396 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d682e9-d1b4-477f-b9fc-b2071f1fc086 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:55.127682 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d682e9-d1b4-477f-b9fc-b2071f1fc086 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:55.127961 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d682e9-d1b4-477f-b9fc-b2071f1fc086 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:55.150640 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d682e9-d1b4-477f-b9fc-b2071f1fc086 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:54:55.158352 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-33d682e9-d1b4-477f-b9fc-b2071f1fc086 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 02:54:55.159668 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 104/206] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Sep 23 02:54:55 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:54:55.167156 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d682e9-d1b4-477f-b9fc-b2071f1fc086 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:55.178835 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 103/207] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:54:55.179616 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d682e9-d1b4-477f-b9fc-b2071f1fc086 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:55.188374 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50d0e5-1f72-456e-9d4c-a5d7a09f4155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:55.189175 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50d0e5-1f72-456e-9d4c-a5d7a09f4155 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:55.189453 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50d0e5-1f72-456e-9d4c-a5d7a09f4155 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:55.189729 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50d0e5-1f72-456e-9d4c-a5d7a09f4155 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:55.190487 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50d0e5-1f72-456e-9d4c-a5d7a09f4155 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:55.190790 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50d0e5-1f72-456e-9d4c-a5d7a09f4155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:55.192388 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50d0e5-1f72-456e-9d4c-a5d7a09f4155 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:55.202661 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 105/208] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:54:55 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:55.207400 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ac401-e422-4eed-90f9-7d7eb04a8636 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:55.209270 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50d0e5-1f72-456e-9d4c-a5d7a09f4155 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:55.219775 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50d0e5-1f72-456e-9d4c-a5d7a09f4155 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:55.221295 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ac401-e422-4eed-90f9-7d7eb04a8636 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:55.227041 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950cdf5-67cb-424f-a930-4adb16dc0bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:55.227492 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da28e9-3ce1-4a80-8305-8bef53ac13a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:55.227917 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950cdf5-67cb-424f-a930-4adb16dc0bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:55.228196 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950cdf5-67cb-424f-a930-4adb16dc0bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:55.228351 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da28e9-3ce1-4a80-8305-8bef53ac13a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:55.228527 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950cdf5-67cb-424f-a930-4adb16dc0bf3 admin admin] PATH_INFO: `/v3/users/16d1a714a7ba40a2997ccaedc5163b95` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:55.228683 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da28e9-3ce1-4a80-8305-8bef53ac13a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:55.228920 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da28e9-3ce1-4a80-8305-8bef53ac13a8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:55.229717 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950cdf5-67cb-424f-a930-4adb16dc0bf3 admin admin] RBAC: Authorizing `identity:get_user(user_id=16d1a714a7ba40a2997ccaedc5163b95)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:55.230183 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da28e9-3ce1-4a80-8305-8bef53ac13a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:55.231854 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950cdf5-67cb-424f-a930-4adb16dc0bf3 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:55.232099 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da28e9-3ce1-4a80-8305-8bef53ac13a8 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:55.233646 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 106/209] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:54:55 2021] GET /identity/v3/users/16d1a714a7ba40a2997ccaedc5163b95 => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:54:55.234001 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 104/210] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:54:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:55.239895 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950cdf5-67cb-424f-a930-4adb16dc0bf3 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:55.240116 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da28e9-3ce1-4a80-8305-8bef53ac13a8 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:55.252476 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950cdf5-67cb-424f-a930-4adb16dc0bf3 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:55.253278 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da28e9-3ce1-4a80-8305-8bef53ac13a8 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:55.257508 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72621920-f194-4a29-abee-ec4ced3f57a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:55.258172 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72621920-f194-4a29-abee-ec4ced3f57a3 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:55.258345 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6ed75-68c8-4ba3-b501-1aadde52885d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:55.258577 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72621920-f194-4a29-abee-ec4ced3f57a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:55.258724 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72621920-f194-4a29-abee-ec4ced3f57a3 admin admin] PATH_INFO: `/v3/groups` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:55.259302 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6ed75-68c8-4ba3-b501-1aadde52885d admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:55.259460 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72621920-f194-4a29-abee-ec4ced3f57a3 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:55.259611 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6ed75-68c8-4ba3-b501-1aadde52885d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:55.259852 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6ed75-68c8-4ba3-b501-1aadde52885d admin admin] PATH_INFO: `/v3/projects/fc55a3bab8cf46219f282e51c510171b` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:55.261093 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6ed75-68c8-4ba3-b501-1aadde52885d admin admin] RBAC: Authorizing `identity:get_project(project_id=fc55a3bab8cf46219f282e51c510171b)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:55.261300 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72621920-f194-4a29-abee-ec4ced3f57a3 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:55.263112 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6ed75-68c8-4ba3-b501-1aadde52885d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:55.265113 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 105/211] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:54:55 2021] GET /identity/v3/projects/fc55a3bab8cf46219f282e51c510171b => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:54:55.271335 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6ed75-68c8-4ba3-b501-1aadde52885d admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:55.283568 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6ed75-68c8-4ba3-b501-1aadde52885d admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:55.288209 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc39f4b-9a36-4508-a732-a8e6382bf1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:55.289219 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc39f4b-9a36-4508-a732-a8e6382bf1cd admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:55.289502 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc39f4b-9a36-4508-a732-a8e6382bf1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:55.289778 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc39f4b-9a36-4508-a732-a8e6382bf1cd admin admin] PATH_INFO: `/v3/projects/fc55a3bab8cf46219f282e51c510171b/users/16d1a714a7ba40a2997ccaedc5163b95/roles/1e311eea15274107873f2490f2cbc7b4` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:55.292243 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc39f4b-9a36-4508-a732-a8e6382bf1cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc55a3bab8cf46219f282e51c510171b, user_id=16d1a714a7ba40a2997ccaedc5163b95, role_id=1e311eea15274107873f2490f2cbc7b4)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:55.295268 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc39f4b-9a36-4508-a732-a8e6382bf1cd admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:55.406427 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 107/212] 10.222.0.23 () {60 vars in 1156 bytes} [Thu Sep 23 02:54:55 2021] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 02:54:55.470182 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 106/213] 10.222.0.23 () {58 vars in 1461 bytes} [Thu Sep 23 02:54:55 2021] PUT /identity/v3/projects/fc55a3bab8cf46219f282e51c510171b/users/16d1a714a7ba40a2997ccaedc5163b95/roles/1e311eea15274107873f2490f2cbc7b4 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 02:54:56.611735 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031fbfa-3aa5-491a-bb8d-2f1db1b9b0d3 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:56.612259 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031fbfa-3aa5-491a-bb8d-2f1db1b9b0d3 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:56.612653 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031fbfa-3aa5-491a-bb8d-2f1db1b9b0d3 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:56.614684 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 108/214] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:56.634527 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0077c-b289-4546-a04d-3d389fbd97ab None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:56.635028 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0077c-b289-4546-a04d-3d389fbd97ab None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:56.635101 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0077c-b289-4546-a04d-3d389fbd97ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:56.657931 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-42a0077c-b289-4546-a04d-3d389fbd97ab None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:56.659210 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-42a0077c-b289-4546-a04d-3d389fbd97ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:56.737147 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 107/215] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:54:56.776948 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031fbfa-3aa5-491a-bb8d-2f1db1b9b0d3 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:56.790697 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031fbfa-3aa5-491a-bb8d-2f1db1b9b0d3 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:56.800022 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8e6f4-b293-42d7-b70a-f2d670cd9f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:56.800849 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8e6f4-b293-42d7-b70a-f2d670cd9f83 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:56.801128 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8e6f4-b293-42d7-b70a-f2d670cd9f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:56.801400 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8e6f4-b293-42d7-b70a-f2d670cd9f83 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:56.814962 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8e6f4-b293-42d7-b70a-f2d670cd9f83 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:54:56.824552 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-8cd8e6f4-b293-42d7-b70a-f2d670cd9f83 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 02:54:56.828857 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 109/216] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:54:56 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:54:56.835774 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0077c-b289-4546-a04d-3d389fbd97ab None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:56.846093 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0077c-b289-4546-a04d-3d389fbd97ab None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:56.857283 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a70f0-792c-4f16-a47e-5a5cf07db4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:56.857992 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a70f0-792c-4f16-a47e-5a5cf07db4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:56.858348 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a70f0-792c-4f16-a47e-5a5cf07db4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:56.858626 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a70f0-792c-4f16-a47e-5a5cf07db4c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:56.859467 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a70f0-792c-4f16-a47e-5a5cf07db4c6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:56.859772 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a70f0-792c-4f16-a47e-5a5cf07db4c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:56.861905 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a70f0-792c-4f16-a47e-5a5cf07db4c6 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:56.876983 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 108/217] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Sep 23 02:54:56 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:56.879093 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8e6f4-b293-42d7-b70a-f2d670cd9f83 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:56.890054 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8e6f4-b293-42d7-b70a-f2d670cd9f83 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:56.900933 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c333c-3e98-41b4-84b6-1bc12f0c6fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:56.901811 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c333c-3e98-41b4-84b6-1bc12f0c6fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:56.902089 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c333c-3e98-41b4-84b6-1bc12f0c6fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:56.902358 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c333c-3e98-41b4-84b6-1bc12f0c6fa9 admin admin] PATH_INFO: `/v3/users/16d1a714a7ba40a2997ccaedc5163b95` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:56.903573 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c333c-3e98-41b4-84b6-1bc12f0c6fa9 admin admin] RBAC: Authorizing `identity:get_user(user_id=16d1a714a7ba40a2997ccaedc5163b95)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:56.905761 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c333c-3e98-41b4-84b6-1bc12f0c6fa9 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:56.907393 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 110/218] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:54:56 2021] GET /identity/v3/users/16d1a714a7ba40a2997ccaedc5163b95 => generated 283 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:56.913771 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a70f0-792c-4f16-a47e-5a5cf07db4c6 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:56.923631 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a70f0-792c-4f16-a47e-5a5cf07db4c6 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:56.932631 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dcd63-177d-4244-bf42-f4628d44a9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:56.933300 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dcd63-177d-4244-bf42-f4628d44a9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:56.933581 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dcd63-177d-4244-bf42-f4628d44a9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:56.933858 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dcd63-177d-4244-bf42-f4628d44a9c1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:56.942956 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3dcd63-177d-4244-bf42-f4628d44a9c1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:56.944729 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3dcd63-177d-4244-bf42-f4628d44a9c1 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:56.958659 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 109/219] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:54:56 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:54:56.965084 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c333c-3e98-41b4-84b6-1bc12f0c6fa9 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:56.974995 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c333c-3e98-41b4-84b6-1bc12f0c6fa9 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:56.981876 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0b424-0e53-4916-a895-1b4d45ea587c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:56.982733 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0b424-0e53-4916-a895-1b4d45ea587c admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:56.983011 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0b424-0e53-4916-a895-1b4d45ea587c admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:56.983282 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0b424-0e53-4916-a895-1b4d45ea587c admin admin] PATH_INFO: `/v3/projects/fc55a3bab8cf46219f282e51c510171b` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:56.984520 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0b424-0e53-4916-a895-1b4d45ea587c admin admin] RBAC: Authorizing `identity:get_project(project_id=fc55a3bab8cf46219f282e51c510171b)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:56.986557 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0b424-0e53-4916-a895-1b4d45ea587c admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:56.988216 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 111/220] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:54:56 2021] GET /identity/v3/projects/fc55a3bab8cf46219f282e51c510171b => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:56.994673 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dcd63-177d-4244-bf42-f4628d44a9c1 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:57.004546 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dcd63-177d-4244-bf42-f4628d44a9c1 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:57.012609 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9797181-23d0-4f52-8442-c3f806090049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:57.013271 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9797181-23d0-4f52-8442-c3f806090049 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:57.013795 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9797181-23d0-4f52-8442-c3f806090049 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:57.014081 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9797181-23d0-4f52-8442-c3f806090049 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:57.014912 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9797181-23d0-4f52-8442-c3f806090049 admin admin] RBAC: Adding query filter params (role.id=99e1944a08bf4c13b6c228cd63b66bcb, scope.project.id=fc55a3bab8cf46219f282e51c510171b, user.id=16d1a714a7ba40a2997ccaedc5163b95) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:57.015309 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9797181-23d0-4f52-8442-c3f806090049 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:57.017153 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9797181-23d0-4f52-8442-c3f806090049 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:57.023393 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 110/221] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:54:56 2021] GET /identity/v3/role_assignments?user.id=16d1a714a7ba40a2997ccaedc5163b95&scope.project.id=fc55a3bab8cf46219f282e51c510171b&role.id=99e1944a08bf4c13b6c228cd63b66bcb => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:54:57.724322 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e241c0-3280-4116-9d43-feca816fe66c None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:57.725051 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e241c0-3280-4116-9d43-feca816fe66c None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:57.725051 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e241c0-3280-4116-9d43-feca816fe66c None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:57.726992 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 112/222] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:57.736171 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ccbc4-2142-45f0-aa29-ffb6f1fdc000 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:57.736767 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ccbc4-2142-45f0-aa29-ffb6f1fdc000 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:57.736935 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ccbc4-2142-45f0-aa29-ffb6f1fdc000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:57.759968 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-348ccbc4-2142-45f0-aa29-ffb6f1fdc000 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:57.761190 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-348ccbc4-2142-45f0-aa29-ffb6f1fdc000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:57.770602 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 111/223] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:54:57.796937 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e241c0-3280-4116-9d43-feca816fe66c None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:57.813501 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e241c0-3280-4116-9d43-feca816fe66c None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:57.819953 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ce8a3-52fd-48e0-a3cb-dfc043b788f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:57.821551 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ce8a3-52fd-48e0-a3cb-dfc043b788f6 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:57.821551 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ce8a3-52fd-48e0-a3cb-dfc043b788f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:57.821551 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ce8a3-52fd-48e0-a3cb-dfc043b788f6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:57.840985 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ce8a3-52fd-48e0-a3cb-dfc043b788f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:54:57.848373 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-aa8ce8a3-52fd-48e0-a3cb-dfc043b788f6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:54:57.852612 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 113/224] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:54:57 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:54:57.855962 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ccbc4-2142-45f0-aa29-ffb6f1fdc000 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:57.865717 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ccbc4-2142-45f0-aa29-ffb6f1fdc000 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:57.876794 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f98a33-2378-4579-bdb3-c0df6b749c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:57.877480 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f98a33-2378-4579-bdb3-c0df6b749c1a admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:57.877758 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f98a33-2378-4579-bdb3-c0df6b749c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:57.878031 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f98a33-2378-4579-bdb3-c0df6b749c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:57.878787 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f98a33-2378-4579-bdb3-c0df6b749c1a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:57.879092 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f98a33-2378-4579-bdb3-c0df6b749c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:57.880914 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f98a33-2378-4579-bdb3-c0df6b749c1a admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:57.896802 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ce8a3-52fd-48e0-a3cb-dfc043b788f6 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:57.897250 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 112/225] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:54:57 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:57.906813 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ce8a3-52fd-48e0-a3cb-dfc043b788f6 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:57.917181 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be4bfe-e211-467e-a15d-41b35449baab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:57.918404 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be4bfe-e211-467e-a15d-41b35449baab admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:57.918883 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be4bfe-e211-467e-a15d-41b35449baab admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:57.919363 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be4bfe-e211-467e-a15d-41b35449baab admin admin] PATH_INFO: `/v3/users/2a7711e2d0394daf9335168cae6f091d` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:57.920871 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be4bfe-e211-467e-a15d-41b35449baab admin admin] RBAC: Authorizing `identity:get_user(user_id=2a7711e2d0394daf9335168cae6f091d)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:57.923425 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be4bfe-e211-467e-a15d-41b35449baab admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:57.925389 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 114/226] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:54:57 2021] GET /identity/v3/users/2a7711e2d0394daf9335168cae6f091d => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:57.931517 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f98a33-2378-4579-bdb3-c0df6b749c1a admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:57.941502 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f98a33-2378-4579-bdb3-c0df6b749c1a admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:57.952507 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb0d6b-6532-4a9b-bad1-e3ee4956f498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:57.953690 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb0d6b-6532-4a9b-bad1-e3ee4956f498 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:57.953972 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb0d6b-6532-4a9b-bad1-e3ee4956f498 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:57.954245 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb0d6b-6532-4a9b-bad1-e3ee4956f498 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:57.967237 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb0d6b-6532-4a9b-bad1-e3ee4956f498 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:57.969102 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb0d6b-6532-4a9b-bad1-e3ee4956f498 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:57.981200 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 113/227] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:54:57 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:54:57.988068 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be4bfe-e211-467e-a15d-41b35449baab admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:58.002601 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be4bfe-e211-467e-a15d-41b35449baab admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:58.013229 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70610d53-1f10-4c3f-a396-ed2801173059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:58.014758 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70610d53-1f10-4c3f-a396-ed2801173059 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:58.015782 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70610d53-1f10-4c3f-a396-ed2801173059 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:58.016270 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70610d53-1f10-4c3f-a396-ed2801173059 admin admin] PATH_INFO: `/v3/projects/fc55a3bab8cf46219f282e51c510171b` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:58.017769 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70610d53-1f10-4c3f-a396-ed2801173059 admin admin] RBAC: Authorizing `identity:get_project(project_id=fc55a3bab8cf46219f282e51c510171b)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:58.020045 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70610d53-1f10-4c3f-a396-ed2801173059 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:58.022127 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 115/228] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:54:57 2021] GET /identity/v3/projects/fc55a3bab8cf46219f282e51c510171b => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:58.029114 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb0d6b-6532-4a9b-bad1-e3ee4956f498 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:58.038437 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb0d6b-6532-4a9b-bad1-e3ee4956f498 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:58.049298 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d60d9-f9e2-4c8c-ad0d-636166612e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:58.049965 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d60d9-f9e2-4c8c-ad0d-636166612e69 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:58.050244 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d60d9-f9e2-4c8c-ad0d-636166612e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:58.050519 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d60d9-f9e2-4c8c-ad0d-636166612e69 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:58.051362 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d60d9-f9e2-4c8c-ad0d-636166612e69 admin admin] RBAC: Adding query filter params (role.id=3e7d7427203a4a4097e2c9a642b9bf69, scope.project.id=fc55a3bab8cf46219f282e51c510171b, user.id=2a7711e2d0394daf9335168cae6f091d) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:58.051670 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d60d9-f9e2-4c8c-ad0d-636166612e69 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:58.053546 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d60d9-f9e2-4c8c-ad0d-636166612e69 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:58.060100 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 114/229] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:54:58 2021] GET /identity/v3/role_assignments?user.id=2a7711e2d0394daf9335168cae6f091d&scope.project.id=fc55a3bab8cf46219f282e51c510171b&role.id=3e7d7427203a4a4097e2c9a642b9bf69 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:58.266008 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f876762-4f8b-4958-9240-6cef92e35107 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:58.266666 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f876762-4f8b-4958-9240-6cef92e35107 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:58.267164 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f876762-4f8b-4958-9240-6cef92e35107 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:58.269204 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 116/230] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:58.284638 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f709570-07da-4f54-97ee-2e341933991c None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:58.284947 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f709570-07da-4f54-97ee-2e341933991c None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:58.285213 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f709570-07da-4f54-97ee-2e341933991c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:58.289755 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73eb6c-ac55-46a4-bb46-772aecdf1726 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:58.290425 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73eb6c-ac55-46a4-bb46-772aecdf1726 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:58.290933 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73eb6c-ac55-46a4-bb46-772aecdf1726 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:58.292985 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 117/231] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 02:54:58.309504 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-9f709570-07da-4f54-97ee-2e341933991c None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:58.310724 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-9f709570-07da-4f54-97ee-2e341933991c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:58.314683 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cef314-4818-4aae-9584-20754e9c5ab2 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:58.315336 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cef314-4818-4aae-9584-20754e9c5ab2 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:58.315826 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cef314-4818-4aae-9584-20754e9c5ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:58.323216 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 115/232] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:54:58.349822 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-27cef314-4818-4aae-9584-20754e9c5ab2 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:58.351394 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-27cef314-4818-4aae-9584-20754e9c5ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:58.361140 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 118/233] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:54:58.386512 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f709570-07da-4f54-97ee-2e341933991c None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:58.396725 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f709570-07da-4f54-97ee-2e341933991c None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:58.406702 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5db44-1516-4715-9d88-a80d568467ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:58.407607 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5db44-1516-4715-9d88-a80d568467ec admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:58.407891 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5db44-1516-4715-9d88-a80d568467ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:58.408163 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5db44-1516-4715-9d88-a80d568467ec admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:58.409483 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cef314-4818-4aae-9584-20754e9c5ab2 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:58.426135 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cef314-4818-4aae-9584-20754e9c5ab2 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:58.426332 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5db44-1516-4715-9d88-a80d568467ec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:54:58.433000 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-4de5db44-1516-4715-9d88-a80d568467ec admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 02:54:58.434215 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 116/234] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:54:58 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:54:58.434915 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45141f8-ca85-4436-b118-bebed5e3724a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:58.436019 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45141f8-ca85-4436-b118-bebed5e3724a admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:58.436520 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45141f8-ca85-4436-b118-bebed5e3724a admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:58.437510 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45141f8-ca85-4436-b118-bebed5e3724a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:58.440978 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5db44-1516-4715-9d88-a80d568467ec admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:58.450684 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5db44-1516-4715-9d88-a80d568467ec admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:58.456003 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45141f8-ca85-4436-b118-bebed5e3724a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:54:58.463800 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-a45141f8-ca85-4436-b118-bebed5e3724a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 02:54:58.464938 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c632802-a0dc-48bd-ade6-a16d2c2da551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:58.465613 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c632802-a0dc-48bd-ade6-a16d2c2da551 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:58.468825 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c632802-a0dc-48bd-ade6-a16d2c2da551 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:58.468825 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c632802-a0dc-48bd-ade6-a16d2c2da551 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:58.468825 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c632802-a0dc-48bd-ade6-a16d2c2da551 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:58.468825 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c632802-a0dc-48bd-ade6-a16d2c2da551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:58.469507 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 119/235] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Sep 23 02:54:58 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:54:58.471489 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c632802-a0dc-48bd-ade6-a16d2c2da551 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:58.475578 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45141f8-ca85-4436-b118-bebed5e3724a admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:58.484638 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 117/236] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Sep 23 02:54:58 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:54:58.488420 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45141f8-ca85-4436-b118-bebed5e3724a admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:58.489632 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c632802-a0dc-48bd-ade6-a16d2c2da551 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:58.501200 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fa293-983f-4e2d-9cf8-eaa558924833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:58.502764 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fa293-983f-4e2d-9cf8-eaa558924833 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:58.503439 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fa293-983f-4e2d-9cf8-eaa558924833 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:58.504432 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fa293-983f-4e2d-9cf8-eaa558924833 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:58.506378 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c632802-a0dc-48bd-ade6-a16d2c2da551 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:58.507458 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fa293-983f-4e2d-9cf8-eaa558924833 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:58.507989 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fa293-983f-4e2d-9cf8-eaa558924833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:58.510359 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fa293-983f-4e2d-9cf8-eaa558924833 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:58.518339 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74659b4b-cb6b-4ae0-a9bb-fb5fbc70d5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:58.520392 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74659b4b-cb6b-4ae0-a9bb-fb5fbc70d5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:58.520969 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74659b4b-cb6b-4ae0-a9bb-fb5fbc70d5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:58.522089 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74659b4b-cb6b-4ae0-a9bb-fb5fbc70d5d5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:58.529914 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 120/237] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:54:58 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:54:58.540362 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74659b4b-cb6b-4ae0-a9bb-fb5fbc70d5d5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:58.542574 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74659b4b-cb6b-4ae0-a9bb-fb5fbc70d5d5 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:58.548828 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fa293-983f-4e2d-9cf8-eaa558924833 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:58.559442 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fa293-983f-4e2d-9cf8-eaa558924833 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:58.567095 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 118/238] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:54:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 02:54:58.569437 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3ee7d-9c19-4d2a-9094-5d4c0aa0dee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:58.570573 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3ee7d-9c19-4d2a-9094-5d4c0aa0dee6 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:58.571161 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3ee7d-9c19-4d2a-9094-5d4c0aa0dee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:58.571675 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3ee7d-9c19-4d2a-9094-5d4c0aa0dee6 admin admin] PATH_INFO: `/v3/users/16d1a714a7ba40a2997ccaedc5163b95` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:58.573355 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74659b4b-cb6b-4ae0-a9bb-fb5fbc70d5d5 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:58.577959 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3ee7d-9c19-4d2a-9094-5d4c0aa0dee6 admin admin] RBAC: Authorizing `identity:get_user(user_id=16d1a714a7ba40a2997ccaedc5163b95)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:58.581255 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3ee7d-9c19-4d2a-9094-5d4c0aa0dee6 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:58.583181 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 121/239] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:54:58 2021] GET /identity/v3/users/16d1a714a7ba40a2997ccaedc5163b95 => generated 283 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:54:58.585763 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74659b4b-cb6b-4ae0-a9bb-fb5fbc70d5d5 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:58.589875 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3ee7d-9c19-4d2a-9094-5d4c0aa0dee6 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:58.602067 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3ee7d-9c19-4d2a-9094-5d4c0aa0dee6 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:58.602228 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6332c5d-3e31-4d22-9e35-112ca512ccff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:58.603188 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6332c5d-3e31-4d22-9e35-112ca512ccff admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:58.603481 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6332c5d-3e31-4d22-9e35-112ca512ccff admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:58.603740 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6332c5d-3e31-4d22-9e35-112ca512ccff admin admin] PATH_INFO: `/v3/projects/edbaae8686104e0483eccd80dd7b042d` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:58.608147 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45dce1-5dc8-4d4d-8674-415e11e92914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:58.609676 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45dce1-5dc8-4d4d-8674-415e11e92914 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:58.609794 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6332c5d-3e31-4d22-9e35-112ca512ccff admin admin] RBAC: Authorizing `identity:get_project(project_id=edbaae8686104e0483eccd80dd7b042d)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:58.610298 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45dce1-5dc8-4d4d-8674-415e11e92914 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:58.610803 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45dce1-5dc8-4d4d-8674-415e11e92914 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:58.611843 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6332c5d-3e31-4d22-9e35-112ca512ccff admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:58.613597 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 119/240] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:54:58 2021] GET /identity/v3/projects/edbaae8686104e0483eccd80dd7b042d => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:58.620620 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6332c5d-3e31-4d22-9e35-112ca512ccff admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:58.621004 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45dce1-5dc8-4d4d-8674-415e11e92914 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:58.623081 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45dce1-5dc8-4d4d-8674-415e11e92914 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:58.633605 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 122/241] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:54:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 02:54:58.639157 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6332c5d-3e31-4d22-9e35-112ca512ccff admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:58.641101 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45dce1-5dc8-4d4d-8674-415e11e92914 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:58.647044 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71148fa7-ecf5-4f3d-9495-5af5e715210e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:58.647923 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71148fa7-ecf5-4f3d-9495-5af5e715210e admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:58.648205 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71148fa7-ecf5-4f3d-9495-5af5e715210e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:58.648474 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71148fa7-ecf5-4f3d-9495-5af5e715210e admin admin] PATH_INFO: `/v3/groups/3ff4e7f4fa8a401789290acc95fe77ba` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:58.652304 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45dce1-5dc8-4d4d-8674-415e11e92914 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:58.659369 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f3d63-93ed-4a14-87d0-bc717951eb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:58.660481 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71148fa7-ecf5-4f3d-9495-5af5e715210e admin admin] RBAC: Authorizing `identity:get_group(group_id=3ff4e7f4fa8a401789290acc95fe77ba)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:58.660889 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f3d63-93ed-4a14-87d0-bc717951eb4b admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:58.661421 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f3d63-93ed-4a14-87d0-bc717951eb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:58.661538 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING py.warnings [None req-71148fa7-ecf5-4f3d-9495-5af5e715210e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:54:58.661538 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: warnings.warn(msg) Sep 23 02:54:58.661538 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: Sep 23 02:54:58.662211 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f3d63-93ed-4a14-87d0-bc717951eb4b admin admin] PATH_INFO: `/v3/projects/fc55a3bab8cf46219f282e51c510171b` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:58.662704 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71148fa7-ecf5-4f3d-9495-5af5e715210e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:58.663940 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f3d63-93ed-4a14-87d0-bc717951eb4b admin admin] RBAC: Authorizing `identity:get_project(project_id=fc55a3bab8cf46219f282e51c510171b)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:58.664590 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 120/242] 10.222.0.23 () {56 vars in 1202 bytes} [Thu Sep 23 02:54:58 2021] GET /identity/v3/groups/3ff4e7f4fa8a401789290acc95fe77ba => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:54:58.666859 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f3d63-93ed-4a14-87d0-bc717951eb4b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:58.668830 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 123/243] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:54:58 2021] GET /identity/v3/projects/fc55a3bab8cf46219f282e51c510171b => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:58.670809 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71148fa7-ecf5-4f3d-9495-5af5e715210e admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:58.676598 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f3d63-93ed-4a14-87d0-bc717951eb4b admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:58.685304 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71148fa7-ecf5-4f3d-9495-5af5e715210e admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:58.688624 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f3d63-93ed-4a14-87d0-bc717951eb4b admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:58.694013 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177b468-a27a-4780-8c85-6075b21e24fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:58.695152 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177b468-a27a-4780-8c85-6075b21e24fe admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:58.695686 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177b468-a27a-4780-8c85-6075b21e24fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:58.696187 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177b468-a27a-4780-8c85-6075b21e24fe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:58.697333 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177b468-a27a-4780-8c85-6075b21e24fe admin admin] RBAC: Adding query filter params (role.id=1e311eea15274107873f2490f2cbc7b4, scope.project.id=fc55a3bab8cf46219f282e51c510171b, user.id=16d1a714a7ba40a2997ccaedc5163b95) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:58.697926 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177b468-a27a-4780-8c85-6075b21e24fe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:58.700186 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177b468-a27a-4780-8c85-6075b21e24fe admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:58.702797 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f00b54-73bb-435c-b90b-14e88793f208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:58.703477 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f00b54-73bb-435c-b90b-14e88793f208 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:58.703755 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f00b54-73bb-435c-b90b-14e88793f208 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:58.704031 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f00b54-73bb-435c-b90b-14e88793f208 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:58.704896 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f00b54-73bb-435c-b90b-14e88793f208 admin admin] RBAC: Adding query filter params (group.id=3ff4e7f4fa8a401789290acc95fe77ba, role.id=99e1944a08bf4c13b6c228cd63b66bcb, scope.project.id=edbaae8686104e0483eccd80dd7b042d) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:58.705209 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f00b54-73bb-435c-b90b-14e88793f208 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:58.707056 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f00b54-73bb-435c-b90b-14e88793f208 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:58.708861 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 124/244] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:54:58 2021] GET /identity/v3/role_assignments?user.id=16d1a714a7ba40a2997ccaedc5163b95&scope.project.id=fc55a3bab8cf46219f282e51c510171b&role.id=1e311eea15274107873f2490f2cbc7b4 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:54:58.720181 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 121/245] 10.222.0.23 () {56 vars in 1398 bytes} [Thu Sep 23 02:54:58 2021] GET /identity/v3/role_assignments?group.id=3ff4e7f4fa8a401789290acc95fe77ba&scope.project.id=edbaae8686104e0483eccd80dd7b042d&role.id=99e1944a08bf4c13b6c228cd63b66bcb => generated 260 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:59.441576 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c2b6a-7ccb-4c15-8dbe-98f074f7f9f3 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:59.443621 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c2b6a-7ccb-4c15-8dbe-98f074f7f9f3 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:59.444129 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c2b6a-7ccb-4c15-8dbe-98f074f7f9f3 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:59.446233 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 125/246] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:54:59 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:54:59.454883 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d772f27-6693-4f71-b476-11702b53d896 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:59.455354 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d772f27-6693-4f71-b476-11702b53d896 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:59.455451 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d772f27-6693-4f71-b476-11702b53d896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:59.480801 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-9d772f27-6693-4f71-b476-11702b53d896 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:54:59.482000 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-9d772f27-6693-4f71-b476-11702b53d896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:54:59.495635 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 122/247] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:54:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:54:59.539324 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c2b6a-7ccb-4c15-8dbe-98f074f7f9f3 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:59.557391 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c2b6a-7ccb-4c15-8dbe-98f074f7f9f3 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:59.569076 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d3e77-bc68-4c8b-888c-182a852f1e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:59.570163 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d3e77-bc68-4c8b-888c-182a852f1e44 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:59.570656 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d3e77-bc68-4c8b-888c-182a852f1e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:59.571155 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d3e77-bc68-4c8b-888c-182a852f1e44 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:59.585329 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d3e77-bc68-4c8b-888c-182a852f1e44 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:54:59.592883 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-1b5d3e77-bc68-4c8b-888c-182a852f1e44 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 02:54:59.594389 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 126/248] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Sep 23 02:54:59 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:54:59.600874 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d772f27-6693-4f71-b476-11702b53d896 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:59.610681 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d772f27-6693-4f71-b476-11702b53d896 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:59.620576 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208687d-011e-46f1-943b-27141b3e31a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:59.621255 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208687d-011e-46f1-943b-27141b3e31a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:59.621535 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208687d-011e-46f1-943b-27141b3e31a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:59.621811 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208687d-011e-46f1-943b-27141b3e31a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:59.622567 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208687d-011e-46f1-943b-27141b3e31a5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:59.622865 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208687d-011e-46f1-943b-27141b3e31a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:59.624482 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208687d-011e-46f1-943b-27141b3e31a5 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:59.637176 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 123/249] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:54:59 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:59.644364 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d3e77-bc68-4c8b-888c-182a852f1e44 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:59.656614 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d3e77-bc68-4c8b-888c-182a852f1e44 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:59.665267 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f2935-6df9-40b6-bbea-5339fe6386ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:59.666175 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f2935-6df9-40b6-bbea-5339fe6386ee admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:59.666662 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f2935-6df9-40b6-bbea-5339fe6386ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:59.667142 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f2935-6df9-40b6-bbea-5339fe6386ee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:59.680189 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f2935-6df9-40b6-bbea-5339fe6386ee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:59.682359 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f2935-6df9-40b6-bbea-5339fe6386ee admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:59.695784 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 127/250] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:54:59 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:54:59.702183 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208687d-011e-46f1-943b-27141b3e31a5 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:59.712704 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208687d-011e-46f1-943b-27141b3e31a5 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:59.723624 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e825e-e7fa-493f-a878-ee9d6036077e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:59.724505 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e825e-e7fa-493f-a878-ee9d6036077e admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:59.724817 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e825e-e7fa-493f-a878-ee9d6036077e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:59.725093 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e825e-e7fa-493f-a878-ee9d6036077e admin admin] PATH_INFO: `/v3/projects/edbaae8686104e0483eccd80dd7b042d` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:59.729225 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e825e-e7fa-493f-a878-ee9d6036077e admin admin] RBAC: Authorizing `identity:get_project(project_id=edbaae8686104e0483eccd80dd7b042d)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:59.731269 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e825e-e7fa-493f-a878-ee9d6036077e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:59.733325 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 124/251] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:54:59 2021] GET /identity/v3/projects/edbaae8686104e0483eccd80dd7b042d => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:59.739864 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f2935-6df9-40b6-bbea-5339fe6386ee admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:59.751891 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f2935-6df9-40b6-bbea-5339fe6386ee admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:59.758606 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e3fcf-4dce-49a9-aa5b-dcff74820f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:59.759798 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e3fcf-4dce-49a9-aa5b-dcff74820f9b admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:59.760298 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e3fcf-4dce-49a9-aa5b-dcff74820f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:59.760842 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e3fcf-4dce-49a9-aa5b-dcff74820f9b admin admin] PATH_INFO: `/v3/groups/3ff4e7f4fa8a401789290acc95fe77ba` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:59.764327 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e3fcf-4dce-49a9-aa5b-dcff74820f9b admin admin] RBAC: Authorizing `identity:get_group(group_id=3ff4e7f4fa8a401789290acc95fe77ba)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:59.765670 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING py.warnings [None req-f15e3fcf-4dce-49a9-aa5b-dcff74820f9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:54:59.765670 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: warnings.warn(msg) Sep 23 02:54:59.765670 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: Sep 23 02:54:59.767294 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e3fcf-4dce-49a9-aa5b-dcff74820f9b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:59.769432 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 128/252] 10.222.0.23 () {56 vars in 1202 bytes} [Thu Sep 23 02:54:59 2021] GET /identity/v3/groups/3ff4e7f4fa8a401789290acc95fe77ba => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:54:59.776095 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e825e-e7fa-493f-a878-ee9d6036077e admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:54:59.786888 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e825e-e7fa-493f-a878-ee9d6036077e admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:54:59.799767 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c939c31-d276-4f44-a280-ee8c34c68b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:54:59.800437 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c939c31-d276-4f44-a280-ee8c34c68b79 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:54:59.800732 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c939c31-d276-4f44-a280-ee8c34c68b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:54:59.801007 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c939c31-d276-4f44-a280-ee8c34c68b79 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:54:59.802176 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c939c31-d276-4f44-a280-ee8c34c68b79 admin admin] RBAC: Adding query filter params (group.id=3ff4e7f4fa8a401789290acc95fe77ba, role.id=1e311eea15274107873f2490f2cbc7b4, scope.project.id=edbaae8686104e0483eccd80dd7b042d) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:54:59.802490 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c939c31-d276-4f44-a280-ee8c34c68b79 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:54:59.804482 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c939c31-d276-4f44-a280-ee8c34c68b79 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:54:59.810562 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 125/253] 10.222.0.23 () {56 vars in 1398 bytes} [Thu Sep 23 02:54:59 2021] GET /identity/v3/role_assignments?group.id=3ff4e7f4fa8a401789290acc95fe77ba&scope.project.id=edbaae8686104e0483eccd80dd7b042d&role.id=1e311eea15274107873f2490f2cbc7b4 => generated 260 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:00.124259 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed0c35-4007-4e4a-b0f2-2d5a5fdcdd02 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:00.125023 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed0c35-4007-4e4a-b0f2-2d5a5fdcdd02 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:00.125516 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed0c35-4007-4e4a-b0f2-2d5a5fdcdd02 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:00.127544 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 129/254] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:00.135474 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3078bb-a53d-484f-b45a-5d3b03b7dff9 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:00.135778 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3078bb-a53d-484f-b45a-5d3b03b7dff9 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:00.136039 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3078bb-a53d-484f-b45a-5d3b03b7dff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:00.160176 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-6a3078bb-a53d-484f-b45a-5d3b03b7dff9 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:00.161454 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-6a3078bb-a53d-484f-b45a-5d3b03b7dff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:00.173163 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 126/255] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:00.200821 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed0c35-4007-4e4a-b0f2-2d5a5fdcdd02 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:00.213692 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed0c35-4007-4e4a-b0f2-2d5a5fdcdd02 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:00.220200 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667500b-7199-4086-804f-13028c4f8a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:00.221022 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667500b-7199-4086-804f-13028c4f8a4f admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:00.221300 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667500b-7199-4086-804f-13028c4f8a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:00.221575 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667500b-7199-4086-804f-13028c4f8a4f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:00.233194 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667500b-7199-4086-804f-13028c4f8a4f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:00.240446 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-0667500b-7199-4086-804f-13028c4f8a4f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 02:55:00.241662 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 130/256] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:55:00 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:00.248167 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3078bb-a53d-484f-b45a-5d3b03b7dff9 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:00.258000 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3078bb-a53d-484f-b45a-5d3b03b7dff9 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:00.263381 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad071306-4283-4b44-a3bb-8607048bbd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:00.264321 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad071306-4283-4b44-a3bb-8607048bbd14 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:00.264630 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad071306-4283-4b44-a3bb-8607048bbd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:00.264906 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad071306-4283-4b44-a3bb-8607048bbd14 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:00.265702 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad071306-4283-4b44-a3bb-8607048bbd14 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:00.266004 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad071306-4283-4b44-a3bb-8607048bbd14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:00.272799 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad071306-4283-4b44-a3bb-8607048bbd14 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:00.282149 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 127/257] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Sep 23 02:55:00 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:00.288370 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667500b-7199-4086-804f-13028c4f8a4f admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:00.298764 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667500b-7199-4086-804f-13028c4f8a4f admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:00.316424 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c8b97-6284-498f-82c3-340743b9206f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:00.317121 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c8b97-6284-498f-82c3-340743b9206f admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:00.317405 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c8b97-6284-498f-82c3-340743b9206f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:00.317683 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c8b97-6284-498f-82c3-340743b9206f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:00.454235 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c8b97-6284-498f-82c3-340743b9206f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:00.457043 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c8b97-6284-498f-82c3-340743b9206f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:00.467661 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 131/258] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:55:00 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:55:00.473866 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad071306-4283-4b44-a3bb-8607048bbd14 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:00.495231 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad071306-4283-4b44-a3bb-8607048bbd14 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:00.505136 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b9170-590b-48cf-a3c5-362c61bd7b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:00.506190 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b9170-590b-48cf-a3c5-362c61bd7b32 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:00.506532 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b9170-590b-48cf-a3c5-362c61bd7b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:00.506811 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b9170-590b-48cf-a3c5-362c61bd7b32 admin admin] PATH_INFO: `/v3/projects/fc55a3bab8cf46219f282e51c510171b` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:00.508072 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b9170-590b-48cf-a3c5-362c61bd7b32 admin admin] RBAC: Authorizing `identity:get_project(project_id=fc55a3bab8cf46219f282e51c510171b)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:00.510187 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b9170-590b-48cf-a3c5-362c61bd7b32 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:00.512065 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 128/259] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:55:00 2021] GET /identity/v3/projects/fc55a3bab8cf46219f282e51c510171b => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:00.518296 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c8b97-6284-498f-82c3-340743b9206f admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:00.534151 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c8b97-6284-498f-82c3-340743b9206f admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:00.544722 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e4129-9ac0-439c-b015-266e2c7e2bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:00.545917 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e4129-9ac0-439c-b015-266e2c7e2bbd admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:00.546480 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e4129-9ac0-439c-b015-266e2c7e2bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:00.546956 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e4129-9ac0-439c-b015-266e2c7e2bbd admin admin] PATH_INFO: `/v3/groups/3ff4e7f4fa8a401789290acc95fe77ba` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:00.553199 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e4129-9ac0-439c-b015-266e2c7e2bbd admin admin] RBAC: Authorizing `identity:get_group(group_id=3ff4e7f4fa8a401789290acc95fe77ba)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:00.555430 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e4129-9ac0-439c-b015-266e2c7e2bbd admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:00.557361 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 132/260] 10.222.0.23 () {56 vars in 1202 bytes} [Thu Sep 23 02:55:00 2021] GET /identity/v3/groups/3ff4e7f4fa8a401789290acc95fe77ba => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:00.564417 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b9170-590b-48cf-a3c5-362c61bd7b32 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:00.576610 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b9170-590b-48cf-a3c5-362c61bd7b32 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:00.584088 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b3c6d-66ee-42ea-85d6-dfa8a38cc0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:00.584785 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b3c6d-66ee-42ea-85d6-dfa8a38cc0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:00.585116 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b3c6d-66ee-42ea-85d6-dfa8a38cc0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:00.585400 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b3c6d-66ee-42ea-85d6-dfa8a38cc0b5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:00.586246 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b3c6d-66ee-42ea-85d6-dfa8a38cc0b5 admin admin] RBAC: Adding query filter params (group.id=3ff4e7f4fa8a401789290acc95fe77ba, role.id=99e1944a08bf4c13b6c228cd63b66bcb, scope.project.id=fc55a3bab8cf46219f282e51c510171b) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:00.586673 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b3c6d-66ee-42ea-85d6-dfa8a38cc0b5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:00.588464 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932b0b4-5981-4efb-b64b-6ead3790a612 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:00.588611 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b3c6d-66ee-42ea-85d6-dfa8a38cc0b5 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:00.589118 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932b0b4-5981-4efb-b64b-6ead3790a612 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:00.589594 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932b0b4-5981-4efb-b64b-6ead3790a612 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:00.591563 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 133/261] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 02:55:00.597622 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 129/262] 10.222.0.23 () {56 vars in 1398 bytes} [Thu Sep 23 02:55:00 2021] GET /identity/v3/role_assignments?group.id=3ff4e7f4fa8a401789290acc95fe77ba&scope.project.id=fc55a3bab8cf46219f282e51c510171b&role.id=99e1944a08bf4c13b6c228cd63b66bcb => generated 260 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:00.599918 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79471106-80d9-4064-b6cb-27149e585a3a None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:00.600428 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79471106-80d9-4064-b6cb-27149e585a3a None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:00.600973 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79471106-80d9-4064-b6cb-27149e585a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:00.629791 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-79471106-80d9-4064-b6cb-27149e585a3a None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:00.631096 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-79471106-80d9-4064-b6cb-27149e585a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:00.642467 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 134/263] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:00.690046 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b3c6d-66ee-42ea-85d6-dfa8a38cc0b5 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:00.700538 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b3c6d-66ee-42ea-85d6-dfa8a38cc0b5 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:00.706383 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fae0c-41a3-483a-aeda-73156e151b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:00.707220 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fae0c-41a3-483a-aeda-73156e151b74 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:00.707510 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fae0c-41a3-483a-aeda-73156e151b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:00.707789 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fae0c-41a3-483a-aeda-73156e151b74 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:00.721390 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fae0c-41a3-483a-aeda-73156e151b74 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:00.729090 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-b54fae0c-41a3-483a-aeda-73156e151b74 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 02:55:00.730425 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 130/264] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Sep 23 02:55:00 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:00.737193 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79471106-80d9-4064-b6cb-27149e585a3a None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:00.746990 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79471106-80d9-4064-b6cb-27149e585a3a None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:00.752260 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5937a-3634-49ec-a0d0-2fc5010a7d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:00.752983 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5937a-3634-49ec-a0d0-2fc5010a7d03 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:00.753326 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5937a-3634-49ec-a0d0-2fc5010a7d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:00.753609 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5937a-3634-49ec-a0d0-2fc5010a7d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:00.754429 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5937a-3634-49ec-a0d0-2fc5010a7d03 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:00.754739 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5937a-3634-49ec-a0d0-2fc5010a7d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:00.756391 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5937a-3634-49ec-a0d0-2fc5010a7d03 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:00.769599 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 135/265] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:00 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:00.776203 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fae0c-41a3-483a-aeda-73156e151b74 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:00.788678 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fae0c-41a3-483a-aeda-73156e151b74 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:00.795493 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc99d7-52fb-4459-a1ab-bf7aee605fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:00.796169 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc99d7-52fb-4459-a1ab-bf7aee605fee admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:00.796558 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc99d7-52fb-4459-a1ab-bf7aee605fee admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:00.796854 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc99d7-52fb-4459-a1ab-bf7aee605fee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:00.806673 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc99d7-52fb-4459-a1ab-bf7aee605fee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:00.809624 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc99d7-52fb-4459-a1ab-bf7aee605fee admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:00.823352 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 131/266] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:55:00 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:55:00.828221 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5937a-3634-49ec-a0d0-2fc5010a7d03 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:00.839128 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5937a-3634-49ec-a0d0-2fc5010a7d03 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:00.845890 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c72d9-18a6-476f-b29d-c10f515625e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:00.846775 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c72d9-18a6-476f-b29d-c10f515625e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:00.847112 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c72d9-18a6-476f-b29d-c10f515625e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:00.847394 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c72d9-18a6-476f-b29d-c10f515625e6 admin admin] PATH_INFO: `/v3/projects/fc55a3bab8cf46219f282e51c510171b` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:00.848670 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c72d9-18a6-476f-b29d-c10f515625e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=fc55a3bab8cf46219f282e51c510171b)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:00.850806 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c72d9-18a6-476f-b29d-c10f515625e6 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:00.852954 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 136/267] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:55:00 2021] GET /identity/v3/projects/fc55a3bab8cf46219f282e51c510171b => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:00.859690 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc99d7-52fb-4459-a1ab-bf7aee605fee admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:00.868853 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc99d7-52fb-4459-a1ab-bf7aee605fee admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:00.873959 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfb7c8-7f21-4f93-8ee3-16586614465e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:00.874853 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfb7c8-7f21-4f93-8ee3-16586614465e admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:00.875242 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfb7c8-7f21-4f93-8ee3-16586614465e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:00.875525 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfb7c8-7f21-4f93-8ee3-16586614465e admin admin] PATH_INFO: `/v3/groups/3ff4e7f4fa8a401789290acc95fe77ba` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:00.876796 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfb7c8-7f21-4f93-8ee3-16586614465e admin admin] RBAC: Authorizing `identity:get_group(group_id=3ff4e7f4fa8a401789290acc95fe77ba)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:00.878859 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfb7c8-7f21-4f93-8ee3-16586614465e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:00.880591 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 132/268] 10.222.0.23 () {56 vars in 1202 bytes} [Thu Sep 23 02:55:00 2021] GET /identity/v3/groups/3ff4e7f4fa8a401789290acc95fe77ba => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:00.887038 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c72d9-18a6-476f-b29d-c10f515625e6 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:00.898266 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c72d9-18a6-476f-b29d-c10f515625e6 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:00.902976 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d6599-7f16-48ec-8ed7-d22f3e29858b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:00.903684 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d6599-7f16-48ec-8ed7-d22f3e29858b admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:00.903974 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d6599-7f16-48ec-8ed7-d22f3e29858b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:00.904255 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d6599-7f16-48ec-8ed7-d22f3e29858b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:00.905184 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d6599-7f16-48ec-8ed7-d22f3e29858b admin admin] RBAC: Adding query filter params (group.id=3ff4e7f4fa8a401789290acc95fe77ba, role.id=1e311eea15274107873f2490f2cbc7b4, scope.project.id=fc55a3bab8cf46219f282e51c510171b) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:00.905506 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d6599-7f16-48ec-8ed7-d22f3e29858b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:00.907627 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d6599-7f16-48ec-8ed7-d22f3e29858b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:00.913721 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 137/269] 10.222.0.23 () {56 vars in 1398 bytes} [Thu Sep 23 02:55:00 2021] GET /identity/v3/role_assignments?group.id=3ff4e7f4fa8a401789290acc95fe77ba&scope.project.id=fc55a3bab8cf46219f282e51c510171b&role.id=1e311eea15274107873f2490f2cbc7b4 => generated 260 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:01.625022 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098e83d-1820-4933-929f-2b9ea7d4d31f None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:01.625529 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098e83d-1820-4933-929f-2b9ea7d4d31f None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:01.625603 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098e83d-1820-4933-929f-2b9ea7d4d31f None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:01.627631 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 133/270] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:01.634974 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89577918-e825-4ab0-b64e-931a7fd10972 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:01.635600 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89577918-e825-4ab0-b64e-931a7fd10972 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:01.635600 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89577918-e825-4ab0-b64e-931a7fd10972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:01.669647 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-89577918-e825-4ab0-b64e-931a7fd10972 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:01.670847 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-89577918-e825-4ab0-b64e-931a7fd10972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:01.680670 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 138/271] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:01.713966 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098e83d-1820-4933-929f-2b9ea7d4d31f None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:01.727397 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098e83d-1820-4933-929f-2b9ea7d4d31f None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:01.731833 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149d108-7fda-454f-8e2a-171202449462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:01.732697 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149d108-7fda-454f-8e2a-171202449462 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:01.732985 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149d108-7fda-454f-8e2a-171202449462 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:01.733266 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149d108-7fda-454f-8e2a-171202449462 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:01.744778 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149d108-7fda-454f-8e2a-171202449462 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:01.752355 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-9149d108-7fda-454f-8e2a-171202449462 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:55:01.753915 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 134/272] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:55:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:01.760322 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89577918-e825-4ab0-b64e-931a7fd10972 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:01.770102 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89577918-e825-4ab0-b64e-931a7fd10972 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:01.774784 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78bb11-6899-41d1-bc20-bbf35af4e562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:01.775654 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78bb11-6899-41d1-bc20-bbf35af4e562 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:01.775944 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78bb11-6899-41d1-bc20-bbf35af4e562 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:01.776225 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78bb11-6899-41d1-bc20-bbf35af4e562 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:01.777022 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78bb11-6899-41d1-bc20-bbf35af4e562 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:01.777332 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78bb11-6899-41d1-bc20-bbf35af4e562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:01.778934 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78bb11-6899-41d1-bc20-bbf35af4e562 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:01.790460 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 139/273] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:55:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:01.797246 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149d108-7fda-454f-8e2a-171202449462 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:01.811412 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149d108-7fda-454f-8e2a-171202449462 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:01.814635 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d8f15-728a-475e-8f14-850ad2eff12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:01.815308 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d8f15-728a-475e-8f14-850ad2eff12d admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:01.815591 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d8f15-728a-475e-8f14-850ad2eff12d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:01.815873 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d8f15-728a-475e-8f14-850ad2eff12d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:01.825425 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d8f15-728a-475e-8f14-850ad2eff12d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:01.827185 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d8f15-728a-475e-8f14-850ad2eff12d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:01.837674 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 135/274] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:55:01 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:55:01.843693 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78bb11-6899-41d1-bc20-bbf35af4e562 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:01.861163 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78bb11-6899-41d1-bc20-bbf35af4e562 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:01.872184 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17be2e4-dd9d-4d8d-b9be-42fc11e9e6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:01.873085 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17be2e4-dd9d-4d8d-b9be-42fc11e9e6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:01.873361 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17be2e4-dd9d-4d8d-b9be-42fc11e9e6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:01.873626 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17be2e4-dd9d-4d8d-b9be-42fc11e9e6a6 admin admin] PATH_INFO: `/v3/projects/c34432677fed4984bbce7291bad96cc8` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:01.877286 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17be2e4-dd9d-4d8d-b9be-42fc11e9e6a6 admin admin] RBAC: Authorizing `identity:get_project(project_id=c34432677fed4984bbce7291bad96cc8)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:01.879026 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17be2e4-dd9d-4d8d-b9be-42fc11e9e6a6 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:01.880921 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 140/275] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:55:01 2021] GET /identity/v3/projects/c34432677fed4984bbce7291bad96cc8 => generated 344 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:01.887187 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d8f15-728a-475e-8f14-850ad2eff12d admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:01.898108 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d8f15-728a-475e-8f14-850ad2eff12d admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:01.903517 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255cb14-5e1f-4d23-8b93-2c04632ab1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:01.904452 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255cb14-5e1f-4d23-8b93-2c04632ab1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:01.904774 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255cb14-5e1f-4d23-8b93-2c04632ab1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:01.905048 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255cb14-5e1f-4d23-8b93-2c04632ab1d8 admin admin] PATH_INFO: `/v3/groups/e1cd28ffb32e4b59a6a6dbefac0eb200` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:01.911745 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255cb14-5e1f-4d23-8b93-2c04632ab1d8 admin admin] RBAC: Authorizing `identity:get_group(group_id=e1cd28ffb32e4b59a6a6dbefac0eb200)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:01.913732 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255cb14-5e1f-4d23-8b93-2c04632ab1d8 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:01.915932 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 136/276] 10.222.0.23 () {56 vars in 1202 bytes} [Thu Sep 23 02:55:01 2021] GET /identity/v3/groups/e1cd28ffb32e4b59a6a6dbefac0eb200 => generated 229 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:01.922962 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17be2e4-dd9d-4d8d-b9be-42fc11e9e6a6 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:01.935314 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17be2e4-dd9d-4d8d-b9be-42fc11e9e6a6 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:01.944832 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d850f-225a-4360-9e59-1b6680cc718f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:01.945517 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d850f-225a-4360-9e59-1b6680cc718f admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:01.945800 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d850f-225a-4360-9e59-1b6680cc718f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:01.946081 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d850f-225a-4360-9e59-1b6680cc718f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:01.946940 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d850f-225a-4360-9e59-1b6680cc718f admin admin] RBAC: Adding query filter params (group.id=e1cd28ffb32e4b59a6a6dbefac0eb200, role.id=3e7d7427203a4a4097e2c9a642b9bf69, scope.project.id=c34432677fed4984bbce7291bad96cc8) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:01.947254 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d850f-225a-4360-9e59-1b6680cc718f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:01.949212 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d850f-225a-4360-9e59-1b6680cc718f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:01.955617 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 141/277] 10.222.0.23 () {56 vars in 1398 bytes} [Thu Sep 23 02:55:01 2021] GET /identity/v3/role_assignments?group.id=e1cd28ffb32e4b59a6a6dbefac0eb200&scope.project.id=c34432677fed4984bbce7291bad96cc8&role.id=3e7d7427203a4a4097e2c9a642b9bf69 => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:02.106636 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab395a2-e01f-498a-8a30-f2d489cd0211 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:02.107042 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab395a2-e01f-498a-8a30-f2d489cd0211 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:02.107331 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab395a2-e01f-498a-8a30-f2d489cd0211 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:02.109476 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 137/278] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:02.117471 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056236f-2485-4248-b0e0-f9693ad6b033 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:02.117757 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056236f-2485-4248-b0e0-f9693ad6b033 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:02.118035 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056236f-2485-4248-b0e0-f9693ad6b033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:02.145707 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-1056236f-2485-4248-b0e0-f9693ad6b033 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:02.146859 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-1056236f-2485-4248-b0e0-f9693ad6b033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:02.155197 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 142/279] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:02.195239 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab395a2-e01f-498a-8a30-f2d489cd0211 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:02.210695 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab395a2-e01f-498a-8a30-f2d489cd0211 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:02.215329 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c6394-b263-4b20-a465-5513f0714b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:02.216154 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c6394-b263-4b20-a465-5513f0714b0f admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:02.216440 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c6394-b263-4b20-a465-5513f0714b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:02.216773 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c6394-b263-4b20-a465-5513f0714b0f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:02.234293 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c6394-b263-4b20-a465-5513f0714b0f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:02.241148 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-389c6394-b263-4b20-a465-5513f0714b0f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 02:55:02.242364 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 138/280] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:55:02 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:02.251408 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056236f-2485-4248-b0e0-f9693ad6b033 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:02.260806 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056236f-2485-4248-b0e0-f9693ad6b033 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:02.267576 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69886487-3c63-41a6-b820-2f9985c5208b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:02.268257 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69886487-3c63-41a6-b820-2f9985c5208b admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:02.268572 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69886487-3c63-41a6-b820-2f9985c5208b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:02.268855 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69886487-3c63-41a6-b820-2f9985c5208b admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:02.269624 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69886487-3c63-41a6-b820-2f9985c5208b admin admin] RBAC: Adding query filter params (name=member) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:02.269932 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69886487-3c63-41a6-b820-2f9985c5208b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:02.271534 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69886487-3c63-41a6-b820-2f9985c5208b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:02.281564 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 143/281] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Sep 23 02:55:02 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:02.287864 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c6394-b263-4b20-a465-5513f0714b0f admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:02.300015 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c6394-b263-4b20-a465-5513f0714b0f admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:02.305622 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d34499-ed2b-46d0-b4c9-c0bc9f2825ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:02.306496 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d34499-ed2b-46d0-b4c9-c0bc9f2825ef admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:02.306776 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d34499-ed2b-46d0-b4c9-c0bc9f2825ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:02.307061 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d34499-ed2b-46d0-b4c9-c0bc9f2825ef admin admin] PATH_INFO: `/v3/groups/3ff4e7f4fa8a401789290acc95fe77ba` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:02.308242 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d34499-ed2b-46d0-b4c9-c0bc9f2825ef admin admin] RBAC: Authorizing `identity:get_group(group_id=3ff4e7f4fa8a401789290acc95fe77ba)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:02.310176 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d34499-ed2b-46d0-b4c9-c0bc9f2825ef admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:02.311785 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 139/282] 10.222.0.23 () {56 vars in 1202 bytes} [Thu Sep 23 02:55:02 2021] GET /identity/v3/groups/3ff4e7f4fa8a401789290acc95fe77ba => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:02.318937 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69886487-3c63-41a6-b820-2f9985c5208b admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:02.328993 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69886487-3c63-41a6-b820-2f9985c5208b admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:02.341168 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233f26b-a46e-48e0-9549-80e174750c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:02.342048 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233f26b-a46e-48e0-9549-80e174750c62 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:02.342329 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233f26b-a46e-48e0-9549-80e174750c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:02.342611 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233f26b-a46e-48e0-9549-80e174750c62 admin admin] PATH_INFO: `/v3/projects/edbaae8686104e0483eccd80dd7b042d` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:02.344463 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d233f26b-a46e-48e0-9549-80e174750c62 admin admin] RBAC: Authorizing `identity:get_project(project_id=edbaae8686104e0483eccd80dd7b042d)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:02.346579 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d233f26b-a46e-48e0-9549-80e174750c62 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:02.348526 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 144/283] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:55:02 2021] GET /identity/v3/projects/edbaae8686104e0483eccd80dd7b042d => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:02.355136 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d34499-ed2b-46d0-b4c9-c0bc9f2825ef admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:02.365644 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d34499-ed2b-46d0-b4c9-c0bc9f2825ef admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:02.374947 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd92bd9-082a-4329-a060-7b26e90f5c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:02.376340 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd92bd9-082a-4329-a060-7b26e90f5c44 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:02.376827 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd92bd9-082a-4329-a060-7b26e90f5c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:02.377292 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd92bd9-082a-4329-a060-7b26e90f5c44 admin admin] PATH_INFO: `/v3/projects/edbaae8686104e0483eccd80dd7b042d/groups/3ff4e7f4fa8a401789290acc95fe77ba/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:02.380796 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd92bd9-082a-4329-a060-7b26e90f5c44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edbaae8686104e0483eccd80dd7b042d, group_id=3ff4e7f4fa8a401789290acc95fe77ba, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:02.383500 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd92bd9-082a-4329-a060-7b26e90f5c44 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:02.468601 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 140/284] 10.222.0.23 () {58 vars in 1464 bytes} [Thu Sep 23 02:55:02 2021] PUT /identity/v3/projects/edbaae8686104e0483eccd80dd7b042d/groups/3ff4e7f4fa8a401789290acc95fe77ba/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 02:55:02.612107 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878fadc-d789-4600-8579-669da101e48c None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:02.612445 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878fadc-d789-4600-8579-669da101e48c None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:02.612697 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878fadc-d789-4600-8579-669da101e48c None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:02.614489 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 145/285] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:02.621895 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952a09a-e1bb-42b4-863c-1fbcfd477c9a None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:02.622192 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952a09a-e1bb-42b4-863c-1fbcfd477c9a None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:02.622514 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952a09a-e1bb-42b4-863c-1fbcfd477c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:02.646689 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-b952a09a-e1bb-42b4-863c-1fbcfd477c9a None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:02.647914 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-b952a09a-e1bb-42b4-863c-1fbcfd477c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:02.715235 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 141/286] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:02.739570 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878fadc-d789-4600-8579-669da101e48c None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:02.754282 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878fadc-d789-4600-8579-669da101e48c None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:02.759987 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67f8ca-08dd-47a2-a2ec-b8ed6060797f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:02.760841 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67f8ca-08dd-47a2-a2ec-b8ed6060797f admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:02.761125 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67f8ca-08dd-47a2-a2ec-b8ed6060797f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:02.761399 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67f8ca-08dd-47a2-a2ec-b8ed6060797f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:02.772320 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67f8ca-08dd-47a2-a2ec-b8ed6060797f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:02.782443 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-fb67f8ca-08dd-47a2-a2ec-b8ed6060797f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 02:55:02.783977 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 146/287] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Sep 23 02:55:02 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:02.790264 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952a09a-e1bb-42b4-863c-1fbcfd477c9a None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:02.805496 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952a09a-e1bb-42b4-863c-1fbcfd477c9a None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:02.812940 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e646a5a-2c2b-44ea-bfae-3232405f686c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:02.813623 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e646a5a-2c2b-44ea-bfae-3232405f686c admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:02.813911 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e646a5a-2c2b-44ea-bfae-3232405f686c admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:02.814180 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e646a5a-2c2b-44ea-bfae-3232405f686c admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:02.814933 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e646a5a-2c2b-44ea-bfae-3232405f686c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:02.815241 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e646a5a-2c2b-44ea-bfae-3232405f686c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:02.818577 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e646a5a-2c2b-44ea-bfae-3232405f686c admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:02.831708 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 142/288] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:02 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:02.838292 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67f8ca-08dd-47a2-a2ec-b8ed6060797f admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:02.851219 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67f8ca-08dd-47a2-a2ec-b8ed6060797f admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:02.856269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d0e7b-13f6-4443-9215-a6b9ac637254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:02.857438 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d0e7b-13f6-4443-9215-a6b9ac637254 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:02.857962 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d0e7b-13f6-4443-9215-a6b9ac637254 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:02.858463 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d0e7b-13f6-4443-9215-a6b9ac637254 admin admin] PATH_INFO: `/v3/groups/3ff4e7f4fa8a401789290acc95fe77ba` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:02.860073 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d0e7b-13f6-4443-9215-a6b9ac637254 admin admin] RBAC: Authorizing `identity:get_group(group_id=3ff4e7f4fa8a401789290acc95fe77ba)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:02.862300 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d0e7b-13f6-4443-9215-a6b9ac637254 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:02.864275 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 147/289] 10.222.0.23 () {56 vars in 1202 bytes} [Thu Sep 23 02:55:02 2021] GET /identity/v3/groups/3ff4e7f4fa8a401789290acc95fe77ba => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:02.870691 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e646a5a-2c2b-44ea-bfae-3232405f686c admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:02.885632 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e646a5a-2c2b-44ea-bfae-3232405f686c admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:02.892747 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1fbbd-8c0c-4cb5-b830-583b2999bb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:02.893624 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1fbbd-8c0c-4cb5-b830-583b2999bb49 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:02.893915 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1fbbd-8c0c-4cb5-b830-583b2999bb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:02.894193 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1fbbd-8c0c-4cb5-b830-583b2999bb49 admin admin] PATH_INFO: `/v3/projects/edbaae8686104e0483eccd80dd7b042d` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:02.901273 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1fbbd-8c0c-4cb5-b830-583b2999bb49 admin admin] RBAC: Authorizing `identity:get_project(project_id=edbaae8686104e0483eccd80dd7b042d)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:02.903343 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1fbbd-8c0c-4cb5-b830-583b2999bb49 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:02.905429 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 143/290] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:55:02 2021] GET /identity/v3/projects/edbaae8686104e0483eccd80dd7b042d => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:02.912364 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d0e7b-13f6-4443-9215-a6b9ac637254 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:02.923266 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d0e7b-13f6-4443-9215-a6b9ac637254 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:02.928263 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb71a7-cbed-41e5-b1ee-6a50fc9e03a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:02.929463 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb71a7-cbed-41e5-b1ee-6a50fc9e03a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:02.929992 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb71a7-cbed-41e5-b1ee-6a50fc9e03a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:02.930477 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb71a7-cbed-41e5-b1ee-6a50fc9e03a8 admin admin] PATH_INFO: `/v3/projects/edbaae8686104e0483eccd80dd7b042d/groups/3ff4e7f4fa8a401789290acc95fe77ba/roles/1e311eea15274107873f2490f2cbc7b4` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:02.933028 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb71a7-cbed-41e5-b1ee-6a50fc9e03a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edbaae8686104e0483eccd80dd7b042d, group_id=3ff4e7f4fa8a401789290acc95fe77ba, role_id=1e311eea15274107873f2490f2cbc7b4)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:02.936022 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb71a7-cbed-41e5-b1ee-6a50fc9e03a8 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:03.017933 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 148/291] 10.222.0.23 () {58 vars in 1464 bytes} [Thu Sep 23 02:55:02 2021] PUT /identity/v3/projects/edbaae8686104e0483eccd80dd7b042d/groups/3ff4e7f4fa8a401789290acc95fe77ba/roles/1e311eea15274107873f2490f2cbc7b4 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 02:55:03.539242 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73d09a-46b7-4641-8d6f-ece2c02ff7c0 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:03.539627 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73d09a-46b7-4641-8d6f-ece2c02ff7c0 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:03.539855 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73d09a-46b7-4641-8d6f-ece2c02ff7c0 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:03.541617 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 144/292] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:03.549388 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c85f64-78a2-4e5a-90f2-df50c76fbfd4 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:03.550044 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c85f64-78a2-4e5a-90f2-df50c76fbfd4 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:03.550549 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c85f64-78a2-4e5a-90f2-df50c76fbfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:03.573413 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-e7c85f64-78a2-4e5a-90f2-df50c76fbfd4 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:03.574970 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-e7c85f64-78a2-4e5a-90f2-df50c76fbfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:03.641900 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 149/293] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:03.676931 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73d09a-46b7-4641-8d6f-ece2c02ff7c0 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:03.691247 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73d09a-46b7-4641-8d6f-ece2c02ff7c0 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:03.696432 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967e9f8-4506-4a25-ab8d-8660be8cb3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:03.700544 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967e9f8-4506-4a25-ab8d-8660be8cb3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:03.701058 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967e9f8-4506-4a25-ab8d-8660be8cb3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:03.701553 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967e9f8-4506-4a25-ab8d-8660be8cb3a1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:03.715322 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967e9f8-4506-4a25-ab8d-8660be8cb3a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:03.723784 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-0967e9f8-4506-4a25-ab8d-8660be8cb3a1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 02:55:03.727656 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 145/294] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Sep 23 02:55:03 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:03.734537 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c85f64-78a2-4e5a-90f2-df50c76fbfd4 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:03.744691 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c85f64-78a2-4e5a-90f2-df50c76fbfd4 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:03.750906 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e05008-7a7e-4d75-8c46-8274973e21e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:03.751976 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e05008-7a7e-4d75-8c46-8274973e21e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:03.752470 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e05008-7a7e-4d75-8c46-8274973e21e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:03.752984 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e05008-7a7e-4d75-8c46-8274973e21e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:03.753947 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e05008-7a7e-4d75-8c46-8274973e21e6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:03.754505 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e05008-7a7e-4d75-8c46-8274973e21e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:03.756404 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e05008-7a7e-4d75-8c46-8274973e21e6 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:03.768013 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 150/295] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:03 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:03.774429 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967e9f8-4506-4a25-ab8d-8660be8cb3a1 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:03.788357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967e9f8-4506-4a25-ab8d-8660be8cb3a1 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:03.793261 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e2fda-8e54-49b2-a5e6-0a44b09d55d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:03.794375 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e2fda-8e54-49b2-a5e6-0a44b09d55d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:03.794870 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e2fda-8e54-49b2-a5e6-0a44b09d55d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:03.795352 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e2fda-8e54-49b2-a5e6-0a44b09d55d2 admin admin] PATH_INFO: `/v3/groups/3ff4e7f4fa8a401789290acc95fe77ba` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:03.796836 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e2fda-8e54-49b2-a5e6-0a44b09d55d2 admin admin] RBAC: Authorizing `identity:get_group(group_id=3ff4e7f4fa8a401789290acc95fe77ba)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:03.798968 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e2fda-8e54-49b2-a5e6-0a44b09d55d2 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:03.800864 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 146/296] 10.222.0.23 () {56 vars in 1202 bytes} [Thu Sep 23 02:55:03 2021] GET /identity/v3/groups/3ff4e7f4fa8a401789290acc95fe77ba => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:03.807293 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e05008-7a7e-4d75-8c46-8274973e21e6 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:03.818608 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e05008-7a7e-4d75-8c46-8274973e21e6 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:03.820970 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa92db7-2ce7-4b08-b76c-f16c09b9a879 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:03.821495 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa92db7-2ce7-4b08-b76c-f16c09b9a879 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:03.822118 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa92db7-2ce7-4b08-b76c-f16c09b9a879 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:03.824670 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 147/297] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 02:55:03.827613 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2e92a-f7f0-4447-951a-db1d3fec2718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:03.828508 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2e92a-f7f0-4447-951a-db1d3fec2718 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:03.828799 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2e92a-f7f0-4447-951a-db1d3fec2718 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:03.829084 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2e92a-f7f0-4447-951a-db1d3fec2718 admin admin] PATH_INFO: `/v3/projects/fc55a3bab8cf46219f282e51c510171b` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:03.836532 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2e92a-f7f0-4447-951a-db1d3fec2718 admin admin] RBAC: Authorizing `identity:get_project(project_id=fc55a3bab8cf46219f282e51c510171b)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:03.836532 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2e92a-f7f0-4447-951a-db1d3fec2718 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:03.838187 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 151/298] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:55:03 2021] GET /identity/v3/projects/fc55a3bab8cf46219f282e51c510171b => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:03.844055 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa92db7-2ce7-4b08-b76c-f16c09b9a879 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:03.846193 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527dce7-9c2d-4019-b9af-9897463e71f8 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:03.846482 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527dce7-9c2d-4019-b9af-9897463e71f8 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:03.846764 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527dce7-9c2d-4019-b9af-9897463e71f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:03.858477 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa92db7-2ce7-4b08-b76c-f16c09b9a879 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:03.863772 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d53268-d2fe-4915-a411-3e7e413ab18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:03.865099 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d53268-d2fe-4915-a411-3e7e413ab18e admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:03.866449 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d53268-d2fe-4915-a411-3e7e413ab18e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:03.867041 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d53268-d2fe-4915-a411-3e7e413ab18e admin admin] PATH_INFO: `/v3/projects/fc55a3bab8cf46219f282e51c510171b/groups/3ff4e7f4fa8a401789290acc95fe77ba/roles/1e311eea15274107873f2490f2cbc7b4` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:03.869674 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d53268-d2fe-4915-a411-3e7e413ab18e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc55a3bab8cf46219f282e51c510171b, group_id=3ff4e7f4fa8a401789290acc95fe77ba, role_id=1e311eea15274107873f2490f2cbc7b4)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:03.873165 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d53268-d2fe-4915-a411-3e7e413ab18e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:03.882661 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-d527dce7-9c2d-4019-b9af-9897463e71f8 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:03.884018 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-d527dce7-9c2d-4019-b9af-9897463e71f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:03.893180 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 152/299] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:03.917421 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527dce7-9c2d-4019-b9af-9897463e71f8 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:03.927225 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527dce7-9c2d-4019-b9af-9897463e71f8 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:03.933072 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec50dc3-a4a6-4ba8-957d-ef8f4ea80432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:03.933918 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec50dc3-a4a6-4ba8-957d-ef8f4ea80432 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:03.934254 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec50dc3-a4a6-4ba8-957d-ef8f4ea80432 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:03.934532 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec50dc3-a4a6-4ba8-957d-ef8f4ea80432 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:03.945598 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec50dc3-a4a6-4ba8-957d-ef8f4ea80432 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:03.953221 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-7ec50dc3-a4a6-4ba8-957d-ef8f4ea80432 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 02:55:03.954612 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 153/300] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:55:03 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:03.961092 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec50dc3-a4a6-4ba8-957d-ef8f4ea80432 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:03.971446 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec50dc3-a4a6-4ba8-957d-ef8f4ea80432 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:03.976342 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22027f74-d23a-4d33-9695-35967058f7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:03.977101 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22027f74-d23a-4d33-9695-35967058f7ea admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:03.977433 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22027f74-d23a-4d33-9695-35967058f7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:03.977756 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22027f74-d23a-4d33-9695-35967058f7ea admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:03.978596 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22027f74-d23a-4d33-9695-35967058f7ea admin admin] RBAC: Adding query filter params (name=member) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:03.978955 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22027f74-d23a-4d33-9695-35967058f7ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:03.980841 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22027f74-d23a-4d33-9695-35967058f7ea admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:03.995776 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 148/302] 10.222.0.23 () {58 vars in 1464 bytes} [Thu Sep 23 02:55:03 2021] PUT /identity/v3/projects/fc55a3bab8cf46219f282e51c510171b/groups/3ff4e7f4fa8a401789290acc95fe77ba/roles/1e311eea15274107873f2490f2cbc7b4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 02:55:03.995942 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 154/302] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Sep 23 02:55:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:04.009638 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22027f74-d23a-4d33-9695-35967058f7ea admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:04.021895 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22027f74-d23a-4d33-9695-35967058f7ea admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:04.102127 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6f0bf-4849-46f5-b668-9a7fe67441fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:04.102928 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6f0bf-4849-46f5-b668-9a7fe67441fe admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:04.103211 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6f0bf-4849-46f5-b668-9a7fe67441fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:04.103484 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6f0bf-4849-46f5-b668-9a7fe67441fe admin admin] PATH_INFO: `/v3/groups/3ff4e7f4fa8a401789290acc95fe77ba` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:04.109578 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6f0bf-4849-46f5-b668-9a7fe67441fe admin admin] RBAC: Authorizing `identity:get_group(group_id=3ff4e7f4fa8a401789290acc95fe77ba)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:04.111650 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6f0bf-4849-46f5-b668-9a7fe67441fe admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:04.113770 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 155/303] 10.222.0.23 () {56 vars in 1202 bytes} [Thu Sep 23 02:55:04 2021] GET /identity/v3/groups/3ff4e7f4fa8a401789290acc95fe77ba => generated 226 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:04.119986 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d53268-d2fe-4915-a411-3e7e413ab18e admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:04.139546 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d53268-d2fe-4915-a411-3e7e413ab18e admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:04.154296 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf30f5-dac2-4cb9-a2a6-9865a52e5acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:04.156180 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf30f5-dac2-4cb9-a2a6-9865a52e5acf admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:04.156725 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf30f5-dac2-4cb9-a2a6-9865a52e5acf admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:04.157214 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf30f5-dac2-4cb9-a2a6-9865a52e5acf admin admin] PATH_INFO: `/v3/projects/fc55a3bab8cf46219f282e51c510171b` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:04.158747 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf30f5-dac2-4cb9-a2a6-9865a52e5acf admin admin] RBAC: Authorizing `identity:get_project(project_id=fc55a3bab8cf46219f282e51c510171b)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:04.161121 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf30f5-dac2-4cb9-a2a6-9865a52e5acf admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:04.168559 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 149/304] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:55:04 2021] GET /identity/v3/projects/fc55a3bab8cf46219f282e51c510171b => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:04.169954 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6f0bf-4849-46f5-b668-9a7fe67441fe admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:04.185533 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6f0bf-4849-46f5-b668-9a7fe67441fe admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:04.192815 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd30ce-f0b2-4c0f-baff-d634bd793e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:04.193720 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd30ce-f0b2-4c0f-baff-d634bd793e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:04.194003 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd30ce-f0b2-4c0f-baff-d634bd793e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:04.194280 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd30ce-f0b2-4c0f-baff-d634bd793e89 admin admin] PATH_INFO: `/v3/projects/fc55a3bab8cf46219f282e51c510171b/groups/3ff4e7f4fa8a401789290acc95fe77ba/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:04.202089 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd30ce-f0b2-4c0f-baff-d634bd793e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc55a3bab8cf46219f282e51c510171b, group_id=3ff4e7f4fa8a401789290acc95fe77ba, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:04.205384 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd30ce-f0b2-4c0f-baff-d634bd793e89 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:04.283240 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 156/305] 10.222.0.23 () {58 vars in 1464 bytes} [Thu Sep 23 02:55:04 2021] PUT /identity/v3/projects/fc55a3bab8cf46219f282e51c510171b/groups/3ff4e7f4fa8a401789290acc95fe77ba/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 02:55:04.831339 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917545e-4ecd-4109-8e89-d23684aab0ba None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:04.832256 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917545e-4ecd-4109-8e89-d23684aab0ba None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:04.832815 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917545e-4ecd-4109-8e89-d23684aab0ba None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:04.834820 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 150/306] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:04 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:04.842266 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f5adf-2a9e-4168-a329-0fa8fc3f7543 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:04.842687 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f5adf-2a9e-4168-a329-0fa8fc3f7543 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:04.842916 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f5adf-2a9e-4168-a329-0fa8fc3f7543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:04.868667 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-cc6f5adf-2a9e-4168-a329-0fa8fc3f7543 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:04.869858 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-cc6f5adf-2a9e-4168-a329-0fa8fc3f7543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:04.942463 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 157/307] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:04.986430 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917545e-4ecd-4109-8e89-d23684aab0ba None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:05.002287 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917545e-4ecd-4109-8e89-d23684aab0ba None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:05.009077 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2367db0-8f98-4186-9095-811b0dd69f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:05.009936 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2367db0-8f98-4186-9095-811b0dd69f5b admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:05.010272 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2367db0-8f98-4186-9095-811b0dd69f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:05.010551 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2367db0-8f98-4186-9095-811b0dd69f5b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:05.021682 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2367db0-8f98-4186-9095-811b0dd69f5b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:05.028385 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-c2367db0-8f98-4186-9095-811b0dd69f5b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:55:05.029604 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 151/308] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:55:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:05.036935 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f5adf-2a9e-4168-a329-0fa8fc3f7543 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:05.046179 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f5adf-2a9e-4168-a329-0fa8fc3f7543 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:05.056565 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c10c9-b75b-4b31-8216-01c18c58e299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:05.057244 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c10c9-b75b-4b31-8216-01c18c58e299 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:05.057522 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c10c9-b75b-4b31-8216-01c18c58e299 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:05.057798 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c10c9-b75b-4b31-8216-01c18c58e299 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:05.058605 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c10c9-b75b-4b31-8216-01c18c58e299 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:05.058912 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c10c9-b75b-4b31-8216-01c18c58e299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:05.060654 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c10c9-b75b-4b31-8216-01c18c58e299 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:05.073575 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 158/309] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:55:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:05.079587 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2367db0-8f98-4186-9095-811b0dd69f5b admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:05.094013 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2367db0-8f98-4186-9095-811b0dd69f5b admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:05.099736 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758aea19-95de-4ea2-8cab-96b7b558e1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:05.100673 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758aea19-95de-4ea2-8cab-96b7b558e1db admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:05.100951 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758aea19-95de-4ea2-8cab-96b7b558e1db admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:05.101226 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758aea19-95de-4ea2-8cab-96b7b558e1db admin admin] PATH_INFO: `/v3/groups/e1cd28ffb32e4b59a6a6dbefac0eb200` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:05.102487 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758aea19-95de-4ea2-8cab-96b7b558e1db admin admin] RBAC: Authorizing `identity:get_group(group_id=e1cd28ffb32e4b59a6a6dbefac0eb200)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:05.104388 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758aea19-95de-4ea2-8cab-96b7b558e1db admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:05.106447 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 152/310] 10.222.0.23 () {56 vars in 1202 bytes} [Thu Sep 23 02:55:05 2021] GET /identity/v3/groups/e1cd28ffb32e4b59a6a6dbefac0eb200 => generated 229 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:05.112397 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c10c9-b75b-4b31-8216-01c18c58e299 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:05.122737 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c10c9-b75b-4b31-8216-01c18c58e299 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:05.130420 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d280fb4-a386-4c7f-bc79-ae34135437ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:05.131339 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d280fb4-a386-4c7f-bc79-ae34135437ce admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:05.131617 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d280fb4-a386-4c7f-bc79-ae34135437ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:05.131890 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d280fb4-a386-4c7f-bc79-ae34135437ce admin admin] PATH_INFO: `/v3/projects/c34432677fed4984bbce7291bad96cc8` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:05.133146 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d280fb4-a386-4c7f-bc79-ae34135437ce admin admin] RBAC: Authorizing `identity:get_project(project_id=c34432677fed4984bbce7291bad96cc8)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:05.135059 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d280fb4-a386-4c7f-bc79-ae34135437ce admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:05.136923 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 159/311] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:55:05 2021] GET /identity/v3/projects/c34432677fed4984bbce7291bad96cc8 => generated 344 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:05.143487 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758aea19-95de-4ea2-8cab-96b7b558e1db admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:05.154000 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758aea19-95de-4ea2-8cab-96b7b558e1db admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:05.159589 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cd94c-8b2a-49c5-9540-65dce5467ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:05.160536 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cd94c-8b2a-49c5-9540-65dce5467ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:05.160815 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cd94c-8b2a-49c5-9540-65dce5467ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:05.161091 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cd94c-8b2a-49c5-9540-65dce5467ff8 admin admin] PATH_INFO: `/v3/projects/c34432677fed4984bbce7291bad96cc8/groups/e1cd28ffb32e4b59a6a6dbefac0eb200/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:05.164964 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cd94c-8b2a-49c5-9540-65dce5467ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34432677fed4984bbce7291bad96cc8, group_id=e1cd28ffb32e4b59a6a6dbefac0eb200, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:05.167676 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cd94c-8b2a-49c5-9540-65dce5467ff8 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:05.245264 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 153/312] 10.222.0.23 () {58 vars in 1464 bytes} [Thu Sep 23 02:55:05 2021] PUT /identity/v3/projects/c34432677fed4984bbce7291bad96cc8/groups/e1cd28ffb32e4b59a6a6dbefac0eb200/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 02:55:05.436062 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8335fa8-d7f8-4dda-836a-2c0c833dede4 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:05.436415 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8335fa8-d7f8-4dda-836a-2c0c833dede4 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:05.436626 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8335fa8-d7f8-4dda-836a-2c0c833dede4 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:05.438618 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 160/313] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:05.446659 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abe0a4-cc7d-4fcf-913c-ba19db15524f None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:05.446954 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abe0a4-cc7d-4fcf-913c-ba19db15524f None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:05.447214 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abe0a4-cc7d-4fcf-913c-ba19db15524f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:05.472929 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-d2abe0a4-cc7d-4fcf-913c-ba19db15524f None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:05.474139 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-d2abe0a4-cc7d-4fcf-913c-ba19db15524f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:05.549043 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 154/314] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:05.581043 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8335fa8-d7f8-4dda-836a-2c0c833dede4 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:05.594315 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8335fa8-d7f8-4dda-836a-2c0c833dede4 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:05.599140 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd094446-af1e-484d-abba-fa8d61468332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:05.600214 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd094446-af1e-484d-abba-fa8d61468332 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:05.600803 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd094446-af1e-484d-abba-fa8d61468332 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:05.601307 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd094446-af1e-484d-abba-fa8d61468332 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:05.613802 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd094446-af1e-484d-abba-fa8d61468332 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:05.621033 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-cd094446-af1e-484d-abba-fa8d61468332 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 02:55:05.622839 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 161/315] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:55:05 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:05.629523 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2abe0a4-cc7d-4fcf-913c-ba19db15524f None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:05.639481 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2abe0a4-cc7d-4fcf-913c-ba19db15524f None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:05.645203 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc9c7e-0c3d-40b5-ae9d-1080118a91f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:05.646241 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc9c7e-0c3d-40b5-ae9d-1080118a91f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:05.646737 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc9c7e-0c3d-40b5-ae9d-1080118a91f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:05.647224 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc9c7e-0c3d-40b5-ae9d-1080118a91f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:05.648325 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc9c7e-0c3d-40b5-ae9d-1080118a91f7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:05.648891 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc9c7e-0c3d-40b5-ae9d-1080118a91f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:05.650854 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc9c7e-0c3d-40b5-ae9d-1080118a91f7 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:05.661005 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 155/316] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Sep 23 02:55:05 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:05.667615 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd094446-af1e-484d-abba-fa8d61468332 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:05.680242 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd094446-af1e-484d-abba-fa8d61468332 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:05.685421 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b83349-13fd-4788-bb60-2913fc40553b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:05.686473 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b83349-13fd-4788-bb60-2913fc40553b admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:05.687026 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b83349-13fd-4788-bb60-2913fc40553b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:05.687607 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b83349-13fd-4788-bb60-2913fc40553b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:05.696505 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b83349-13fd-4788-bb60-2913fc40553b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:05.698653 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b83349-13fd-4788-bb60-2913fc40553b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:05.709004 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 162/317] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:55:05 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:55:05.715602 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc9c7e-0c3d-40b5-ae9d-1080118a91f7 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:05.726690 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc9c7e-0c3d-40b5-ae9d-1080118a91f7 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:05.731750 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b24270-467d-4dcd-91b5-a76803ce48fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:05.732894 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b24270-467d-4dcd-91b5-a76803ce48fb admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:05.733465 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b24270-467d-4dcd-91b5-a76803ce48fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:05.733987 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b24270-467d-4dcd-91b5-a76803ce48fb admin admin] PATH_INFO: `/v3/projects/edbaae8686104e0483eccd80dd7b042d` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:05.735460 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b24270-467d-4dcd-91b5-a76803ce48fb admin admin] RBAC: Authorizing `identity:get_project(project_id=edbaae8686104e0483eccd80dd7b042d)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:05.737991 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b24270-467d-4dcd-91b5-a76803ce48fb admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:05.740245 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 156/318] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:55:05 2021] GET /identity/v3/projects/edbaae8686104e0483eccd80dd7b042d => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:05.748331 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b83349-13fd-4788-bb60-2913fc40553b admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:05.762387 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b83349-13fd-4788-bb60-2913fc40553b admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:05.772918 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23546948-b6d5-4271-aa0e-d111880446b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:05.774285 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23546948-b6d5-4271-aa0e-d111880446b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:05.774776 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23546948-b6d5-4271-aa0e-d111880446b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:05.776501 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23546948-b6d5-4271-aa0e-d111880446b0 admin admin] PATH_INFO: `/v3/groups/3ff4e7f4fa8a401789290acc95fe77ba` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:05.780163 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23546948-b6d5-4271-aa0e-d111880446b0 admin admin] RBAC: Authorizing `identity:get_group(group_id=3ff4e7f4fa8a401789290acc95fe77ba)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:05.782434 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23546948-b6d5-4271-aa0e-d111880446b0 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:05.784846 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 163/319] 10.222.0.23 () {56 vars in 1202 bytes} [Thu Sep 23 02:55:05 2021] GET /identity/v3/groups/3ff4e7f4fa8a401789290acc95fe77ba => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:05.791442 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b24270-467d-4dcd-91b5-a76803ce48fb admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:05.801862 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b24270-467d-4dcd-91b5-a76803ce48fb admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:05.806949 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf1cfa-c91c-4f56-b5e5-250c6bc869ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:05.807885 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf1cfa-c91c-4f56-b5e5-250c6bc869ca admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:05.808408 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf1cfa-c91c-4f56-b5e5-250c6bc869ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:05.808934 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf1cfa-c91c-4f56-b5e5-250c6bc869ca admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:05.810030 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf1cfa-c91c-4f56-b5e5-250c6bc869ca admin admin] RBAC: Adding query filter params (group.id=3ff4e7f4fa8a401789290acc95fe77ba, role.id=99e1944a08bf4c13b6c228cd63b66bcb, scope.project.id=edbaae8686104e0483eccd80dd7b042d) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:05.810553 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf1cfa-c91c-4f56-b5e5-250c6bc869ca admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:05.813456 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf1cfa-c91c-4f56-b5e5-250c6bc869ca admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:05.825726 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 157/320] 10.222.0.23 () {56 vars in 1398 bytes} [Thu Sep 23 02:55:05 2021] GET /identity/v3/role_assignments?group.id=3ff4e7f4fa8a401789290acc95fe77ba&scope.project.id=edbaae8686104e0483eccd80dd7b042d&role.id=99e1944a08bf4c13b6c228cd63b66bcb => generated 611 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:06.019041 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f4a10-7137-4fcb-b223-0de06d96f727 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:06.020077 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f4a10-7137-4fcb-b223-0de06d96f727 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:06.020895 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f4a10-7137-4fcb-b223-0de06d96f727 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:06.023110 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 164/321] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:06.031158 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd769e52-35a5-4b12-88e8-a9223c1dc70c None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:06.034260 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd769e52-35a5-4b12-88e8-a9223c1dc70c None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:06.035908 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd769e52-35a5-4b12-88e8-a9223c1dc70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:06.058767 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-dd769e52-35a5-4b12-88e8-a9223c1dc70c None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:06.060715 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-dd769e52-35a5-4b12-88e8-a9223c1dc70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:06.070341 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 158/322] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:06.115862 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f4a10-7137-4fcb-b223-0de06d96f727 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:06.139046 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f4a10-7137-4fcb-b223-0de06d96f727 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:06.144509 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf81a36-3435-4ad5-a1cd-79334f039684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:06.145628 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf81a36-3435-4ad5-a1cd-79334f039684 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:06.146158 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf81a36-3435-4ad5-a1cd-79334f039684 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:06.146639 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf81a36-3435-4ad5-a1cd-79334f039684 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:06.163515 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf81a36-3435-4ad5-a1cd-79334f039684 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:06.171390 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-1cf81a36-3435-4ad5-a1cd-79334f039684 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 02:55:06.173213 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 165/323] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Sep 23 02:55:06 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:06.183398 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd769e52-35a5-4b12-88e8-a9223c1dc70c None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:06.193368 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd769e52-35a5-4b12-88e8-a9223c1dc70c None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:06.198197 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0aab7-5d66-43b3-a2b5-aadac6d35478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:06.199122 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0aab7-5d66-43b3-a2b5-aadac6d35478 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:06.199612 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0aab7-5d66-43b3-a2b5-aadac6d35478 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:06.200108 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0aab7-5d66-43b3-a2b5-aadac6d35478 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:06.201185 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0aab7-5d66-43b3-a2b5-aadac6d35478 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:06.201704 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0aab7-5d66-43b3-a2b5-aadac6d35478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:06.207149 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0aab7-5d66-43b3-a2b5-aadac6d35478 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:06.217239 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 159/324] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:06 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:06.223059 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf81a36-3435-4ad5-a1cd-79334f039684 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:06.237516 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf81a36-3435-4ad5-a1cd-79334f039684 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:06.242631 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22fd53-2b77-422a-a5fa-7232fcea496f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:06.243568 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22fd53-2b77-422a-a5fa-7232fcea496f admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:06.244109 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22fd53-2b77-422a-a5fa-7232fcea496f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:06.244627 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22fd53-2b77-422a-a5fa-7232fcea496f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:06.257328 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22fd53-2b77-422a-a5fa-7232fcea496f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:06.259783 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22fd53-2b77-422a-a5fa-7232fcea496f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:06.271260 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 166/325] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:55:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:55:06.276984 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0aab7-5d66-43b3-a2b5-aadac6d35478 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:06.291579 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0aab7-5d66-43b3-a2b5-aadac6d35478 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:06.297535 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39599a2-aa8c-4a2e-86ea-e280189676a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:06.298699 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39599a2-aa8c-4a2e-86ea-e280189676a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:06.299251 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39599a2-aa8c-4a2e-86ea-e280189676a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:06.299755 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39599a2-aa8c-4a2e-86ea-e280189676a0 admin admin] PATH_INFO: `/v3/projects/edbaae8686104e0483eccd80dd7b042d` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:06.306173 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39599a2-aa8c-4a2e-86ea-e280189676a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=edbaae8686104e0483eccd80dd7b042d)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:06.310149 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39599a2-aa8c-4a2e-86ea-e280189676a0 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:06.313872 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 160/326] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:55:06 2021] GET /identity/v3/projects/edbaae8686104e0483eccd80dd7b042d => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:06.320659 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22fd53-2b77-422a-a5fa-7232fcea496f admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:06.331016 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22fd53-2b77-422a-a5fa-7232fcea496f admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:06.336198 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f9393-58d1-44ef-b165-9815de93c9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:06.339389 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f9393-58d1-44ef-b165-9815de93c9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:06.340967 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f9393-58d1-44ef-b165-9815de93c9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:06.341538 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f9393-58d1-44ef-b165-9815de93c9f9 admin admin] PATH_INFO: `/v3/groups/3ff4e7f4fa8a401789290acc95fe77ba` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:06.343907 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f9393-58d1-44ef-b165-9815de93c9f9 admin admin] RBAC: Authorizing `identity:get_group(group_id=3ff4e7f4fa8a401789290acc95fe77ba)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:06.346293 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f9393-58d1-44ef-b165-9815de93c9f9 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:06.348592 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 167/327] 10.222.0.23 () {56 vars in 1202 bytes} [Thu Sep 23 02:55:06 2021] GET /identity/v3/groups/3ff4e7f4fa8a401789290acc95fe77ba => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:06.356982 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39599a2-aa8c-4a2e-86ea-e280189676a0 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:06.370955 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39599a2-aa8c-4a2e-86ea-e280189676a0 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:06.377727 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc0506-cccf-484f-8063-2e19d73b3345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:06.378736 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc0506-cccf-484f-8063-2e19d73b3345 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:06.379240 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc0506-cccf-484f-8063-2e19d73b3345 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:06.379774 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc0506-cccf-484f-8063-2e19d73b3345 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:06.380883 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc0506-cccf-484f-8063-2e19d73b3345 admin admin] RBAC: Adding query filter params (group.id=3ff4e7f4fa8a401789290acc95fe77ba, role.id=1e311eea15274107873f2490f2cbc7b4, scope.project.id=edbaae8686104e0483eccd80dd7b042d) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:06.381445 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc0506-cccf-484f-8063-2e19d73b3345 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:06.383726 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc0506-cccf-484f-8063-2e19d73b3345 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:06.391567 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 161/328] 10.222.0.23 () {56 vars in 1398 bytes} [Thu Sep 23 02:55:06 2021] GET /identity/v3/role_assignments?group.id=3ff4e7f4fa8a401789290acc95fe77ba&scope.project.id=edbaae8686104e0483eccd80dd7b042d&role.id=1e311eea15274107873f2490f2cbc7b4 => generated 611 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:06.871315 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f91d2-53aa-4b82-8ee2-1610d7cd3890 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:06.871656 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f91d2-53aa-4b82-8ee2-1610d7cd3890 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:06.871866 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f91d2-53aa-4b82-8ee2-1610d7cd3890 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:06.873969 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 168/329] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:06.881577 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254b6e8-066b-4136-813f-2a377ff4f451 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:06.881874 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254b6e8-066b-4136-813f-2a377ff4f451 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:06.882135 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254b6e8-066b-4136-813f-2a377ff4f451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:06.901486 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-a254b6e8-066b-4136-813f-2a377ff4f451 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:06.902710 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-a254b6e8-066b-4136-813f-2a377ff4f451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:06.912579 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 162/330] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:06.935792 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f91d2-53aa-4b82-8ee2-1610d7cd3890 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:06.948264 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f91d2-53aa-4b82-8ee2-1610d7cd3890 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:06.953396 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea21649-47b5-4630-b901-c2f942db6a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:06.954225 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea21649-47b5-4630-b901-c2f942db6a7a admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:06.954499 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea21649-47b5-4630-b901-c2f942db6a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:06.954772 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea21649-47b5-4630-b901-c2f942db6a7a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:06.966500 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea21649-47b5-4630-b901-c2f942db6a7a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:06.974468 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-5ea21649-47b5-4630-b901-c2f942db6a7a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 02:55:06.975923 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 169/331] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Sep 23 02:55:06 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:06.982295 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254b6e8-066b-4136-813f-2a377ff4f451 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:06.991802 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254b6e8-066b-4136-813f-2a377ff4f451 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:06.996332 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a71124-fc4d-4276-a490-d29ad54f8f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:06.997070 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a71124-fc4d-4276-a490-d29ad54f8f80 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:06.997379 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a71124-fc4d-4276-a490-d29ad54f8f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:06.997635 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a71124-fc4d-4276-a490-d29ad54f8f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:06.998390 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a71124-fc4d-4276-a490-d29ad54f8f80 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:06.998703 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a71124-fc4d-4276-a490-d29ad54f8f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:07.000379 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a71124-fc4d-4276-a490-d29ad54f8f80 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:07.009560 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 163/332] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:06 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:07.016288 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea21649-47b5-4630-b901-c2f942db6a7a admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:07.027085 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea21649-47b5-4630-b901-c2f942db6a7a admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:07.034596 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2003289-fcd9-42b3-a515-1611536c91d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:07.035248 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2003289-fcd9-42b3-a515-1611536c91d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:07.035524 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2003289-fcd9-42b3-a515-1611536c91d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:07.035795 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2003289-fcd9-42b3-a515-1611536c91d0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:07.046904 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2003289-fcd9-42b3-a515-1611536c91d0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:07.048717 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2003289-fcd9-42b3-a515-1611536c91d0 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:07.057778 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 170/333] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:55:07 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 02:55:07.063801 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a71124-fc4d-4276-a490-d29ad54f8f80 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:07.076613 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a71124-fc4d-4276-a490-d29ad54f8f80 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:07.081794 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5f989-7565-4935-a62b-56d55a2a9681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:07.082655 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5f989-7565-4935-a62b-56d55a2a9681 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:07.082935 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5f989-7565-4935-a62b-56d55a2a9681 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:07.083207 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5f989-7565-4935-a62b-56d55a2a9681 admin admin] PATH_INFO: `/v3/projects/fc55a3bab8cf46219f282e51c510171b` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:07.084421 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5f989-7565-4935-a62b-56d55a2a9681 admin admin] RBAC: Authorizing `identity:get_project(project_id=fc55a3bab8cf46219f282e51c510171b)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:07.086548 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5f989-7565-4935-a62b-56d55a2a9681 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:07.088388 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 164/334] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:55:07 2021] GET /identity/v3/projects/fc55a3bab8cf46219f282e51c510171b => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:07.094437 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2003289-fcd9-42b3-a515-1611536c91d0 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:07.103276 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2003289-fcd9-42b3-a515-1611536c91d0 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:07.110350 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855f561-02da-475d-83e7-365f1baba2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:07.111187 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855f561-02da-475d-83e7-365f1baba2aa admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:07.111459 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855f561-02da-475d-83e7-365f1baba2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:07.111719 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855f561-02da-475d-83e7-365f1baba2aa admin admin] PATH_INFO: `/v3/groups/3ff4e7f4fa8a401789290acc95fe77ba` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:07.112944 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855f561-02da-475d-83e7-365f1baba2aa admin admin] RBAC: Authorizing `identity:get_group(group_id=3ff4e7f4fa8a401789290acc95fe77ba)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:07.114829 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855f561-02da-475d-83e7-365f1baba2aa admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:07.116598 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 171/335] 10.222.0.23 () {56 vars in 1202 bytes} [Thu Sep 23 02:55:07 2021] GET /identity/v3/groups/3ff4e7f4fa8a401789290acc95fe77ba => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:07.122956 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5f989-7565-4935-a62b-56d55a2a9681 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:07.133480 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5f989-7565-4935-a62b-56d55a2a9681 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:07.137853 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474fa23-0b92-4680-910d-46ffe0aed49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:07.138784 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474fa23-0b92-4680-910d-46ffe0aed49a admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:07.139075 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474fa23-0b92-4680-910d-46ffe0aed49a admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:07.139357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474fa23-0b92-4680-910d-46ffe0aed49a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:07.142857 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474fa23-0b92-4680-910d-46ffe0aed49a admin admin] RBAC: Adding query filter params (group.id=3ff4e7f4fa8a401789290acc95fe77ba, role.id=1e311eea15274107873f2490f2cbc7b4, scope.project.id=fc55a3bab8cf46219f282e51c510171b) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:07.143196 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474fa23-0b92-4680-910d-46ffe0aed49a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:07.145083 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474fa23-0b92-4680-910d-46ffe0aed49a admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:07.151567 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 165/336] 10.222.0.23 () {56 vars in 1398 bytes} [Thu Sep 23 02:55:07 2021] GET /identity/v3/role_assignments?group.id=3ff4e7f4fa8a401789290acc95fe77ba&scope.project.id=fc55a3bab8cf46219f282e51c510171b&role.id=1e311eea15274107873f2490f2cbc7b4 => generated 611 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:07.257426 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015a7b1-79a8-42d0-b214-71490c5611a9 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:07.257777 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015a7b1-79a8-42d0-b214-71490c5611a9 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:07.257987 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015a7b1-79a8-42d0-b214-71490c5611a9 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:07.259819 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 172/337] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:07.268518 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65f87c-24ec-497e-8562-9cb164ff070c None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:07.268833 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65f87c-24ec-497e-8562-9cb164ff070c None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:07.269090 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65f87c-24ec-497e-8562-9cb164ff070c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:07.288009 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-cc65f87c-24ec-497e-8562-9cb164ff070c None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:07.289266 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-cc65f87c-24ec-497e-8562-9cb164ff070c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:07.297260 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 166/338] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:07.321817 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015a7b1-79a8-42d0-b214-71490c5611a9 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:07.335087 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015a7b1-79a8-42d0-b214-71490c5611a9 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:07.339451 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb347837-8bbc-452b-8f4c-27a1549fb0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:07.340242 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb347837-8bbc-452b-8f4c-27a1549fb0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:07.340568 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb347837-8bbc-452b-8f4c-27a1549fb0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:07.340846 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb347837-8bbc-452b-8f4c-27a1549fb0f1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:07.352705 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb347837-8bbc-452b-8f4c-27a1549fb0f1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:07.359704 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-fb347837-8bbc-452b-8f4c-27a1549fb0f1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 02:55:07.361273 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 173/339] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:55:07 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:07.367592 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65f87c-24ec-497e-8562-9cb164ff070c None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:07.377669 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65f87c-24ec-497e-8562-9cb164ff070c None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:07.384447 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87468fc0-6466-4d34-87ae-0677f4fb6478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:07.385155 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87468fc0-6466-4d34-87ae-0677f4fb6478 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:07.385438 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87468fc0-6466-4d34-87ae-0677f4fb6478 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:07.385710 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87468fc0-6466-4d34-87ae-0677f4fb6478 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:07.386456 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87468fc0-6466-4d34-87ae-0677f4fb6478 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:07.386764 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87468fc0-6466-4d34-87ae-0677f4fb6478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:07.388632 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87468fc0-6466-4d34-87ae-0677f4fb6478 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:07.397158 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 167/340] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Sep 23 02:55:07 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:07.403394 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb347837-8bbc-452b-8f4c-27a1549fb0f1 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:07.413312 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb347837-8bbc-452b-8f4c-27a1549fb0f1 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:07.417576 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456b145-c24d-4e2b-b9b9-54faf57e7dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:07.418211 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456b145-c24d-4e2b-b9b9-54faf57e7dfe admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:07.418491 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456b145-c24d-4e2b-b9b9-54faf57e7dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:07.418763 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456b145-c24d-4e2b-b9b9-54faf57e7dfe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:07.427365 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456b145-c24d-4e2b-b9b9-54faf57e7dfe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:07.429124 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456b145-c24d-4e2b-b9b9-54faf57e7dfe admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:07.437613 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 174/341] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:55:07 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:55:07.443733 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87468fc0-6466-4d34-87ae-0677f4fb6478 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:07.453266 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87468fc0-6466-4d34-87ae-0677f4fb6478 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:07.457536 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd15fd-71b4-43cd-bb8b-bf29134062a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:07.458387 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd15fd-71b4-43cd-bb8b-bf29134062a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:07.458671 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd15fd-71b4-43cd-bb8b-bf29134062a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:07.458951 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd15fd-71b4-43cd-bb8b-bf29134062a2 admin admin] PATH_INFO: `/v3/projects/fc55a3bab8cf46219f282e51c510171b` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:07.460126 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd15fd-71b4-43cd-bb8b-bf29134062a2 admin admin] RBAC: Authorizing `identity:get_project(project_id=fc55a3bab8cf46219f282e51c510171b)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:07.462216 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd15fd-71b4-43cd-bb8b-bf29134062a2 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:07.463864 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 168/342] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:55:07 2021] GET /identity/v3/projects/fc55a3bab8cf46219f282e51c510171b => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:07.470331 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456b145-c24d-4e2b-b9b9-54faf57e7dfe admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:07.479124 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456b145-c24d-4e2b-b9b9-54faf57e7dfe admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:07.483482 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db31f5e-7e05-46bd-afd1-a069fc81d5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:07.484877 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db31f5e-7e05-46bd-afd1-a069fc81d5da admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:07.485147 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db31f5e-7e05-46bd-afd1-a069fc81d5da admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:07.485410 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db31f5e-7e05-46bd-afd1-a069fc81d5da admin admin] PATH_INFO: `/v3/groups/3ff4e7f4fa8a401789290acc95fe77ba` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:07.486567 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db31f5e-7e05-46bd-afd1-a069fc81d5da admin admin] RBAC: Authorizing `identity:get_group(group_id=3ff4e7f4fa8a401789290acc95fe77ba)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:07.488427 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db31f5e-7e05-46bd-afd1-a069fc81d5da admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:07.490015 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 175/343] 10.222.0.23 () {56 vars in 1202 bytes} [Thu Sep 23 02:55:07 2021] GET /identity/v3/groups/3ff4e7f4fa8a401789290acc95fe77ba => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:07.496369 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd15fd-71b4-43cd-bb8b-bf29134062a2 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:07.506332 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd15fd-71b4-43cd-bb8b-bf29134062a2 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:07.510662 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f929d2-5fa3-40fc-9963-4c7d756f44ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:07.511322 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f929d2-5fa3-40fc-9963-4c7d756f44ba admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:07.511606 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f929d2-5fa3-40fc-9963-4c7d756f44ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:07.511885 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f929d2-5fa3-40fc-9963-4c7d756f44ba admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:07.512752 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f929d2-5fa3-40fc-9963-4c7d756f44ba admin admin] RBAC: Adding query filter params (group.id=3ff4e7f4fa8a401789290acc95fe77ba, role.id=99e1944a08bf4c13b6c228cd63b66bcb, scope.project.id=fc55a3bab8cf46219f282e51c510171b) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:07.513069 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f929d2-5fa3-40fc-9963-4c7d756f44ba admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:07.515165 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f929d2-5fa3-40fc-9963-4c7d756f44ba admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:07.521287 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 169/344] 10.222.0.23 () {56 vars in 1398 bytes} [Thu Sep 23 02:55:07 2021] GET /identity/v3/role_assignments?group.id=3ff4e7f4fa8a401789290acc95fe77ba&scope.project.id=fc55a3bab8cf46219f282e51c510171b&role.id=99e1944a08bf4c13b6c228cd63b66bcb => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:07.907008 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0edff-be29-41d8-b4d7-dd2097177e2f None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:07.907290 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0edff-be29-41d8-b4d7-dd2097177e2f None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:07.907569 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0edff-be29-41d8-b4d7-dd2097177e2f None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:07.909385 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 176/345] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:07.916692 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4a94e-a579-4010-9086-cfdc71c27bdc None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:07.916986 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4a94e-a579-4010-9086-cfdc71c27bdc None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:07.917262 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4a94e-a579-4010-9086-cfdc71c27bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:07.935357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-36d4a94e-a579-4010-9086-cfdc71c27bdc None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:07.936601 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-36d4a94e-a579-4010-9086-cfdc71c27bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:07.944183 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 170/346] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:07.969367 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0edff-be29-41d8-b4d7-dd2097177e2f None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:07.981674 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0edff-be29-41d8-b4d7-dd2097177e2f None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:07.986614 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133592a1-101c-47b1-b6c4-57fc6971fc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:07.987409 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133592a1-101c-47b1-b6c4-57fc6971fc37 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:07.987689 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133592a1-101c-47b1-b6c4-57fc6971fc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:07.987970 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133592a1-101c-47b1-b6c4-57fc6971fc37 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:07.998442 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133592a1-101c-47b1-b6c4-57fc6971fc37 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:08.005241 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-133592a1-101c-47b1-b6c4-57fc6971fc37 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:55:08.006418 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 177/347] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:55:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:08.012829 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4a94e-a579-4010-9086-cfdc71c27bdc None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:08.022052 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4a94e-a579-4010-9086-cfdc71c27bdc None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:08.026497 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5a8f7-2e1d-4809-9e5c-849443d7b192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:08.027163 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5a8f7-2e1d-4809-9e5c-849443d7b192 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:08.027449 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5a8f7-2e1d-4809-9e5c-849443d7b192 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:08.027728 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5a8f7-2e1d-4809-9e5c-849443d7b192 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:08.028473 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5a8f7-2e1d-4809-9e5c-849443d7b192 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:08.028814 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5a8f7-2e1d-4809-9e5c-849443d7b192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:08.030951 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5a8f7-2e1d-4809-9e5c-849443d7b192 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:08.039033 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 171/348] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:55:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:08.045046 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133592a1-101c-47b1-b6c4-57fc6971fc37 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:08.055112 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133592a1-101c-47b1-b6c4-57fc6971fc37 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:08.059420 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb345b06-b5b8-4065-b746-7ac6c532dc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:08.060051 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb345b06-b5b8-4065-b746-7ac6c532dc51 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:08.060328 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb345b06-b5b8-4065-b746-7ac6c532dc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:08.060634 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb345b06-b5b8-4065-b746-7ac6c532dc51 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:08.068643 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb345b06-b5b8-4065-b746-7ac6c532dc51 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:08.070358 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb345b06-b5b8-4065-b746-7ac6c532dc51 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:08.084541 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 178/349] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:55:08 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:55:08.084687 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5a8f7-2e1d-4809-9e5c-849443d7b192 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:08.094400 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5a8f7-2e1d-4809-9e5c-849443d7b192 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:08.098758 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607cfb62-18f1-4a91-ba20-cc785d5af721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:08.099593 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cfb62-18f1-4a91-ba20-cc785d5af721 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:08.099870 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cfb62-18f1-4a91-ba20-cc785d5af721 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:08.100143 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cfb62-18f1-4a91-ba20-cc785d5af721 admin admin] PATH_INFO: `/v3/projects/c34432677fed4984bbce7291bad96cc8` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:08.101333 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607cfb62-18f1-4a91-ba20-cc785d5af721 admin admin] RBAC: Authorizing `identity:get_project(project_id=c34432677fed4984bbce7291bad96cc8)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:08.103229 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607cfb62-18f1-4a91-ba20-cc785d5af721 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:08.104863 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 172/350] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:55:08 2021] GET /identity/v3/projects/c34432677fed4984bbce7291bad96cc8 => generated 344 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:08.110784 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb345b06-b5b8-4065-b746-7ac6c532dc51 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:08.119650 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb345b06-b5b8-4065-b746-7ac6c532dc51 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:08.123920 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31708e-df04-49ef-ba6c-094c25125ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:08.124778 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31708e-df04-49ef-ba6c-094c25125ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:08.125052 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31708e-df04-49ef-ba6c-094c25125ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:08.125319 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31708e-df04-49ef-ba6c-094c25125ef5 admin admin] PATH_INFO: `/v3/groups/e1cd28ffb32e4b59a6a6dbefac0eb200` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:08.126453 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31708e-df04-49ef-ba6c-094c25125ef5 admin admin] RBAC: Authorizing `identity:get_group(group_id=e1cd28ffb32e4b59a6a6dbefac0eb200)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:08.128308 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31708e-df04-49ef-ba6c-094c25125ef5 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:08.130008 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 179/351] 10.222.0.23 () {56 vars in 1202 bytes} [Thu Sep 23 02:55:08 2021] GET /identity/v3/groups/e1cd28ffb32e4b59a6a6dbefac0eb200 => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:08.135585 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607cfb62-18f1-4a91-ba20-cc785d5af721 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:08.145003 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607cfb62-18f1-4a91-ba20-cc785d5af721 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:08.149277 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed40d8a-c617-4acc-b568-da72ff10f830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:08.149889 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed40d8a-c617-4acc-b568-da72ff10f830 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:08.150170 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed40d8a-c617-4acc-b568-da72ff10f830 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:08.150442 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed40d8a-c617-4acc-b568-da72ff10f830 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:08.151243 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed40d8a-c617-4acc-b568-da72ff10f830 admin admin] RBAC: Adding query filter params (group.id=e1cd28ffb32e4b59a6a6dbefac0eb200, role.id=3e7d7427203a4a4097e2c9a642b9bf69, scope.project.id=c34432677fed4984bbce7291bad96cc8) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:08.151548 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed40d8a-c617-4acc-b568-da72ff10f830 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:08.153356 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed40d8a-c617-4acc-b568-da72ff10f830 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:08.159277 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 173/352] 10.222.0.23 () {56 vars in 1398 bytes} [Thu Sep 23 02:55:08 2021] GET /identity/v3/role_assignments?group.id=e1cd28ffb32e4b59a6a6dbefac0eb200&scope.project.id=c34432677fed4984bbce7291bad96cc8&role.id=3e7d7427203a4a4097e2c9a642b9bf69 => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:10.881327 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb54736-2a07-4882-bb22-f85428643942 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:10.881856 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb54736-2a07-4882-bb22-f85428643942 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:10.881856 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb54736-2a07-4882-bb22-f85428643942 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:10.883813 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 180/353] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:10.892020 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a40348-17b1-408f-ba01-63466dbc427f None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:10.892477 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a40348-17b1-408f-ba01-63466dbc427f None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:10.892617 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a40348-17b1-408f-ba01-63466dbc427f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:10.912049 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-d6a40348-17b1-408f-ba01-63466dbc427f None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:10.913264 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-d6a40348-17b1-408f-ba01-63466dbc427f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:10.921867 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 174/354] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:10.947283 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb54736-2a07-4882-bb22-f85428643942 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:10.960994 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb54736-2a07-4882-bb22-f85428643942 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:10.965419 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7ec6d-546b-4f12-b711-115dfc378dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:10.966212 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7ec6d-546b-4f12-b711-115dfc378dec admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:10.966496 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7ec6d-546b-4f12-b711-115dfc378dec admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:10.966764 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7ec6d-546b-4f12-b711-115dfc378dec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:10.977755 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7ec6d-546b-4f12-b711-115dfc378dec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:10.979603 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7ec6d-546b-4f12-b711-115dfc378dec admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:10.997530 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-f1e7ec6d-546b-4f12-b711-115dfc378dec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:10.999080 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 181/355] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:11.005474 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a40348-17b1-408f-ba01-63466dbc427f None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:11.014982 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a40348-17b1-408f-ba01-63466dbc427f None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:11.019780 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a58e30-7071-4b8b-8996-82d12df09836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:11.020447 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a58e30-7071-4b8b-8996-82d12df09836 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:11.020766 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a58e30-7071-4b8b-8996-82d12df09836 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:11.021041 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a58e30-7071-4b8b-8996-82d12df09836 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:11.021764 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a58e30-7071-4b8b-8996-82d12df09836 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:11.022072 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a58e30-7071-4b8b-8996-82d12df09836 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:11.023080 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING py.warnings [None req-63a58e30-7071-4b8b-8996-82d12df09836 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:55:11.023080 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: warnings.warn(msg) Sep 23 02:55:11.023080 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: Sep 23 02:55:11.024007 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a58e30-7071-4b8b-8996-82d12df09836 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:11.048006 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 175/356] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:11.054363 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7ec6d-546b-4f12-b711-115dfc378dec admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:11.075103 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7ec6d-546b-4f12-b711-115dfc378dec admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:11.113230 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cd47e-429b-40d4-8215-76a02dc03cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:11.113929 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cd47e-429b-40d4-8215-76a02dc03cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:11.114211 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cd47e-429b-40d4-8215-76a02dc03cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:11.114485 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cd47e-429b-40d4-8215-76a02dc03cb8 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:11.115214 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291cd47e-429b-40d4-8215-76a02dc03cb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:11.120585 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291cd47e-429b-40d4-8215-76a02dc03cb8 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:11.211168 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da917069-6ac8-41bb-bf78-7dbb98a8409f None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:11.211499 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da917069-6ac8-41bb-bf78-7dbb98a8409f None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:11.213719 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da917069-6ac8-41bb-bf78-7dbb98a8409f None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:11.213719 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 176/357] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:11.227419 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc51b95-6915-4001-9a76-bdff7d9515a0 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:11.227709 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc51b95-6915-4001-9a76-bdff7d9515a0 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:11.228752 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc51b95-6915-4001-9a76-bdff7d9515a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:11.231627 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 182/358] 10.222.0.23 () {60 vars in 1154 bytes} [Thu Sep 23 02:55:11 2021] POST /identity/v3/users => generated 246 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 02:55:11.260185 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-8dc51b95-6915-4001-9a76-bdff7d9515a0 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:11.262251 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-8dc51b95-6915-4001-9a76-bdff7d9515a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:11.278595 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 177/359] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:11.319646 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cd47e-429b-40d4-8215-76a02dc03cb8 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:11.331439 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cd47e-429b-40d4-8215-76a02dc03cb8 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:11.338943 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d5595-7766-47a0-9116-3c556b7302bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:11.339755 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d5595-7766-47a0-9116-3c556b7302bf admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:11.340035 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d5595-7766-47a0-9116-3c556b7302bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:11.340308 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d5595-7766-47a0-9116-3c556b7302bf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:11.353172 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d5595-7766-47a0-9116-3c556b7302bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:11.355102 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d5595-7766-47a0-9116-3c556b7302bf admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:11.376514 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-567d5595-7766-47a0-9116-3c556b7302bf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:11.376514 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 183/360] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:11.385850 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc51b95-6915-4001-9a76-bdff7d9515a0 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:11.397313 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc51b95-6915-4001-9a76-bdff7d9515a0 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:11.408528 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3052b-cbc9-4c19-9ed1-fad861a72e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:11.408528 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3052b-cbc9-4c19-9ed1-fad861a72e29 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:11.408528 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3052b-cbc9-4c19-9ed1-fad861a72e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:11.408528 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3052b-cbc9-4c19-9ed1-fad861a72e29 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:11.408919 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3052b-cbc9-4c19-9ed1-fad861a72e29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:11.408919 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3052b-cbc9-4c19-9ed1-fad861a72e29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:11.408919 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3052b-cbc9-4c19-9ed1-fad861a72e29 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:11.421454 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 178/361] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:11.428525 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d5595-7766-47a0-9116-3c556b7302bf admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:11.440531 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d5595-7766-47a0-9116-3c556b7302bf admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:11.448522 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a55487-96fc-4165-9d5e-47a8995734ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:11.448522 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a55487-96fc-4165-9d5e-47a8995734ae admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:11.448522 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a55487-96fc-4165-9d5e-47a8995734ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:11.448522 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a55487-96fc-4165-9d5e-47a8995734ae admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:11.448913 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a55487-96fc-4165-9d5e-47a8995734ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:11.450770 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a55487-96fc-4165-9d5e-47a8995734ae admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:11.530453 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 184/362] 10.222.0.23 () {60 vars in 1154 bytes} [Thu Sep 23 02:55:11 2021] POST /identity/v3/users => generated 248 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 02:55:11.822517 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804b3f4-b304-4933-85a7-4910947d333f None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:11.822971 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804b3f4-b304-4933-85a7-4910947d333f None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:11.823395 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804b3f4-b304-4933-85a7-4910947d333f None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:11.825364 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 179/363] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:11.833697 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639b6fb-9ee3-439a-b9df-2c632239cc90 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:11.834241 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639b6fb-9ee3-439a-b9df-2c632239cc90 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:11.834729 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639b6fb-9ee3-439a-b9df-2c632239cc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:11.853515 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-c639b6fb-9ee3-439a-b9df-2c632239cc90 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:11.855016 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-c639b6fb-9ee3-439a-b9df-2c632239cc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:11.863071 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 185/364] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:11.868622 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a515ab-5ac6-4f03-99a0-1e57a5f2badb None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:11.869172 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a515ab-5ac6-4f03-99a0-1e57a5f2badb None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:11.869629 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a515ab-5ac6-4f03-99a0-1e57a5f2badb None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:11.871803 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 180/365] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:11.880524 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bbf2c-c2b4-4d4f-8cd8-ece2abf19080 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:11.881097 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bbf2c-c2b4-4d4f-8cd8-ece2abf19080 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:11.881584 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bbf2c-c2b4-4d4f-8cd8-ece2abf19080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:11.890922 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a515ab-5ac6-4f03-99a0-1e57a5f2badb None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:11.903788 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-110bbf2c-c2b4-4d4f-8cd8-ece2abf19080 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:11.906724 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-110bbf2c-c2b4-4d4f-8cd8-ece2abf19080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:11.909551 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a515ab-5ac6-4f03-99a0-1e57a5f2badb None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:11.916359 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d79bc-2ef3-4359-afe6-e875cb246912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:11.916837 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 186/366] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:11.917507 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d79bc-2ef3-4359-afe6-e875cb246912 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:11.917865 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d79bc-2ef3-4359-afe6-e875cb246912 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:11.918215 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d79bc-2ef3-4359-afe6-e875cb246912 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:11.931768 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d79bc-2ef3-4359-afe6-e875cb246912 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:11.933692 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d79bc-2ef3-4359-afe6-e875cb246912 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:11.950480 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-590d79bc-2ef3-4359-afe6-e875cb246912 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:11.951860 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 181/367] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:11.957495 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bbf2c-c2b4-4d4f-8cd8-ece2abf19080 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:11.958357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d79bc-2ef3-4359-afe6-e875cb246912 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:11.975142 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d79bc-2ef3-4359-afe6-e875cb246912 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:11.975324 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bbf2c-c2b4-4d4f-8cd8-ece2abf19080 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:11.986709 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3b69e-e7d2-406a-be84-42b0d93483b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:11.997357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3b69e-e7d2-406a-be84-42b0d93483b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:11.997357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3b69e-e7d2-406a-be84-42b0d93483b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:11.997357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3b69e-e7d2-406a-be84-42b0d93483b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:11.997357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3b69e-e7d2-406a-be84-42b0d93483b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:11.997357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3b69e-e7d2-406a-be84-42b0d93483b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:11.997357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3b69e-e7d2-406a-be84-42b0d93483b1 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:11.997820 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e4ea2-a761-4cb8-ade9-cbf8bd6cc06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:11.997820 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e4ea2-a761-4cb8-ade9-cbf8bd6cc06b admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:11.997820 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e4ea2-a761-4cb8-ade9-cbf8bd6cc06b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:11.997820 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e4ea2-a761-4cb8-ade9-cbf8bd6cc06b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:12.017597 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 182/368] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:12.023442 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e4ea2-a761-4cb8-ade9-cbf8bd6cc06b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:12.025351 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e4ea2-a761-4cb8-ade9-cbf8bd6cc06b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:12.026790 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3b69e-e7d2-406a-be84-42b0d93483b1 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:12.040930 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3b69e-e7d2-406a-be84-42b0d93483b1 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:12.045554 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cb0a5-9d80-4627-ab56-b88cbcba9cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:12.049126 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cb0a5-9d80-4627-ab56-b88cbcba9cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:12.049126 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cb0a5-9d80-4627-ab56-b88cbcba9cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:12.049126 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cb0a5-9d80-4627-ab56-b88cbcba9cb5 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:12.049126 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3cb0a5-9d80-4627-ab56-b88cbcba9cb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:12.049673 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3cb0a5-9d80-4627-ab56-b88cbcba9cb5 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:12.059832 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-8e2e4ea2-a761-4cb8-ade9-cbf8bd6cc06b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:12.063742 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 187/369] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:12.070565 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e4ea2-a761-4cb8-ade9-cbf8bd6cc06b admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:12.080297 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e4ea2-a761-4cb8-ade9-cbf8bd6cc06b admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:12.085436 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405eddb-fff4-45f9-a464-241b447209d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:12.086418 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405eddb-fff4-45f9-a464-241b447209d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:12.086872 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405eddb-fff4-45f9-a464-241b447209d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:12.087348 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405eddb-fff4-45f9-a464-241b447209d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:12.088261 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405eddb-fff4-45f9-a464-241b447209d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:12.088789 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405eddb-fff4-45f9-a464-241b447209d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:12.090594 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405eddb-fff4-45f9-a464-241b447209d6 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:12.112401 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 188/370] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:12.113219 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405eddb-fff4-45f9-a464-241b447209d6 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:12.122773 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405eddb-fff4-45f9-a464-241b447209d6 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:12.127306 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310f802-b1f3-4ded-a809-1201e9090221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:12.128004 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310f802-b1f3-4ded-a809-1201e9090221 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:12.128283 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310f802-b1f3-4ded-a809-1201e9090221 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:12.128761 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310f802-b1f3-4ded-a809-1201e9090221 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:12.129462 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310f802-b1f3-4ded-a809-1201e9090221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:12.131367 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310f802-b1f3-4ded-a809-1201e9090221 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:12.218756 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 183/371] 10.222.0.23 () {60 vars in 1154 bytes} [Thu Sep 23 02:55:12 2021] POST /identity/v3/users => generated 249 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 02:55:12.259707 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 189/372] 10.222.0.23 () {60 vars in 1154 bytes} [Thu Sep 23 02:55:12 2021] POST /identity/v3/users => generated 248 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 02:55:12.708804 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340fea9-b052-42db-9a95-2224a17bb32f None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:12.709182 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340fea9-b052-42db-9a95-2224a17bb32f None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:12.709391 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340fea9-b052-42db-9a95-2224a17bb32f None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:12.711399 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 184/373] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:12.718998 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74973fe1-a652-4397-967a-fa5adbdc62e5 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:12.719287 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74973fe1-a652-4397-967a-fa5adbdc62e5 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:12.719570 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74973fe1-a652-4397-967a-fa5adbdc62e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:12.745487 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-74973fe1-a652-4397-967a-fa5adbdc62e5 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:12.746692 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-74973fe1-a652-4397-967a-fa5adbdc62e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:12.755485 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 190/374] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:12.779657 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340fea9-b052-42db-9a95-2224a17bb32f None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:12.797652 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340fea9-b052-42db-9a95-2224a17bb32f None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:12.802234 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96e357-de78-4cf1-a1a6-c6b9a4339fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:12.802908 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96e357-de78-4cf1-a1a6-c6b9a4339fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:12.803192 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96e357-de78-4cf1-a1a6-c6b9a4339fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:12.803470 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96e357-de78-4cf1-a1a6-c6b9a4339fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:12.804287 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96e357-de78-4cf1-a1a6-c6b9a4339fc1 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:12.805950 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96e357-de78-4cf1-a1a6-c6b9a4339fc1 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:12.844700 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.sql.core [None req-3c96e357-de78-4cf1-a1a6-c6b9a4339fc1 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 23 02:55:12.844700 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 23 02:55:12.844700 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [parameters: {'id': '16056293505448dea8e0b21855857599', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 23 02:55:12.844700 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73781) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 23 02:55:12.858885 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-3c96e357-de78-4cf1-a1a6-c6b9a4339fc1 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 23 02:55:12.865661 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 185/375] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 02:55:12 2021] POST /identity/v3/roles => generated 144 bytes in 86 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:12.871858 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74973fe1-a652-4397-967a-fa5adbdc62e5 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:12.885843 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74973fe1-a652-4397-967a-fa5adbdc62e5 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:12.891802 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5feff36-45cd-4e7f-a3ac-806d406c0923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:12.892688 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5feff36-45cd-4e7f-a3ac-806d406c0923 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:12.892971 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5feff36-45cd-4e7f-a3ac-806d406c0923 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:12.893242 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5feff36-45cd-4e7f-a3ac-806d406c0923 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:12.907677 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5feff36-45cd-4e7f-a3ac-806d406c0923 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:12.915278 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-e5feff36-45cd-4e7f-a3ac-806d406c0923 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 02:55:12.916638 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 191/376] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Sep 23 02:55:12 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:12.923425 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96e357-de78-4cf1-a1a6-c6b9a4339fc1 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:12.935985 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96e357-de78-4cf1-a1a6-c6b9a4339fc1 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:12.945313 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16e092-c475-46f3-85f1-a069538bbc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:12.946543 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16e092-c475-46f3-85f1-a069538bbc30 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:12.947039 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16e092-c475-46f3-85f1-a069538bbc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:12.947512 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16e092-c475-46f3-85f1-a069538bbc30 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:12.948989 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16e092-c475-46f3-85f1-a069538bbc30 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:12.949331 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16e092-c475-46f3-85f1-a069538bbc30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:12.951192 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16e092-c475-46f3-85f1-a069538bbc30 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:12.969983 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 186/377] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:12 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:14.177649 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02817c9a-23b4-4332-bf72-413c82a22fe8 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:14.178306 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02817c9a-23b4-4332-bf72-413c82a22fe8 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:14.178306 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02817c9a-23b4-4332-bf72-413c82a22fe8 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:14.180112 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 192/378] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:14.188013 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ae5d0-af1f-4d33-a8d6-62554f2b48da None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:14.188912 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ae5d0-af1f-4d33-a8d6-62554f2b48da None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:14.189413 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ae5d0-af1f-4d33-a8d6-62554f2b48da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:14.209178 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-b51ae5d0-af1f-4d33-a8d6-62554f2b48da None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:14.210718 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-b51ae5d0-af1f-4d33-a8d6-62554f2b48da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:14.219545 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 187/379] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:14.243651 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02817c9a-23b4-4332-bf72-413c82a22fe8 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:14.260912 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02817c9a-23b4-4332-bf72-413c82a22fe8 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:14.268429 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17894c5-3488-4dec-922b-2ce135dde43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:14.269268 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17894c5-3488-4dec-922b-2ce135dde43f admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:14.269552 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17894c5-3488-4dec-922b-2ce135dde43f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:14.270000 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17894c5-3488-4dec-922b-2ce135dde43f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:14.282969 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17894c5-3488-4dec-922b-2ce135dde43f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:14.295229 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-a17894c5-3488-4dec-922b-2ce135dde43f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 02:55:14.297379 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 193/380] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 23 02:55:14 2021] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:14.305585 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ae5d0-af1f-4d33-a8d6-62554f2b48da None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:14.321584 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ae5d0-af1f-4d33-a8d6-62554f2b48da None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:14.332789 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffc866-9a62-48f5-ba0d-40076c63e92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:14.333657 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffc866-9a62-48f5-ba0d-40076c63e92b admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:14.334083 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffc866-9a62-48f5-ba0d-40076c63e92b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:14.334527 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffc866-9a62-48f5-ba0d-40076c63e92b admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:14.335420 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ffc866-9a62-48f5-ba0d-40076c63e92b admin admin] RBAC: Adding query filter params (name=service) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:14.335870 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ffc866-9a62-48f5-ba0d-40076c63e92b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:14.337648 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ffc866-9a62-48f5-ba0d-40076c63e92b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:14.351887 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 188/381] 10.222.0.23 () {56 vars in 1125 bytes} [Thu Sep 23 02:55:14 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:14.358741 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17894c5-3488-4dec-922b-2ce135dde43f admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:14.373584 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17894c5-3488-4dec-922b-2ce135dde43f admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:14.378146 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ad5c2-a8f7-424f-b224-2ab1c74d2a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:14.378945 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ad5c2-a8f7-424f-b224-2ab1c74d2a10 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:14.379223 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ad5c2-a8f7-424f-b224-2ab1c74d2a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:14.379494 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ad5c2-a8f7-424f-b224-2ab1c74d2a10 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:14.392246 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ad5c2-a8f7-424f-b224-2ab1c74d2a10 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:14.394141 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ad5c2-a8f7-424f-b224-2ab1c74d2a10 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:14.410886 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-d42ad5c2-a8f7-424f-b224-2ab1c74d2a10 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:14.412510 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 194/382] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:14.418516 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffc866-9a62-48f5-ba0d-40076c63e92b admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:14.434034 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffc866-9a62-48f5-ba0d-40076c63e92b admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:14.444692 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ce976-2e9b-4de3-bf6e-da6af7cc07fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:14.445620 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ce976-2e9b-4de3-bf6e-da6af7cc07fc admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:14.446101 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ce976-2e9b-4de3-bf6e-da6af7cc07fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:14.446595 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ce976-2e9b-4de3-bf6e-da6af7cc07fc admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:14.447515 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ce976-2e9b-4de3-bf6e-da6af7cc07fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:14.448018 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ce976-2e9b-4de3-bf6e-da6af7cc07fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:14.449835 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ce976-2e9b-4de3-bf6e-da6af7cc07fc admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:14.470730 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 189/383] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:14.478044 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ad5c2-a8f7-424f-b224-2ab1c74d2a10 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:14.488606 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ad5c2-a8f7-424f-b224-2ab1c74d2a10 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:14.500905 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98e732-8c68-4c84-9684-e68a66bfdf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:14.501721 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98e732-8c68-4c84-9684-e68a66bfdf54 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:14.502000 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98e732-8c68-4c84-9684-e68a66bfdf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:14.502271 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98e732-8c68-4c84-9684-e68a66bfdf54 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:14.516237 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98e732-8c68-4c84-9684-e68a66bfdf54 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:14.518339 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98e732-8c68-4c84-9684-e68a66bfdf54 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:14.533061 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-0b98e732-8c68-4c84-9684-e68a66bfdf54 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 02:55:14.534645 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 195/384] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Sep 23 02:55:14 2021] GET /identity/v3/users/nova => generated 82 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:14.540915 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ce976-2e9b-4de3-bf6e-da6af7cc07fc admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:14.556735 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ce976-2e9b-4de3-bf6e-da6af7cc07fc admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:14.562226 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425e6d5-8331-412e-8251-6625279cf1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:14.563155 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425e6d5-8331-412e-8251-6625279cf1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:14.563647 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425e6d5-8331-412e-8251-6625279cf1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:14.564131 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425e6d5-8331-412e-8251-6625279cf1a7 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:14.565201 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425e6d5-8331-412e-8251-6625279cf1a7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:14.565714 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425e6d5-8331-412e-8251-6625279cf1a7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:14.572511 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING py.warnings [None req-7425e6d5-8331-412e-8251-6625279cf1a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:55:14.572511 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: warnings.warn(msg) Sep 23 02:55:14.572511 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: Sep 23 02:55:14.574047 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425e6d5-8331-412e-8251-6625279cf1a7 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:14.628074 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d24ac-8fd4-4ac7-aa81-6328c627f06a None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:14.628428 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d24ac-8fd4-4ac7-aa81-6328c627f06a None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:14.628670 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d24ac-8fd4-4ac7-aa81-6328c627f06a None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:14.631117 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 196/385] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 02:55:14.639858 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 190/386] 10.222.0.23 () {56 vars in 1155 bytes} [Thu Sep 23 02:55:14 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:14.641274 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae9aef-03e9-4152-ba08-aeef6f96e62f None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:14.641560 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae9aef-03e9-4152-ba08-aeef6f96e62f None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:14.641836 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae9aef-03e9-4152-ba08-aeef6f96e62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:14.646600 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425e6d5-8331-412e-8251-6625279cf1a7 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:14.656546 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425e6d5-8331-412e-8251-6625279cf1a7 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:14.667312 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61060405-6870-4d3d-ac83-7395540f9458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:14.667970 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61060405-6870-4d3d-ac83-7395540f9458 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:14.668250 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61060405-6870-4d3d-ac83-7395540f9458 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:14.668547 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61060405-6870-4d3d-ac83-7395540f9458 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:14.669975 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-03ae9aef-03e9-4152-ba08-aeef6f96e62f None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:14.671708 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-03ae9aef-03e9-4152-ba08-aeef6f96e62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:14.682801 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61060405-6870-4d3d-ac83-7395540f9458 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:14.684640 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61060405-6870-4d3d-ac83-7395540f9458 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:14.693157 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 197/387] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:14.699151 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 191/388] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:55:14 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 02:55:14.705458 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae9aef-03e9-4152-ba08-aeef6f96e62f None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:14.715516 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae9aef-03e9-4152-ba08-aeef6f96e62f None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:14.718472 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61060405-6870-4d3d-ac83-7395540f9458 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:14.726972 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f27e06-10b5-46f1-971a-2337701b75d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:14.727801 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f27e06-10b5-46f1-971a-2337701b75d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:14.728095 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f27e06-10b5-46f1-971a-2337701b75d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:14.728351 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f27e06-10b5-46f1-971a-2337701b75d3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:14.728732 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61060405-6870-4d3d-ac83-7395540f9458 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:14.734321 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d336ff-e7e7-4369-88eb-b07390c8cb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:14.735279 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d336ff-e7e7-4369-88eb-b07390c8cb38 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:14.735600 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d336ff-e7e7-4369-88eb-b07390c8cb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:14.735882 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d336ff-e7e7-4369-88eb-b07390c8cb38 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:14.754533 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f27e06-10b5-46f1-971a-2337701b75d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:14.756397 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f27e06-10b5-46f1-971a-2337701b75d3 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:14.759985 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d336ff-e7e7-4369-88eb-b07390c8cb38 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:14.773799 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-f8d336ff-e7e7-4369-88eb-b07390c8cb38 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 02:55:14.775027 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 192/389] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 23 02:55:14 2021] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:14.789281 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-90f27e06-10b5-46f1-971a-2337701b75d3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:14.790556 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 198/390] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:14.793167 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d336ff-e7e7-4369-88eb-b07390c8cb38 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:14.799720 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f27e06-10b5-46f1-971a-2337701b75d3 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:14.807164 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d336ff-e7e7-4369-88eb-b07390c8cb38 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:14.821269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f27e06-10b5-46f1-971a-2337701b75d3 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:14.821941 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030b41b-4b7d-478b-94b4-4da249b9c650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:14.822827 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030b41b-4b7d-478b-94b4-4da249b9c650 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:14.823256 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030b41b-4b7d-478b-94b4-4da249b9c650 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:14.823682 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030b41b-4b7d-478b-94b4-4da249b9c650 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:14.824614 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030b41b-4b7d-478b-94b4-4da249b9c650 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:14.825081 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030b41b-4b7d-478b-94b4-4da249b9c650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:14.826143 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990dd7e6-ea9a-440e-8a48-a30d8f4d2bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:14.827041 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990dd7e6-ea9a-440e-8a48-a30d8f4d2bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:14.827288 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030b41b-4b7d-478b-94b4-4da249b9c650 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:14.827408 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990dd7e6-ea9a-440e-8a48-a30d8f4d2bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:14.827620 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990dd7e6-ea9a-440e-8a48-a30d8f4d2bc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:14.828422 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990dd7e6-ea9a-440e-8a48-a30d8f4d2bc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:14.828760 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990dd7e6-ea9a-440e-8a48-a30d8f4d2bc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:14.830780 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990dd7e6-ea9a-440e-8a48-a30d8f4d2bc0 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:14.839092 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 193/391] 10.222.0.23 () {56 vars in 1125 bytes} [Thu Sep 23 02:55:14 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:14.841268 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4b4db-248b-4dff-aef0-98e0f6702f58 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:14.841699 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4b4db-248b-4dff-aef0-98e0f6702f58 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:14.842120 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4b4db-248b-4dff-aef0-98e0f6702f58 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:14.844578 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 194/392] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:14 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:14.852270 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4b4db-248b-4dff-aef0-98e0f6702f58 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:14.852775 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 199/393] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:14.857003 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a272f-d4f1-4174-859d-afb6545aedec None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:14.857003 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a272f-d4f1-4174-859d-afb6545aedec None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:14.857003 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a272f-d4f1-4174-859d-afb6545aedec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:14.869858 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4b4db-248b-4dff-aef0-98e0f6702f58 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:14.873026 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-da8a272f-d4f1-4174-859d-afb6545aedec None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:14.874731 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-da8a272f-d4f1-4174-859d-afb6545aedec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:14.875188 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c05b0-958d-45a0-84af-9872d2a22de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:14.876131 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c05b0-958d-45a0-84af-9872d2a22de0 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:14.876529 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c05b0-958d-45a0-84af-9872d2a22de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:14.876987 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c05b0-958d-45a0-84af-9872d2a22de0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:14.882699 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 200/394] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:14.883273 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a272f-d4f1-4174-859d-afb6545aedec None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:14.889066 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c05b0-958d-45a0-84af-9872d2a22de0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:14.891123 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c05b0-958d-45a0-84af-9872d2a22de0 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:14.892706 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a272f-d4f1-4174-859d-afb6545aedec None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:14.897416 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbb340-d2c2-414e-ab88-e060ae6feb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:14.898210 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbb340-d2c2-414e-ab88-e060ae6feb59 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:14.898664 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbb340-d2c2-414e-ab88-e060ae6feb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:14.898943 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbb340-d2c2-414e-ab88-e060ae6feb59 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:14.907269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbb340-d2c2-414e-ab88-e060ae6feb59 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:14.909306 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbb340-d2c2-414e-ab88-e060ae6feb59 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:14.910999 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-e97c05b0-958d-45a0-84af-9872d2a22de0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:14.912606 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 195/395] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:14.917922 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf22fd-5e3c-416d-a3b0-ad8bb2da869d None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:14.918214 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf22fd-5e3c-416d-a3b0-ad8bb2da869d None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:14.918504 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf22fd-5e3c-416d-a3b0-ad8bb2da869d None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:14.920338 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 196/396] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:14 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 02:55:14.921516 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf22fd-5e3c-416d-a3b0-ad8bb2da869d None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:14.928760 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-60cbb340-d2c2-414e-ab88-e060ae6feb59 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:14.930074 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 201/397] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:14.930723 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbb340-d2c2-414e-ab88-e060ae6feb59 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:14.941236 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbb340-d2c2-414e-ab88-e060ae6feb59 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:14.941906 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf22fd-5e3c-416d-a3b0-ad8bb2da869d None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:14.945574 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964df027-9ffd-4782-a242-2f369743dd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:14.946298 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964df027-9ffd-4782-a242-2f369743dd17 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:14.946583 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964df027-9ffd-4782-a242-2f369743dd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:14.946859 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964df027-9ffd-4782-a242-2f369743dd17 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:14.947420 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454b8df-5436-461d-97f7-5fd863327000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:14.948279 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454b8df-5436-461d-97f7-5fd863327000 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:14.948929 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454b8df-5436-461d-97f7-5fd863327000 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:14.949701 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454b8df-5436-461d-97f7-5fd863327000 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:14.950610 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454b8df-5436-461d-97f7-5fd863327000 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:14.951114 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454b8df-5436-461d-97f7-5fd863327000 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:14.953265 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454b8df-5436-461d-97f7-5fd863327000 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:14.956934 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964df027-9ffd-4782-a242-2f369743dd17 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:14.963679 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-964df027-9ffd-4782-a242-2f369743dd17 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 02:55:14.964864 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 202/398] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 23 02:55:14 2021] GET /identity/v3/roles/service => generated 85 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:14.966032 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc21fe-3083-4ea3-8b1f-16e520c78602 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:14.966235 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 197/399] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:14.966355 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc21fe-3083-4ea3-8b1f-16e520c78602 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:14.966579 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc21fe-3083-4ea3-8b1f-16e520c78602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:14.968023 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454b8df-5436-461d-97f7-5fd863327000 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:14.979769 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454b8df-5436-461d-97f7-5fd863327000 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:14.985200 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee82d2-9551-4c7e-8c5f-7b6209fc0a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:14.985852 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee82d2-9551-4c7e-8c5f-7b6209fc0a82 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:14.986133 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee82d2-9551-4c7e-8c5f-7b6209fc0a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:14.986411 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee82d2-9551-4c7e-8c5f-7b6209fc0a82 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:14.987191 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee82d2-9551-4c7e-8c5f-7b6209fc0a82 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:14.987499 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee82d2-9551-4c7e-8c5f-7b6209fc0a82 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:14.988508 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING py.warnings [None req-5eee82d2-9551-4c7e-8c5f-7b6209fc0a82 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:55:14.988508 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: warnings.warn(msg) Sep 23 02:55:14.988508 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: Sep 23 02:55:14.989670 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee82d2-9551-4c7e-8c5f-7b6209fc0a82 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:14.993140 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-affc21fe-3083-4ea3-8b1f-16e520c78602 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:14.994318 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-affc21fe-3083-4ea3-8b1f-16e520c78602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:15.002347 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 203/400] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:15.007237 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 198/401] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:15.012459 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee82d2-9551-4c7e-8c5f-7b6209fc0a82 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.012654 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc21fe-3083-4ea3-8b1f-16e520c78602 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.022754 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee82d2-9551-4c7e-8c5f-7b6209fc0a82 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.023633 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc21fe-3083-4ea3-8b1f-16e520c78602 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.027484 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57625825-5503-4a0c-833d-d92c18fb73ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.028316 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57625825-5503-4a0c-833d-d92c18fb73ce admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.028637 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57625825-5503-4a0c-833d-d92c18fb73ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.028916 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57625825-5503-4a0c-833d-d92c18fb73ce admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.029237 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c1b76-563a-4184-b1c9-a5d78e05771d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.030452 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c1b76-563a-4184-b1c9-a5d78e05771d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.030690 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c1b76-563a-4184-b1c9-a5d78e05771d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.030963 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c1b76-563a-4184-b1c9-a5d78e05771d admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.031726 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c1b76-563a-4184-b1c9-a5d78e05771d admin admin] RBAC: Adding query filter params (name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:15.032090 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c1b76-563a-4184-b1c9-a5d78e05771d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.033725 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c1b76-563a-4184-b1c9-a5d78e05771d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.038204 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57625825-5503-4a0c-833d-d92c18fb73ce admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.040237 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57625825-5503-4a0c-833d-d92c18fb73ce admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.042852 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 204/402] 10.222.0.23 () {56 vars in 1125 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:15.045490 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c1b76-563a-4184-b1c9-a5d78e05771d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.054342 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-57625825-5503-4a0c-833d-d92c18fb73ce admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 23 02:55:15.055597 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 199/403] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/users/glance => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:15.056244 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c1b76-563a-4184-b1c9-a5d78e05771d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.056351 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57625825-5503-4a0c-833d-d92c18fb73ce admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.065657 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f55137-6742-44e6-abf1-22c71b7dca15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.066302 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57625825-5503-4a0c-833d-d92c18fb73ce admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.066650 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f55137-6742-44e6-abf1-22c71b7dca15 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.067065 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f55137-6742-44e6-abf1-22c71b7dca15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.067560 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f55137-6742-44e6-abf1-22c71b7dca15 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.068587 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f55137-6742-44e6-abf1-22c71b7dca15 admin admin] RBAC: Adding query filter params (role.id=8e064794445b4039b2cf2d06b26b49de, scope.project.id=73dcb70ac3714a428a717707e6be8201, user.id=83aa47f723434143b22aac1b96b6a610) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:15.069036 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f55137-6742-44e6-abf1-22c71b7dca15 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.070693 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70501b03-c4f5-4ef7-9971-62d4adf61706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.071175 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f55137-6742-44e6-abf1-22c71b7dca15 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.071446 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70501b03-c4f5-4ef7-9971-62d4adf61706 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.071729 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70501b03-c4f5-4ef7-9971-62d4adf61706 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.072028 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70501b03-c4f5-4ef7-9971-62d4adf61706 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.078777 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 205/404] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/role_assignments?user.id=83aa47f723434143b22aac1b96b6a610&scope.project.id=73dcb70ac3714a428a717707e6be8201&role.id=8e064794445b4039b2cf2d06b26b49de => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:15.080461 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f55137-6742-44e6-abf1-22c71b7dca15 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.083661 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70501b03-c4f5-4ef7-9971-62d4adf61706 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:15.090822 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-70501b03-c4f5-4ef7-9971-62d4adf61706 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 02:55:15.092094 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 200/405] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:15.098533 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70501b03-c4f5-4ef7-9971-62d4adf61706 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.102836 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f55137-6742-44e6-abf1-22c71b7dca15 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.104222 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70501b03-c4f5-4ef7-9971-62d4adf61706 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.108003 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b3255-3e15-4bfc-98db-9b2674a9e2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.109282 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cd0d5-4370-4841-b9c5-783fde2854d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.109570 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b3255-3e15-4bfc-98db-9b2674a9e2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.109993 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b3255-3e15-4bfc-98db-9b2674a9e2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.114690 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cd0d5-4370-4841-b9c5-783fde2854d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.114829 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b3255-3e15-4bfc-98db-9b2674a9e2d4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.114945 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cd0d5-4370-4841-b9c5-783fde2854d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.114945 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cd0d5-4370-4841-b9c5-783fde2854d0 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.114945 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cd0d5-4370-4841-b9c5-783fde2854d0 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:15.114945 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cd0d5-4370-4841-b9c5-783fde2854d0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.114945 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cd0d5-4370-4841-b9c5-783fde2854d0 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.126141 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b3255-3e15-4bfc-98db-9b2674a9e2d4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.128298 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b3255-3e15-4bfc-98db-9b2674a9e2d4 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.135020 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 201/406] 10.222.0.23 () {56 vars in 1159 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:15.135988 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cd0d5-4370-4841-b9c5-783fde2854d0 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.147087 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cd0d5-4370-4841-b9c5-783fde2854d0 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.150366 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-ad4b3255-3e15-4bfc-98db-9b2674a9e2d4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:15.152069 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92803361-c238-4250-afd7-cfe9f6fef4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.152520 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 206/407] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:15.152947 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92803361-c238-4250-afd7-cfe9f6fef4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.153392 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92803361-c238-4250-afd7-cfe9f6fef4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.153747 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92803361-c238-4250-afd7-cfe9f6fef4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.153991 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b3255-3e15-4bfc-98db-9b2674a9e2d4 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.154652 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92803361-c238-4250-afd7-cfe9f6fef4c9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:15.155650 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92803361-c238-4250-afd7-cfe9f6fef4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.157471 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92803361-c238-4250-afd7-cfe9f6fef4c9 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.167079 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 202/408] 10.222.0.23 () {56 vars in 1125 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:15.172815 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92803361-c238-4250-afd7-cfe9f6fef4c9 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.173037 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b3255-3e15-4bfc-98db-9b2674a9e2d4 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.178961 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92803361-c238-4250-afd7-cfe9f6fef4c9 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.179561 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1c739-d930-4601-8521-8719cd7774d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.180990 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1c739-d930-4601-8521-8719cd7774d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.181414 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1c739-d930-4601-8521-8719cd7774d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.181830 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1c739-d930-4601-8521-8719cd7774d2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.184409 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6d14a-f56b-4d59-a4b5-481af1f28082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.185253 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6d14a-f56b-4d59-a4b5-481af1f28082 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.185608 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6d14a-f56b-4d59-a4b5-481af1f28082 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.186011 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6d14a-f56b-4d59-a4b5-481af1f28082 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.186880 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6d14a-f56b-4d59-a4b5-481af1f28082 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:15.187250 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6d14a-f56b-4d59-a4b5-481af1f28082 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.189088 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6d14a-f56b-4d59-a4b5-481af1f28082 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.197269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1c739-d930-4601-8521-8719cd7774d2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.197269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1c739-d930-4601-8521-8719cd7774d2 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.203351 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 203/409] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:15.204166 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6d14a-f56b-4d59-a4b5-481af1f28082 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.209166 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 207/410] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:55:15.210347 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1c739-d930-4601-8521-8719cd7774d2 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.214373 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6d14a-f56b-4d59-a4b5-481af1f28082 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.219606 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48566155-b37e-45c9-8945-e6a05738d22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.220633 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48566155-b37e-45c9-8945-e6a05738d22c admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.221259 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48566155-b37e-45c9-8945-e6a05738d22c admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.221637 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48566155-b37e-45c9-8945-e6a05738d22c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.222355 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1c739-d930-4601-8521-8719cd7774d2 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.228144 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18470b1-4bf4-4306-b66b-476e443020d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.229881 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18470b1-4bf4-4306-b66b-476e443020d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.230383 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18470b1-4bf4-4306-b66b-476e443020d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.230828 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18470b1-4bf4-4306-b66b-476e443020d3 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.234113 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48566155-b37e-45c9-8945-e6a05738d22c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.240729 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48566155-b37e-45c9-8945-e6a05738d22c admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.242922 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18470b1-4bf4-4306-b66b-476e443020d3 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.245848 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18470b1-4bf4-4306-b66b-476e443020d3 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.255501 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-48566155-b37e-45c9-8945-e6a05738d22c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:15.256972 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 204/411] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:15.260254 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48566155-b37e-45c9-8945-e6a05738d22c admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.269538 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-c18470b1-4bf4-4306-b66b-476e443020d3 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 02:55:15.271233 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 208/412] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/users/cinder => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:15.271881 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18470b1-4bf4-4306-b66b-476e443020d3 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.274443 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48566155-b37e-45c9-8945-e6a05738d22c admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.287592 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18470b1-4bf4-4306-b66b-476e443020d3 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.292740 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec37494-c557-43ac-8438-aaf2d3815682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.292740 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec37494-c557-43ac-8438-aaf2d3815682 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.292740 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec37494-c557-43ac-8438-aaf2d3815682 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.292740 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec37494-c557-43ac-8438-aaf2d3815682 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.299462 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe019b-7a00-48fa-bbd0-e4fa0e262331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.300158 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe019b-7a00-48fa-bbd0-e4fa0e262331 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.300438 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe019b-7a00-48fa-bbd0-e4fa0e262331 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.301205 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe019b-7a00-48fa-bbd0-e4fa0e262331 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.301939 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe019b-7a00-48fa-bbd0-e4fa0e262331 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:15.302250 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe019b-7a00-48fa-bbd0-e4fa0e262331 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.303891 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe019b-7a00-48fa-bbd0-e4fa0e262331 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.305394 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec37494-c557-43ac-8438-aaf2d3815682 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.307260 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec37494-c557-43ac-8438-aaf2d3815682 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.322280 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 209/413] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:15.323117 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe019b-7a00-48fa-bbd0-e4fa0e262331 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.328780 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-9ec37494-c557-43ac-8438-aaf2d3815682 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:15.330311 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 205/414] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:15.331092 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec37494-c557-43ac-8438-aaf2d3815682 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.339177 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe019b-7a00-48fa-bbd0-e4fa0e262331 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.344757 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec0de4-fcd9-4b02-9f25-bb46d9cb41ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.345709 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec0de4-fcd9-4b02-9f25-bb46d9cb41ed admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.345990 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec0de4-fcd9-4b02-9f25-bb46d9cb41ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.346267 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec0de4-fcd9-4b02-9f25-bb46d9cb41ed admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.347101 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec0de4-fcd9-4b02-9f25-bb46d9cb41ed admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:15.347406 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec0de4-fcd9-4b02-9f25-bb46d9cb41ed admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.347575 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec37494-c557-43ac-8438-aaf2d3815682 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.348410 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING py.warnings [None req-25ec0de4-fcd9-4b02-9f25-bb46d9cb41ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:55:15.348410 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: warnings.warn(msg) Sep 23 02:55:15.348410 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: Sep 23 02:55:15.349767 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec0de4-fcd9-4b02-9f25-bb46d9cb41ed admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.352558 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f95f9-0698-4419-aea4-92ff8bd100b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.353499 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f95f9-0698-4419-aea4-92ff8bd100b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.353889 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f95f9-0698-4419-aea4-92ff8bd100b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.354235 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f95f9-0698-4419-aea4-92ff8bd100b4 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.391792 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 210/415] 10.222.0.23 () {56 vars in 1159 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:15.392820 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec0de4-fcd9-4b02-9f25-bb46d9cb41ed admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.403573 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec0de4-fcd9-4b02-9f25-bb46d9cb41ed admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.408353 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05660d6-1fe9-4472-8dfd-d0fe287260b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.409093 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05660d6-1fe9-4472-8dfd-d0fe287260b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.409374 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05660d6-1fe9-4472-8dfd-d0fe287260b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.409646 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05660d6-1fe9-4472-8dfd-d0fe287260b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.410385 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05660d6-1fe9-4472-8dfd-d0fe287260b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:15.410692 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05660d6-1fe9-4472-8dfd-d0fe287260b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.412347 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05660d6-1fe9-4472-8dfd-d0fe287260b5 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.427811 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 211/416] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:15.428713 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05660d6-1fe9-4472-8dfd-d0fe287260b5 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.438953 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05660d6-1fe9-4472-8dfd-d0fe287260b5 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.443710 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d839cf6-1e3a-4f82-b0b1-b4797ebf7c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.444497 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d839cf6-1e3a-4f82-b0b1-b4797ebf7c78 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.444792 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d839cf6-1e3a-4f82-b0b1-b4797ebf7c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.445068 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d839cf6-1e3a-4f82-b0b1-b4797ebf7c78 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.454465 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d839cf6-1e3a-4f82-b0b1-b4797ebf7c78 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.456177 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d839cf6-1e3a-4f82-b0b1-b4797ebf7c78 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.466508 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 212/417] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:55:15.467379 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d839cf6-1e3a-4f82-b0b1-b4797ebf7c78 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.482748 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d839cf6-1e3a-4f82-b0b1-b4797ebf7c78 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.483973 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f95f9-0698-4419-aea4-92ff8bd100b4 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.486572 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f95f9-0698-4419-aea4-92ff8bd100b4 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.487949 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb8fbf-7bb7-44c5-8813-d4211efc0abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.488945 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb8fbf-7bb7-44c5-8813-d4211efc0abd admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.489253 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb8fbf-7bb7-44c5-8813-d4211efc0abd admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.490031 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb8fbf-7bb7-44c5-8813-d4211efc0abd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.497388 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb8fbf-7bb7-44c5-8813-d4211efc0abd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.499382 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb8fbf-7bb7-44c5-8813-d4211efc0abd admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.501269 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-105f95f9-0698-4419-aea4-92ff8bd100b4 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 23 02:55:15.502523 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 206/418] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:15.503379 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f95f9-0698-4419-aea4-92ff8bd100b4 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.515699 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f95f9-0698-4419-aea4-92ff8bd100b4 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.521427 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94572133-69d8-4af6-a0d7-1de1b4f5eca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.522320 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94572133-69d8-4af6-a0d7-1de1b4f5eca7 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.522602 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94572133-69d8-4af6-a0d7-1de1b4f5eca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.522878 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94572133-69d8-4af6-a0d7-1de1b4f5eca7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.524247 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-ebeb8fbf-7bb7-44c5-8813-d4211efc0abd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:15.526983 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 213/419] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:15.533822 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb8fbf-7bb7-44c5-8813-d4211efc0abd admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.535280 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94572133-69d8-4af6-a0d7-1de1b4f5eca7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.537302 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94572133-69d8-4af6-a0d7-1de1b4f5eca7 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.553401 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb8fbf-7bb7-44c5-8813-d4211efc0abd admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.557561 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-94572133-69d8-4af6-a0d7-1de1b4f5eca7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:15.558241 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4748499-901d-4637-aa51-8ca151f87407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.558766 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 207/420] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:15.559284 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4748499-901d-4637-aa51-8ca151f87407 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.559627 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4748499-901d-4637-aa51-8ca151f87407 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.559914 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4748499-901d-4637-aa51-8ca151f87407 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.560931 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4748499-901d-4637-aa51-8ca151f87407 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:15.561294 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4748499-901d-4637-aa51-8ca151f87407 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.563244 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4748499-901d-4637-aa51-8ca151f87407 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.564475 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94572133-69d8-4af6-a0d7-1de1b4f5eca7 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.576194 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94572133-69d8-4af6-a0d7-1de1b4f5eca7 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.582321 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 214/421] 10.222.0.23 () {56 vars in 1161 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:15.582535 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de592f22-65f0-4113-93f3-3168c07a4a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.583021 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4748499-901d-4637-aa51-8ca151f87407 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.583211 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de592f22-65f0-4113-93f3-3168c07a4a1d admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.584612 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de592f22-65f0-4113-93f3-3168c07a4a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.584932 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de592f22-65f0-4113-93f3-3168c07a4a1d admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.585784 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de592f22-65f0-4113-93f3-3168c07a4a1d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:15.586099 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de592f22-65f0-4113-93f3-3168c07a4a1d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.588124 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de592f22-65f0-4113-93f3-3168c07a4a1d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.597936 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4748499-901d-4637-aa51-8ca151f87407 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.602652 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3d305-4b0e-4f71-b90e-d42159f1bf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.603311 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3d305-4b0e-4f71-b90e-d42159f1bf32 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.603693 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3d305-4b0e-4f71-b90e-d42159f1bf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.604023 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3d305-4b0e-4f71-b90e-d42159f1bf32 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.604791 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3d305-4b0e-4f71-b90e-d42159f1bf32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:15.605100 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3d305-4b0e-4f71-b90e-d42159f1bf32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.606862 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3d305-4b0e-4f71-b90e-d42159f1bf32 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.607258 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 208/422] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:15.608142 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de592f22-65f0-4113-93f3-3168c07a4a1d admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.623592 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de592f22-65f0-4113-93f3-3168c07a4a1d admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.624089 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 215/423] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:15.624780 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3d305-4b0e-4f71-b90e-d42159f1bf32 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.633217 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438df428-c09a-4afe-b484-3193a02f3091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.634055 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438df428-c09a-4afe-b484-3193a02f3091 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.634345 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438df428-c09a-4afe-b484-3193a02f3091 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.634619 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438df428-c09a-4afe-b484-3193a02f3091 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.639117 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3d305-4b0e-4f71-b90e-d42159f1bf32 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.643883 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7d662-8fe7-4423-a636-972af7c9c716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.644440 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438df428-c09a-4afe-b484-3193a02f3091 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.644632 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7d662-8fe7-4423-a636-972af7c9c716 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.644880 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7d662-8fe7-4423-a636-972af7c9c716 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.645161 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7d662-8fe7-4423-a636-972af7c9c716 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.646101 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7d662-8fe7-4423-a636-972af7c9c716 admin admin] RBAC: Adding query filter params (role.id=8e064794445b4039b2cf2d06b26b49de, scope.project.id=73dcb70ac3714a428a717707e6be8201, user.id=83242c1ef12d4a5b800e67346f4ad963) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:15.646262 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438df428-c09a-4afe-b484-3193a02f3091 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.646456 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7d662-8fe7-4423-a636-972af7c9c716 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.648399 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7d662-8fe7-4423-a636-972af7c9c716 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.654328 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 216/424] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/role_assignments?user.id=83242c1ef12d4a5b800e67346f4ad963&scope.project.id=73dcb70ac3714a428a717707e6be8201&role.id=8e064794445b4039b2cf2d06b26b49de => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:15.655618 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7d662-8fe7-4423-a636-972af7c9c716 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.656787 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 209/425] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:55:15.662758 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438df428-c09a-4afe-b484-3193a02f3091 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.672789 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438df428-c09a-4afe-b484-3193a02f3091 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.678393 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7d662-8fe7-4423-a636-972af7c9c716 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.678591 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a55a4-a4ae-481b-bf20-f1f8d7c62699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.679255 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a55a4-a4ae-481b-bf20-f1f8d7c62699 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.679659 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a55a4-a4ae-481b-bf20-f1f8d7c62699 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.680188 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a55a4-a4ae-481b-bf20-f1f8d7c62699 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.691436 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e85730-edbc-43a4-a9a5-6e8c24a08442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.692256 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e85730-edbc-43a4-a9a5-6e8c24a08442 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.692565 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e85730-edbc-43a4-a9a5-6e8c24a08442 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.692839 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e85730-edbc-43a4-a9a5-6e8c24a08442 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.706666 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e85730-edbc-43a4-a9a5-6e8c24a08442 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.708766 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e85730-edbc-43a4-a9a5-6e8c24a08442 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.713498 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a55a4-a4ae-481b-bf20-f1f8d7c62699 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.715372 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a55a4-a4ae-481b-bf20-f1f8d7c62699 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.724520 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-d7e85730-edbc-43a4-a9a5-6e8c24a08442 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:15.726095 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 217/426] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:15.735329 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e85730-edbc-43a4-a9a5-6e8c24a08442 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.753185 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-d09a55a4-a4ae-481b-bf20-f1f8d7c62699 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:15.754609 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 210/427] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:15.761180 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e85730-edbc-43a4-a9a5-6e8c24a08442 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.765215 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a55a4-a4ae-481b-bf20-f1f8d7c62699 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.769473 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b6b1d-7f63-49d4-b356-dfe9094025fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.770162 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b6b1d-7f63-49d4-b356-dfe9094025fd admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.770447 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b6b1d-7f63-49d4-b356-dfe9094025fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.770726 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b6b1d-7f63-49d4-b356-dfe9094025fd admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.771593 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b6b1d-7f63-49d4-b356-dfe9094025fd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:15.771959 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b6b1d-7f63-49d4-b356-dfe9094025fd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.773054 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING py.warnings [None req-c85b6b1d-7f63-49d4-b356-dfe9094025fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:55:15.773054 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: warnings.warn(msg) Sep 23 02:55:15.773054 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: Sep 23 02:55:15.774263 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b6b1d-7f63-49d4-b356-dfe9094025fd admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.785242 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a55a4-a4ae-481b-bf20-f1f8d7c62699 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.796734 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac67b7d-01f1-4a3c-916f-d01d24a49ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.797432 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac67b7d-01f1-4a3c-916f-d01d24a49ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.798988 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac67b7d-01f1-4a3c-916f-d01d24a49ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.799271 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac67b7d-01f1-4a3c-916f-d01d24a49ae2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.800119 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac67b7d-01f1-4a3c-916f-d01d24a49ae2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:15.800438 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac67b7d-01f1-4a3c-916f-d01d24a49ae2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.805094 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac67b7d-01f1-4a3c-916f-d01d24a49ae2 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.827331 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 218/428] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:15.829585 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b6b1d-7f63-49d4-b356-dfe9094025fd admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.831808 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 211/429] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:15.846824 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac67b7d-01f1-4a3c-916f-d01d24a49ae2 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.847751 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b6b1d-7f63-49d4-b356-dfe9094025fd admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.856520 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039bb28-64d8-4794-97bb-659bfd93def2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.856520 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039bb28-64d8-4794-97bb-659bfd93def2 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.856520 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039bb28-64d8-4794-97bb-659bfd93def2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.856520 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039bb28-64d8-4794-97bb-659bfd93def2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.856914 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039bb28-64d8-4794-97bb-659bfd93def2 admin admin] RBAC: Adding query filter params (role.id=8e064794445b4039b2cf2d06b26b49de, scope.project.id=73dcb70ac3714a428a717707e6be8201, user.id=5a435fd22fdc4160888f942e634c0a08) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:15.856914 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039bb28-64d8-4794-97bb-659bfd93def2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.856914 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039bb28-64d8-4794-97bb-659bfd93def2 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.862960 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 219/430] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/role_assignments?user.id=5a435fd22fdc4160888f942e634c0a08&scope.project.id=73dcb70ac3714a428a717707e6be8201&role.id=8e064794445b4039b2cf2d06b26b49de => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:15.863737 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac67b7d-01f1-4a3c-916f-d01d24a49ae2 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.874734 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69056a81-ad41-4b7a-8d7c-ac31e684105c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.875569 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69056a81-ad41-4b7a-8d7c-ac31e684105c admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.875854 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69056a81-ad41-4b7a-8d7c-ac31e684105c admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.876127 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69056a81-ad41-4b7a-8d7c-ac31e684105c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.885754 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69056a81-ad41-4b7a-8d7c-ac31e684105c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.887818 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69056a81-ad41-4b7a-8d7c-ac31e684105c admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.903944 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-69056a81-ad41-4b7a-8d7c-ac31e684105c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:15.905635 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 212/431] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:15.912092 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039bb28-64d8-4794-97bb-659bfd93def2 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.923989 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039bb28-64d8-4794-97bb-659bfd93def2 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.930441 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e721c-5735-4476-9176-29410edc4657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.931555 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e721c-5735-4476-9176-29410edc4657 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.932101 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e721c-5735-4476-9176-29410edc4657 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.932636 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e721c-5735-4476-9176-29410edc4657 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.933742 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e721c-5735-4476-9176-29410edc4657 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:15.934299 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e721c-5735-4476-9176-29410edc4657 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.936603 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e721c-5735-4476-9176-29410edc4657 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:15.952911 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 220/432] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:15.959933 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69056a81-ad41-4b7a-8d7c-ac31e684105c admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:15.975226 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69056a81-ad41-4b7a-8d7c-ac31e684105c admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:15.994498 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a13e8-aab4-424e-b099-d5ee2de4d08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:15.995203 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a13e8-aab4-424e-b099-d5ee2de4d08d admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:15.995487 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a13e8-aab4-424e-b099-d5ee2de4d08d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:15.995765 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a13e8-aab4-424e-b099-d5ee2de4d08d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:15.996671 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a13e8-aab4-424e-b099-d5ee2de4d08d admin admin] RBAC: Adding query filter params (role.id=8e064794445b4039b2cf2d06b26b49de, scope.project.id=73dcb70ac3714a428a717707e6be8201, user.id=621e97bd0914448c8afadba25510053d) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:15.996990 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a13e8-aab4-424e-b099-d5ee2de4d08d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:15.998967 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a13e8-aab4-424e-b099-d5ee2de4d08d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:16.005753 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 213/433] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:55:15 2021] GET /identity/v3/role_assignments?user.id=621e97bd0914448c8afadba25510053d&scope.project.id=73dcb70ac3714a428a717707e6be8201&role.id=8e064794445b4039b2cf2d06b26b49de => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:16.069394 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca3d90-a141-4adc-a46b-c6c0e7649984 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:16.070019 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca3d90-a141-4adc-a46b-c6c0e7649984 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:16.070506 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca3d90-a141-4adc-a46b-c6c0e7649984 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:16.072944 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 221/434] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:16.082474 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27025614-c083-4146-b61e-3df8128618d3 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:16.082765 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27025614-c083-4146-b61e-3df8128618d3 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:16.083039 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27025614-c083-4146-b61e-3df8128618d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:16.109272 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-27025614-c083-4146-b61e-3df8128618d3 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:16.110487 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-27025614-c083-4146-b61e-3df8128618d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:16.118968 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 214/435] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:16.147269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca3d90-a141-4adc-a46b-c6c0e7649984 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:16.160122 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca3d90-a141-4adc-a46b-c6c0e7649984 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:16.168896 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbabbc-56e9-4bda-9e25-1a36045dcc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:16.169854 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbabbc-56e9-4bda-9e25-1a36045dcc74 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:16.170206 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbabbc-56e9-4bda-9e25-1a36045dcc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:16.171088 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbabbc-56e9-4bda-9e25-1a36045dcc74 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:16.187793 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbabbc-56e9-4bda-9e25-1a36045dcc74 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:16.189713 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbabbc-56e9-4bda-9e25-1a36045dcc74 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:16.211971 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-f9cbabbc-56e9-4bda-9e25-1a36045dcc74 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:16.213595 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 222/436] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:16.220718 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27025614-c083-4146-b61e-3df8128618d3 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:16.230868 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27025614-c083-4146-b61e-3df8128618d3 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:16.236622 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0396a-99bf-44e2-8a09-031afb76ddbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:16.237591 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0396a-99bf-44e2-8a09-031afb76ddbd admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:16.238080 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0396a-99bf-44e2-8a09-031afb76ddbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:16.238557 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0396a-99bf-44e2-8a09-031afb76ddbd admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:16.239479 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0396a-99bf-44e2-8a09-031afb76ddbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:16.240690 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0396a-99bf-44e2-8a09-031afb76ddbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:16.242780 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0396a-99bf-44e2-8a09-031afb76ddbd admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:16.255989 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 215/437] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:16.262459 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbabbc-56e9-4bda-9e25-1a36045dcc74 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:16.273082 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbabbc-56e9-4bda-9e25-1a36045dcc74 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:16.277869 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d86b4a-0850-4934-86fa-7a8239215330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:16.278856 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d86b4a-0850-4934-86fa-7a8239215330 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:16.279347 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d86b4a-0850-4934-86fa-7a8239215330 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:16.280837 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d86b4a-0850-4934-86fa-7a8239215330 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:16.281770 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d86b4a-0850-4934-86fa-7a8239215330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:16.284024 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d86b4a-0850-4934-86fa-7a8239215330 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:16.377721 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 223/438] 10.222.0.23 () {60 vars in 1154 bytes} [Thu Sep 23 02:55:16 2021] POST /identity/v3/users => generated 247 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 02:55:17.580664 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e0b18-88ea-42ee-8809-7ec116d370c4 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:17.581828 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e0b18-88ea-42ee-8809-7ec116d370c4 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:17.582332 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e0b18-88ea-42ee-8809-7ec116d370c4 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:17.584351 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 216/439] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:17 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:17.591713 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f287c6-99d6-4e01-be7c-015ddf976e63 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:17.592629 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f287c6-99d6-4e01-be7c-015ddf976e63 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:17.593127 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f287c6-99d6-4e01-be7c-015ddf976e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:17.615942 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-c1f287c6-99d6-4e01-be7c-015ddf976e63 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:17.617165 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-c1f287c6-99d6-4e01-be7c-015ddf976e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:17.628401 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 224/440] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:17.669990 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e0b18-88ea-42ee-8809-7ec116d370c4 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:17.687830 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e0b18-88ea-42ee-8809-7ec116d370c4 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:17.692749 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f55226-2731-4bd0-9fca-b2017e6cd488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:17.693798 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f55226-2731-4bd0-9fca-b2017e6cd488 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:17.694285 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f55226-2731-4bd0-9fca-b2017e6cd488 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:17.694761 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f55226-2731-4bd0-9fca-b2017e6cd488 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:17.710369 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f55226-2731-4bd0-9fca-b2017e6cd488 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:17.717581 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-d7f55226-2731-4bd0-9fca-b2017e6cd488 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 02:55:17.719361 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 217/441] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 23 02:55:17 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:17.725468 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f287c6-99d6-4e01-be7c-015ddf976e63 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:17.742846 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f287c6-99d6-4e01-be7c-015ddf976e63 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:17.753947 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f207bf-ecbc-474a-bbb3-281be401c8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:17.754628 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f207bf-ecbc-474a-bbb3-281be401c8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:17.754909 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f207bf-ecbc-474a-bbb3-281be401c8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:17.755180 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f207bf-ecbc-474a-bbb3-281be401c8a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:17.755936 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f207bf-ecbc-474a-bbb3-281be401c8a7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:17.756242 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f207bf-ecbc-474a-bbb3-281be401c8a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:17.757888 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f207bf-ecbc-474a-bbb3-281be401c8a7 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:17.772035 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 225/442] 10.222.0.23 () {56 vars in 1125 bytes} [Thu Sep 23 02:55:17 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:17.778093 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f55226-2731-4bd0-9fca-b2017e6cd488 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:17.789062 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f55226-2731-4bd0-9fca-b2017e6cd488 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:17.802161 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20829c-357b-4b71-be6f-203b2ee51267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:17.802969 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20829c-357b-4b71-be6f-203b2ee51267 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:17.803254 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20829c-357b-4b71-be6f-203b2ee51267 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:17.803534 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20829c-357b-4b71-be6f-203b2ee51267 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:17.820543 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20829c-357b-4b71-be6f-203b2ee51267 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:17.822159 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20829c-357b-4b71-be6f-203b2ee51267 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:17.851084 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-5a20829c-357b-4b71-be6f-203b2ee51267 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:17.852549 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 218/443] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:17.858617 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f207bf-ecbc-474a-bbb3-281be401c8a7 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:17.882599 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f207bf-ecbc-474a-bbb3-281be401c8a7 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:17.897130 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78695a63-2565-44b3-bbb0-58d18bbce5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:17.897805 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78695a63-2565-44b3-bbb0-58d18bbce5ee admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:17.898082 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78695a63-2565-44b3-bbb0-58d18bbce5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:17.898356 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78695a63-2565-44b3-bbb0-58d18bbce5ee admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:17.899078 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78695a63-2565-44b3-bbb0-58d18bbce5ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:17.899381 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78695a63-2565-44b3-bbb0-58d18bbce5ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:17.901015 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78695a63-2565-44b3-bbb0-58d18bbce5ee admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:17.918229 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 226/444] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:17.924316 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20829c-357b-4b71-be6f-203b2ee51267 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:17.937973 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20829c-357b-4b71-be6f-203b2ee51267 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:17.948634 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2daa930-501a-4695-b629-70eb42bfd830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:17.949437 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daa930-501a-4695-b629-70eb42bfd830 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:17.949723 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daa930-501a-4695-b629-70eb42bfd830 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:17.950004 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daa930-501a-4695-b629-70eb42bfd830 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:17.969779 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2daa930-501a-4695-b629-70eb42bfd830 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:17.971870 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2daa930-501a-4695-b629-70eb42bfd830 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:17.995811 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-d2daa930-501a-4695-b629-70eb42bfd830 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 02:55:17.997340 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 219/445] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Sep 23 02:55:17 2021] GET /identity/v3/users/nova => generated 82 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:18.003795 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78695a63-2565-44b3-bbb0-58d18bbce5ee admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:18.021466 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78695a63-2565-44b3-bbb0-58d18bbce5ee admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:18.031389 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa7641-99fe-4e80-b0eb-c2bd315c9a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:18.032037 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa7641-99fe-4e80-b0eb-c2bd315c9a53 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.032315 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa7641-99fe-4e80-b0eb-c2bd315c9a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.032627 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa7641-99fe-4e80-b0eb-c2bd315c9a53 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.033467 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa7641-99fe-4e80-b0eb-c2bd315c9a53 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:18.033773 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa7641-99fe-4e80-b0eb-c2bd315c9a53 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:18.035631 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa7641-99fe-4e80-b0eb-c2bd315c9a53 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:18.064683 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 227/446] 10.222.0.23 () {56 vars in 1155 bytes} [Thu Sep 23 02:55:18 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:18.070564 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2daa930-501a-4695-b629-70eb42bfd830 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:18.084704 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2daa930-501a-4695-b629-70eb42bfd830 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:18.093073 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd9d42-e6fa-4840-a64a-53893194d04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:18.093976 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd9d42-e6fa-4840-a64a-53893194d04e admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.094259 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd9d42-e6fa-4840-a64a-53893194d04e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.094531 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd9d42-e6fa-4840-a64a-53893194d04e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.116350 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd9d42-e6fa-4840-a64a-53893194d04e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:18.118151 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd9d42-e6fa-4840-a64a-53893194d04e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:18.147712 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-48bd9d42-e6fa-4840-a64a-53893194d04e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:18.149266 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 220/447] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:18.155289 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa7641-99fe-4e80-b0eb-c2bd315c9a53 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:18.175320 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa7641-99fe-4e80-b0eb-c2bd315c9a53 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:18.190445 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90910340-7dc3-4b5e-b05c-c11e21d66082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:18.191165 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90910340-7dc3-4b5e-b05c-c11e21d66082 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.191446 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90910340-7dc3-4b5e-b05c-c11e21d66082 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.191731 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90910340-7dc3-4b5e-b05c-c11e21d66082 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.192514 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90910340-7dc3-4b5e-b05c-c11e21d66082 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:18.192828 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90910340-7dc3-4b5e-b05c-c11e21d66082 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:18.194503 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90910340-7dc3-4b5e-b05c-c11e21d66082 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:18.218124 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 228/448] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:18.224083 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd9d42-e6fa-4840-a64a-53893194d04e admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:18.238011 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd9d42-e6fa-4840-a64a-53893194d04e admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:18.248871 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070a45f-2f92-4209-80f6-3d01999eb6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:18.249460 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070a45f-2f92-4209-80f6-3d01999eb6bf admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.249743 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070a45f-2f92-4209-80f6-3d01999eb6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.250018 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070a45f-2f92-4209-80f6-3d01999eb6bf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.265802 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070a45f-2f92-4209-80f6-3d01999eb6bf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:18.267747 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070a45f-2f92-4209-80f6-3d01999eb6bf admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:18.288875 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-e070a45f-2f92-4209-80f6-3d01999eb6bf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:18.289062 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeac656-b756-4b4c-8c57-56ff6dae1df5 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.289303 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeac656-b756-4b4c-8c57-56ff6dae1df5 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.289558 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeac656-b756-4b4c-8c57-56ff6dae1df5 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.290254 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 221/449] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:18.291557 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 229/450] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:18.297208 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070a45f-2f92-4209-80f6-3d01999eb6bf admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:18.309379 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070a45f-2f92-4209-80f6-3d01999eb6bf admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:18.316991 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b196725-7c76-4df3-b1ea-327c63e5432e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:18.317680 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b196725-7c76-4df3-b1ea-327c63e5432e admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.317956 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b196725-7c76-4df3-b1ea-327c63e5432e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.318229 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b196725-7c76-4df3-b1ea-327c63e5432e admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.319029 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b196725-7c76-4df3-b1ea-327c63e5432e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:18.319335 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b196725-7c76-4df3-b1ea-327c63e5432e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:18.321259 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b196725-7c76-4df3-b1ea-327c63e5432e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:18.327175 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e1ceb-3843-4ba0-95f7-572262b6ffea None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.327453 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e1ceb-3843-4ba0-95f7-572262b6ffea None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.327731 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e1ceb-3843-4ba0-95f7-572262b6ffea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.336579 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 222/451] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:18.342906 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b196725-7c76-4df3-b1ea-327c63e5432e admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:18.355238 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-db4e1ceb-3843-4ba0-95f7-572262b6ffea None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:18.357658 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b196725-7c76-4df3-b1ea-327c63e5432e admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:18.359718 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-db4e1ceb-3843-4ba0-95f7-572262b6ffea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:18.366766 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63bc1f-769e-43b9-9d8e-32e058eeb078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:18.368055 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63bc1f-769e-43b9-9d8e-32e058eeb078 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.368339 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63bc1f-769e-43b9-9d8e-32e058eeb078 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.368652 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63bc1f-769e-43b9-9d8e-32e058eeb078 admin admin] PATH_INFO: `/v3/projects/73dcb70ac3714a428a717707e6be8201/users/83aa47f723434143b22aac1b96b6a610/roles/8e064794445b4039b2cf2d06b26b49de` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.380607 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 230/452] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:18.398537 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d63bc1f-769e-43b9-9d8e-32e058eeb078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73dcb70ac3714a428a717707e6be8201, user_id=83aa47f723434143b22aac1b96b6a610, role_id=8e064794445b4039b2cf2d06b26b49de)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:18.401352 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d63bc1f-769e-43b9-9d8e-32e058eeb078 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:18.402372 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b2393-5d6c-4122-ad08-544817c488d1 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.402695 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b2393-5d6c-4122-ad08-544817c488d1 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.402979 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b2393-5d6c-4122-ad08-544817c488d1 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.405026 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 231/453] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 02:55:18.414228 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaea966-4d6d-49a7-aae5-24b59a484758 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.414571 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaea966-4d6d-49a7-aae5-24b59a484758 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.414857 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaea966-4d6d-49a7-aae5-24b59a484758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.433175 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-bcaea966-4d6d-49a7-aae5-24b59a484758 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:18.434357 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-bcaea966-4d6d-49a7-aae5-24b59a484758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:18.442789 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 232/454] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:18.443567 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaea966-4d6d-49a7-aae5-24b59a484758 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:18.454917 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaea966-4d6d-49a7-aae5-24b59a484758 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:18.459991 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc8a32-9e92-4a6e-a1a4-f3540f36ddb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:18.461149 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc8a32-9e92-4a6e-a1a4-f3540f36ddb6 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.461684 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc8a32-9e92-4a6e-a1a4-f3540f36ddb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.462176 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc8a32-9e92-4a6e-a1a4-f3540f36ddb6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.473888 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc8a32-9e92-4a6e-a1a4-f3540f36ddb6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:18.479662 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 223/455] 10.222.0.23 () {58 vars in 1461 bytes} [Thu Sep 23 02:55:18 2021] PUT /identity/v3/projects/73dcb70ac3714a428a717707e6be8201/users/83aa47f723434143b22aac1b96b6a610/roles/8e064794445b4039b2cf2d06b26b49de => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 02:55:18.482251 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-c0cc8a32-9e92-4a6e-a1a4-f3540f36ddb6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 02:55:18.484686 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63bc1f-769e-43b9-9d8e-32e058eeb078 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:18.484847 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 233/456] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 23 02:55:18 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:18.491987 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc8a32-9e92-4a6e-a1a4-f3540f36ddb6 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:18.504738 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc8a32-9e92-4a6e-a1a4-f3540f36ddb6 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:18.617862 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63bc1f-769e-43b9-9d8e-32e058eeb078 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:18.620649 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d0874-f04e-43f5-a87b-81e21a5845aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:18.621984 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d0874-f04e-43f5-a87b-81e21a5845aa admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.622468 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d0874-f04e-43f5-a87b-81e21a5845aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.622573 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28a527-e2fc-4a93-867d-a2374cf6d4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:18.623055 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d0874-f04e-43f5-a87b-81e21a5845aa admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.623300 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28a527-e2fc-4a93-867d-a2374cf6d4aa admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.624121 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28a527-e2fc-4a93-867d-a2374cf6d4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.624401 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28a527-e2fc-4a93-867d-a2374cf6d4aa admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.625449 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d0874-f04e-43f5-a87b-81e21a5845aa admin admin] RBAC: Adding query filter params (name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:18.625974 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d0874-f04e-43f5-a87b-81e21a5845aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:18.628504 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d0874-f04e-43f5-a87b-81e21a5845aa admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:18.636943 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28a527-e2fc-4a93-867d-a2374cf6d4aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:18.640480 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 234/457] 10.222.0.23 () {56 vars in 1125 bytes} [Thu Sep 23 02:55:18 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:18.645531 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-6a28a527-e2fc-4a93-867d-a2374cf6d4aa admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 02:55:18.646004 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 224/458] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 23 02:55:18 2021] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:18.647241 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a1bd6-8124-4dfd-87b0-b1104eea4bff None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.647444 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d0874-f04e-43f5-a87b-81e21a5845aa admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:18.647540 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a1bd6-8124-4dfd-87b0-b1104eea4bff None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.647798 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a1bd6-8124-4dfd-87b0-b1104eea4bff None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.649995 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 225/459] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:18.657543 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a1bd6-8124-4dfd-87b0-b1104eea4bff None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:18.659694 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d0874-f04e-43f5-a87b-81e21a5845aa admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:18.665127 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43058f3b-624b-4cfe-a4b3-82b747dd9cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:18.666891 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43058f3b-624b-4cfe-a4b3-82b747dd9cff admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.667638 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43058f3b-624b-4cfe-a4b3-82b747dd9cff admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.668108 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43058f3b-624b-4cfe-a4b3-82b747dd9cff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.670711 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a1bd6-8124-4dfd-87b0-b1104eea4bff None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:18.675718 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f770e-5f86-4ef1-9549-a5872e7381dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:18.677214 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f770e-5f86-4ef1-9549-a5872e7381dd admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.677397 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f770e-5f86-4ef1-9549-a5872e7381dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.677679 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f770e-5f86-4ef1-9549-a5872e7381dd admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.678493 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f770e-5f86-4ef1-9549-a5872e7381dd admin admin] RBAC: Adding query filter params (name=service) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:18.678806 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f770e-5f86-4ef1-9549-a5872e7381dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:18.680884 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f770e-5f86-4ef1-9549-a5872e7381dd admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:18.682113 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43058f3b-624b-4cfe-a4b3-82b747dd9cff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:18.683940 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43058f3b-624b-4cfe-a4b3-82b747dd9cff admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:18.691377 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 226/460] 10.222.0.23 () {56 vars in 1125 bytes} [Thu Sep 23 02:55:18 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:18.692773 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548f3d0-d789-4fec-8800-61346f751a50 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.693063 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548f3d0-d789-4fec-8800-61346f751a50 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.693343 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548f3d0-d789-4fec-8800-61346f751a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.704560 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-43058f3b-624b-4cfe-a4b3-82b747dd9cff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:18.706001 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 235/461] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:18.706789 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43058f3b-624b-4cfe-a4b3-82b747dd9cff admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:18.712664 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-b548f3d0-d789-4fec-8800-61346f751a50 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:18.714203 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-b548f3d0-d789-4fec-8800-61346f751a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:18.720315 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43058f3b-624b-4cfe-a4b3-82b747dd9cff admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:18.723700 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 227/462] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:18.724778 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548f3d0-d789-4fec-8800-61346f751a50 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:18.725502 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4675d-0d12-4212-bc5a-288b109a7e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:18.726434 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4675d-0d12-4212-bc5a-288b109a7e63 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.726849 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4675d-0d12-4212-bc5a-288b109a7e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.727274 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4675d-0d12-4212-bc5a-288b109a7e63 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.734539 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548f3d0-d789-4fec-8800-61346f751a50 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:18.738221 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4675d-0d12-4212-bc5a-288b109a7e63 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:18.739287 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e96da-53a8-44b0-98f3-a1dbb4631234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:18.740036 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e96da-53a8-44b0-98f3-a1dbb4631234 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.740322 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e96da-53a8-44b0-98f3-a1dbb4631234 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.740681 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e96da-53a8-44b0-98f3-a1dbb4631234 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.740897 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4675d-0d12-4212-bc5a-288b109a7e63 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:18.741406 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e96da-53a8-44b0-98f3-a1dbb4631234 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:18.741714 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e96da-53a8-44b0-98f3-a1dbb4631234 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:18.743788 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e96da-53a8-44b0-98f3-a1dbb4631234 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:18.757966 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 228/463] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:18.759563 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-b5e4675d-0d12-4212-bc5a-288b109a7e63 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:18.760184 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e96da-53a8-44b0-98f3-a1dbb4631234 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:18.761075 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 236/464] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:18.768973 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4675d-0d12-4212-bc5a-288b109a7e63 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:18.770187 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e96da-53a8-44b0-98f3-a1dbb4631234 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:18.774622 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd6a78-0c74-4ee7-b62c-66c22811558a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:18.775429 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd6a78-0c74-4ee7-b62c-66c22811558a admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.775707 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd6a78-0c74-4ee7-b62c-66c22811558a admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.775988 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd6a78-0c74-4ee7-b62c-66c22811558a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.788550 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4675d-0d12-4212-bc5a-288b109a7e63 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:18.789753 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd6a78-0c74-4ee7-b62c-66c22811558a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:18.793123 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dacd97-52f6-447e-8240-b91b43af7001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:18.793918 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dacd97-52f6-447e-8240-b91b43af7001 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.794202 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dacd97-52f6-447e-8240-b91b43af7001 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.794480 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dacd97-52f6-447e-8240-b91b43af7001 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.800043 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-97dd6a78-0c74-4ee7-b62c-66c22811558a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 02:55:18.801975 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 229/465] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 23 02:55:18 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:18.802892 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dacd97-52f6-447e-8240-b91b43af7001 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:18.803185 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd6a78-0c74-4ee7-b62c-66c22811558a admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:18.805342 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dacd97-52f6-447e-8240-b91b43af7001 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:18.826259 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd6a78-0c74-4ee7-b62c-66c22811558a admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:18.826378 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-70dacd97-52f6-447e-8240-b91b43af7001 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 23 02:55:18.827853 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 237/466] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:55:18 2021] GET /identity/v3/users/glance => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:18.828715 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dacd97-52f6-447e-8240-b91b43af7001 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:18.831854 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a21b06-7421-4499-a3a9-78ca1ea52b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:18.832820 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a21b06-7421-4499-a3a9-78ca1ea52b28 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.833318 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a21b06-7421-4499-a3a9-78ca1ea52b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.834043 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a21b06-7421-4499-a3a9-78ca1ea52b28 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.835607 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a21b06-7421-4499-a3a9-78ca1ea52b28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:18.836184 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a21b06-7421-4499-a3a9-78ca1ea52b28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:18.838256 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a21b06-7421-4499-a3a9-78ca1ea52b28 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:18.838855 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dacd97-52f6-447e-8240-b91b43af7001 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:18.844830 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca7bb8-9691-45da-a7f9-9a26b71cf2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:18.845666 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca7bb8-9691-45da-a7f9-9a26b71cf2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.846032 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca7bb8-9691-45da-a7f9-9a26b71cf2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.846426 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca7bb8-9691-45da-a7f9-9a26b71cf2d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.847240 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca7bb8-9691-45da-a7f9-9a26b71cf2d7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:18.847665 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca7bb8-9691-45da-a7f9-9a26b71cf2d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:18.849480 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca7bb8-9691-45da-a7f9-9a26b71cf2d7 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:18.854082 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 230/467] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:18.859870 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a21b06-7421-4499-a3a9-78ca1ea52b28 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:18.864034 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 238/468] 10.222.0.23 () {56 vars in 1125 bytes} [Thu Sep 23 02:55:18 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:18.865131 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca7bb8-9691-45da-a7f9-9a26b71cf2d7 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:18.871265 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a21b06-7421-4499-a3a9-78ca1ea52b28 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:18.875148 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca7bb8-9691-45da-a7f9-9a26b71cf2d7 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:18.878525 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4fb69-e927-4c87-bda9-2239e1fdf21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:18.879532 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4fb69-e927-4c87-bda9-2239e1fdf21d admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.880015 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4fb69-e927-4c87-bda9-2239e1fdf21d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.880431 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4fb69-e927-4c87-bda9-2239e1fdf21d admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.880635 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcabe32-46bc-490f-a4a4-a0d711a90e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:18.881521 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcabe32-46bc-490f-a4a4-a0d711a90e73 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.881746 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4fb69-e927-4c87-bda9-2239e1fdf21d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:18.882038 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcabe32-46bc-490f-a4a4-a0d711a90e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.882334 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4fb69-e927-4c87-bda9-2239e1fdf21d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:18.882586 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcabe32-46bc-490f-a4a4-a0d711a90e73 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.884754 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4fb69-e927-4c87-bda9-2239e1fdf21d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:18.892009 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcabe32-46bc-490f-a4a4-a0d711a90e73 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:18.894207 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcabe32-46bc-490f-a4a4-a0d711a90e73 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:18.904219 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 231/469] 10.222.0.23 () {56 vars in 1159 bytes} [Thu Sep 23 02:55:18 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:18.905308 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4fb69-e927-4c87-bda9-2239e1fdf21d admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:18.912835 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-6dcabe32-46bc-490f-a4a4-a0d711a90e73 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 02:55:18.912835 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 239/470] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:55:18 2021] GET /identity/v3/users/cinder => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:18.912835 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcabe32-46bc-490f-a4a4-a0d711a90e73 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:18.919519 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4fb69-e927-4c87-bda9-2239e1fdf21d admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:18.925858 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb772f-6038-43df-a457-7f6dfccd173b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:18.926940 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb772f-6038-43df-a457-7f6dfccd173b admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.927133 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcabe32-46bc-490f-a4a4-a0d711a90e73 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:18.927646 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb772f-6038-43df-a457-7f6dfccd173b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.928119 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb772f-6038-43df-a457-7f6dfccd173b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.932120 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676492e-ea4b-4ffb-91b5-b93cf28920e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:18.932920 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676492e-ea4b-4ffb-91b5-b93cf28920e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.933200 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676492e-ea4b-4ffb-91b5-b93cf28920e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.933475 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676492e-ea4b-4ffb-91b5-b93cf28920e1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.940741 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb772f-6038-43df-a457-7f6dfccd173b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:18.943304 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb772f-6038-43df-a457-7f6dfccd173b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:18.945789 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676492e-ea4b-4ffb-91b5-b93cf28920e1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:18.948191 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676492e-ea4b-4ffb-91b5-b93cf28920e1 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:18.963442 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-3dfb772f-6038-43df-a457-7f6dfccd173b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:18.964943 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 232/471] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:18.965925 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb772f-6038-43df-a457-7f6dfccd173b admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:18.968764 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-c676492e-ea4b-4ffb-91b5-b93cf28920e1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:18.970399 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 240/472] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:18.976403 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676492e-ea4b-4ffb-91b5-b93cf28920e1 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:18.982903 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb772f-6038-43df-a457-7f6dfccd173b admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:18.986959 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676492e-ea4b-4ffb-91b5-b93cf28920e1 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:18.988024 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29a42d-acd8-41d0-ba35-178ac1e7694a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:18.988717 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29a42d-acd8-41d0-ba35-178ac1e7694a admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.989023 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29a42d-acd8-41d0-ba35-178ac1e7694a admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.989358 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29a42d-acd8-41d0-ba35-178ac1e7694a admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.990425 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29a42d-acd8-41d0-ba35-178ac1e7694a admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:18.990779 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29a42d-acd8-41d0-ba35-178ac1e7694a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:18.993016 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084deda-4b1d-4bd2-9262-a2691ff093e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:18.993137 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29a42d-acd8-41d0-ba35-178ac1e7694a admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:18.993980 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084deda-4b1d-4bd2-9262-a2691ff093e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:18.994458 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084deda-4b1d-4bd2-9262-a2691ff093e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:18.994929 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084deda-4b1d-4bd2-9262-a2691ff093e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:18.995864 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084deda-4b1d-4bd2-9262-a2691ff093e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:18.996364 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084deda-4b1d-4bd2-9262-a2691ff093e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:18.998170 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084deda-4b1d-4bd2-9262-a2691ff093e7 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:19.011100 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 241/473] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:19.012247 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084deda-4b1d-4bd2-9262-a2691ff093e7 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:19.017551 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 233/474] 10.222.0.23 () {56 vars in 1159 bytes} [Thu Sep 23 02:55:18 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:19.019376 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29a42d-acd8-41d0-ba35-178ac1e7694a admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:19.027665 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084deda-4b1d-4bd2-9262-a2691ff093e7 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:19.032872 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ed85f-3709-49f5-9040-eeb7d4da7433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:19.033778 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ed85f-3709-49f5-9040-eeb7d4da7433 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:19.034026 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29a42d-acd8-41d0-ba35-178ac1e7694a admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:19.034482 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ed85f-3709-49f5-9040-eeb7d4da7433 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:19.035023 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ed85f-3709-49f5-9040-eeb7d4da7433 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:19.036088 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ed85f-3709-49f5-9040-eeb7d4da7433 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:19.036629 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ed85f-3709-49f5-9040-eeb7d4da7433 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:19.038637 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ed85f-3709-49f5-9040-eeb7d4da7433 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:19.038744 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06349b0b-c8cf-4f26-b39f-b9243e558f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:19.039481 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06349b0b-c8cf-4f26-b39f-b9243e558f9e admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:19.039761 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06349b0b-c8cf-4f26-b39f-b9243e558f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:19.040131 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06349b0b-c8cf-4f26-b39f-b9243e558f9e admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:19.050292 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06349b0b-c8cf-4f26-b39f-b9243e558f9e admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:19.051978 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 242/475] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:19.052521 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06349b0b-c8cf-4f26-b39f-b9243e558f9e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:19.053251 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ed85f-3709-49f5-9040-eeb7d4da7433 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:19.066865 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ed85f-3709-49f5-9040-eeb7d4da7433 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:19.071777 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e98b61-cbab-4609-a65c-70efaac480a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:19.072865 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e98b61-cbab-4609-a65c-70efaac480a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:19.073354 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e98b61-cbab-4609-a65c-70efaac480a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:19.073871 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e98b61-cbab-4609-a65c-70efaac480a5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:19.075733 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-06349b0b-c8cf-4f26-b39f-b9243e558f9e admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 23 02:55:19.080631 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 234/476] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 23 02:55:19 2021] GET /identity/v3/users/neutron => generated 85 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:19.081700 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06349b0b-c8cf-4f26-b39f-b9243e558f9e admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:19.093123 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e98b61-cbab-4609-a65c-70efaac480a5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:19.095311 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e98b61-cbab-4609-a65c-70efaac480a5 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:19.096330 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06349b0b-c8cf-4f26-b39f-b9243e558f9e admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:19.101694 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e79a4-c587-4640-a031-f2ba4f1bf78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:19.102843 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e79a4-c587-4640-a031-f2ba4f1bf78c admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:19.103329 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e79a4-c587-4640-a031-f2ba4f1bf78c admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:19.103857 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e79a4-c587-4640-a031-f2ba4f1bf78c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:19.112213 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e79a4-c587-4640-a031-f2ba4f1bf78c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:19.114443 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-f9e98b61-cbab-4609-a65c-70efaac480a5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:19.114793 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e79a4-c587-4640-a031-f2ba4f1bf78c admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:19.115842 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 243/477] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:19.120673 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e98b61-cbab-4609-a65c-70efaac480a5 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:19.133478 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-664e79a4-c587-4640-a031-f2ba4f1bf78c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:19.134120 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e98b61-cbab-4609-a65c-70efaac480a5 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:19.135173 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 235/478] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:19.136133 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e79a4-c587-4640-a031-f2ba4f1bf78c admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:19.145918 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d64e6-f671-488f-b7db-85c76a61c461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:19.146598 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d64e6-f671-488f-b7db-85c76a61c461 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:19.146869 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d64e6-f671-488f-b7db-85c76a61c461 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:19.147144 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d64e6-f671-488f-b7db-85c76a61c461 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:19.147983 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d64e6-f671-488f-b7db-85c76a61c461 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:19.148281 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d64e6-f671-488f-b7db-85c76a61c461 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:19.149021 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e79a4-c587-4640-a031-f2ba4f1bf78c admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:19.150229 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d64e6-f671-488f-b7db-85c76a61c461 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:19.154416 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafff230-a07a-4b52-97a5-2b37c6448567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:19.155415 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafff230-a07a-4b52-97a5-2b37c6448567 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:19.155895 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafff230-a07a-4b52-97a5-2b37c6448567 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:19.156397 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafff230-a07a-4b52-97a5-2b37c6448567 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:19.157407 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafff230-a07a-4b52-97a5-2b37c6448567 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:19.157996 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafff230-a07a-4b52-97a5-2b37c6448567 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:19.159866 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafff230-a07a-4b52-97a5-2b37c6448567 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:19.170304 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 244/479] 10.222.0.23 () {56 vars in 1161 bytes} [Thu Sep 23 02:55:19 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:19.171722 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d64e6-f671-488f-b7db-85c76a61c461 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:19.173239 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 236/480] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:19.176394 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafff230-a07a-4b52-97a5-2b37c6448567 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:19.186354 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafff230-a07a-4b52-97a5-2b37c6448567 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:19.187327 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d64e6-f671-488f-b7db-85c76a61c461 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:19.191968 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38615c99-12a0-45ab-b6d8-e02de2b02102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:19.192248 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79b8de-cf84-4d08-9e35-5bec9bb14d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:19.192892 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79b8de-cf84-4d08-9e35-5bec9bb14d34 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:19.193177 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79b8de-cf84-4d08-9e35-5bec9bb14d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:19.193450 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79b8de-cf84-4d08-9e35-5bec9bb14d34 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:19.193966 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38615c99-12a0-45ab-b6d8-e02de2b02102 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:19.194230 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79b8de-cf84-4d08-9e35-5bec9bb14d34 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:19.194534 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79b8de-cf84-4d08-9e35-5bec9bb14d34 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:19.194919 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38615c99-12a0-45ab-b6d8-e02de2b02102 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:19.195394 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38615c99-12a0-45ab-b6d8-e02de2b02102 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:19.196580 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79b8de-cf84-4d08-9e35-5bec9bb14d34 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:19.207269 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38615c99-12a0-45ab-b6d8-e02de2b02102 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:19.209399 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38615c99-12a0-45ab-b6d8-e02de2b02102 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:19.212555 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 245/481] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:19 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:19.213591 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79b8de-cf84-4d08-9e35-5bec9bb14d34 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:19.227101 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79b8de-cf84-4d08-9e35-5bec9bb14d34 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:19.231557 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58807e2c-65f0-4060-b1cf-6bb35b97d937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:19.232325 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58807e2c-65f0-4060-b1cf-6bb35b97d937 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:19.232632 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58807e2c-65f0-4060-b1cf-6bb35b97d937 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:19.233421 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58807e2c-65f0-4060-b1cf-6bb35b97d937 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:19.234366 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-38615c99-12a0-45ab-b6d8-e02de2b02102 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:19.235820 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 237/482] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:19.236960 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38615c99-12a0-45ab-b6d8-e02de2b02102 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:19.240335 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58807e2c-65f0-4060-b1cf-6bb35b97d937 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:19.242564 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58807e2c-65f0-4060-b1cf-6bb35b97d937 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:19.247552 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38615c99-12a0-45ab-b6d8-e02de2b02102 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:19.252517 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe134d94-580b-4640-b716-2c8d79373209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:19.253759 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe134d94-580b-4640-b716-2c8d79373209 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:19.254255 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe134d94-580b-4640-b716-2c8d79373209 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:19.254727 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe134d94-580b-4640-b716-2c8d79373209 admin admin] PATH_INFO: `/v3/projects/73dcb70ac3714a428a717707e6be8201/users/83242c1ef12d4a5b800e67346f4ad963/roles/8e064794445b4039b2cf2d06b26b49de` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:19.257806 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-58807e2c-65f0-4060-b1cf-6bb35b97d937 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:19.259816 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 246/483] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:19.264653 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58807e2c-65f0-4060-b1cf-6bb35b97d937 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:19.274300 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe134d94-580b-4640-b716-2c8d79373209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73dcb70ac3714a428a717707e6be8201, user_id=83242c1ef12d4a5b800e67346f4ad963, role_id=8e064794445b4039b2cf2d06b26b49de)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:19.276922 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58807e2c-65f0-4060-b1cf-6bb35b97d937 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:19.277292 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe134d94-580b-4640-b716-2c8d79373209 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:19.283026 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085ca4f-fb94-4246-9034-3fb94e9ba5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:19.283829 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085ca4f-fb94-4246-9034-3fb94e9ba5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:19.284245 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085ca4f-fb94-4246-9034-3fb94e9ba5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:19.284733 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085ca4f-fb94-4246-9034-3fb94e9ba5b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:19.285524 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085ca4f-fb94-4246-9034-3fb94e9ba5b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:19.285928 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085ca4f-fb94-4246-9034-3fb94e9ba5b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:19.287609 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085ca4f-fb94-4246-9034-3fb94e9ba5b1 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:19.299318 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 247/484] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:19.300212 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085ca4f-fb94-4246-9034-3fb94e9ba5b1 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:19.309709 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085ca4f-fb94-4246-9034-3fb94e9ba5b1 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:19.314869 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109431d-18c6-4f56-8078-ff992f8c1497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:19.315630 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109431d-18c6-4f56-8078-ff992f8c1497 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:19.316004 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109431d-18c6-4f56-8078-ff992f8c1497 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:19.316343 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109431d-18c6-4f56-8078-ff992f8c1497 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:19.319019 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109431d-18c6-4f56-8078-ff992f8c1497 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:19.319019 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109431d-18c6-4f56-8078-ff992f8c1497 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:19.319638 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109431d-18c6-4f56-8078-ff992f8c1497 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:19.333108 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 248/485] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:19 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:19.338650 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109431d-18c6-4f56-8078-ff992f8c1497 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:19.349429 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109431d-18c6-4f56-8078-ff992f8c1497 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:19.356434 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 238/486] 10.222.0.23 () {58 vars in 1461 bytes} [Thu Sep 23 02:55:19 2021] PUT /identity/v3/projects/73dcb70ac3714a428a717707e6be8201/users/83242c1ef12d4a5b800e67346f4ad963/roles/8e064794445b4039b2cf2d06b26b49de => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 02:55:19.359308 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe134d94-580b-4640-b716-2c8d79373209 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:19.460012 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4a4c0-2eef-44c9-a3d4-f8f4a9526bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:19.460939 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4a4c0-2eef-44c9-a3d4-f8f4a9526bdc admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:19.461828 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4a4c0-2eef-44c9-a3d4-f8f4a9526bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:19.462394 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4a4c0-2eef-44c9-a3d4-f8f4a9526bdc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:19.477849 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b4a4c0-2eef-44c9-a3d4-f8f4a9526bdc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:19.482189 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe134d94-580b-4640-b716-2c8d79373209 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:19.482790 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b4a4c0-2eef-44c9-a3d4-f8f4a9526bdc admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:19.493994 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15d87f-d4d8-476c-9118-832da412fa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:19.495104 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15d87f-d4d8-476c-9118-832da412fa70 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:19.495491 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15d87f-d4d8-476c-9118-832da412fa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:19.495875 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15d87f-d4d8-476c-9118-832da412fa70 admin admin] PATH_INFO: `/v3/projects/73dcb70ac3714a428a717707e6be8201/users/5a435fd22fdc4160888f942e634c0a08/roles/8e064794445b4039b2cf2d06b26b49de` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:19.512658 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-67b4a4c0-2eef-44c9-a3d4-f8f4a9526bdc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:19.514491 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 249/487] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:19.521019 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4a4c0-2eef-44c9-a3d4-f8f4a9526bdc admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:19.535459 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4a4c0-2eef-44c9-a3d4-f8f4a9526bdc admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:19.538040 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15d87f-d4d8-476c-9118-832da412fa70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73dcb70ac3714a428a717707e6be8201, user_id=5a435fd22fdc4160888f942e634c0a08, role_id=8e064794445b4039b2cf2d06b26b49de)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:19.540660 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e8adf-3729-4557-b704-5a6ecd43bb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:19.540821 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15d87f-d4d8-476c-9118-832da412fa70 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:19.541728 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e8adf-3729-4557-b704-5a6ecd43bb0a admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:19.542265 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e8adf-3729-4557-b704-5a6ecd43bb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:19.542757 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e8adf-3729-4557-b704-5a6ecd43bb0a admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:19.543839 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e8adf-3729-4557-b704-5a6ecd43bb0a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:19.544353 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e8adf-3729-4557-b704-5a6ecd43bb0a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:19.546667 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e8adf-3729-4557-b704-5a6ecd43bb0a admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:19.563976 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 250/488] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:19 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:19.570217 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e8adf-3729-4557-b704-5a6ecd43bb0a admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:19.588139 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e8adf-3729-4557-b704-5a6ecd43bb0a admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:19.597162 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30174b41-82c3-4461-abcb-a4e6432360fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:19.598165 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30174b41-82c3-4461-abcb-a4e6432360fe admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:19.598501 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30174b41-82c3-4461-abcb-a4e6432360fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:19.598836 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30174b41-82c3-4461-abcb-a4e6432360fe admin admin] PATH_INFO: `/v3/projects/73dcb70ac3714a428a717707e6be8201/users/621e97bd0914448c8afadba25510053d/roles/8e064794445b4039b2cf2d06b26b49de` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:19.617562 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30174b41-82c3-4461-abcb-a4e6432360fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=73dcb70ac3714a428a717707e6be8201, user_id=621e97bd0914448c8afadba25510053d, role_id=8e064794445b4039b2cf2d06b26b49de)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:19.620352 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30174b41-82c3-4461-abcb-a4e6432360fe admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:19.667653 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 239/489] 10.222.0.23 () {58 vars in 1461 bytes} [Thu Sep 23 02:55:19 2021] PUT /identity/v3/projects/73dcb70ac3714a428a717707e6be8201/users/5a435fd22fdc4160888f942e634c0a08/roles/8e064794445b4039b2cf2d06b26b49de => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 02:55:19.669833 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f6be9-fc4c-48a8-8bf5-b5841fdc8e7d None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:19.670358 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f6be9-fc4c-48a8-8bf5-b5841fdc8e7d None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:19.670935 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f6be9-fc4c-48a8-8bf5-b5841fdc8e7d None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:19.673259 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 240/490] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:19.681985 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ea82d-86cd-4f97-8745-74eee6fc657c None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:19.682649 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ea82d-86cd-4f97-8745-74eee6fc657c None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:19.683118 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ea82d-86cd-4f97-8745-74eee6fc657c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:19.703608 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-9d2ea82d-86cd-4f97-8745-74eee6fc657c None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:19.705290 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-9d2ea82d-86cd-4f97-8745-74eee6fc657c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:19.739956 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 251/491] 10.222.0.23 () {58 vars in 1461 bytes} [Thu Sep 23 02:55:19 2021] PUT /identity/v3/projects/73dcb70ac3714a428a717707e6be8201/users/621e97bd0914448c8afadba25510053d/roles/8e064794445b4039b2cf2d06b26b49de => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 02:55:19.785686 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 241/492] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:19.830054 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30174b41-82c3-4461-abcb-a4e6432360fe admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:19.910999 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30174b41-82c3-4461-abcb-a4e6432360fe admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:19.915739 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491a432-eb8a-46e2-83af-b4a55ee45c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:19.916703 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491a432-eb8a-46e2-83af-b4a55ee45c52 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:19.916952 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491a432-eb8a-46e2-83af-b4a55ee45c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:19.917232 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491a432-eb8a-46e2-83af-b4a55ee45c52 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:19.931358 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491a432-eb8a-46e2-83af-b4a55ee45c52 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:19.938696 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-3491a432-eb8a-46e2-83af-b4a55ee45c52 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 02:55:19.940014 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 252/493] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 23 02:55:19 2021] GET /identity/v3/roles/service => generated 85 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:19.946872 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ea82d-86cd-4f97-8745-74eee6fc657c None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:19.957615 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ea82d-86cd-4f97-8745-74eee6fc657c None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:19.963027 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa540e5-d538-4d37-a2f7-e7c6d8cba3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:19.963841 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa540e5-d538-4d37-a2f7-e7c6d8cba3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:19.964226 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa540e5-d538-4d37-a2f7-e7c6d8cba3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:19.964637 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa540e5-d538-4d37-a2f7-e7c6d8cba3d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:19.965506 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa540e5-d538-4d37-a2f7-e7c6d8cba3d5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:19.965916 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa540e5-d538-4d37-a2f7-e7c6d8cba3d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:19.967701 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa540e5-d538-4d37-a2f7-e7c6d8cba3d5 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:19.978398 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 242/494] 10.222.0.23 () {56 vars in 1125 bytes} [Thu Sep 23 02:55:19 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:19.985036 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491a432-eb8a-46e2-83af-b4a55ee45c52 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:19.995344 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491a432-eb8a-46e2-83af-b4a55ee45c52 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:20.004302 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859ab58-72e5-430f-ae7c-f1868eaaeea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:20.005303 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859ab58-72e5-430f-ae7c-f1868eaaeea1 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:20.005682 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859ab58-72e5-430f-ae7c-f1868eaaeea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:20.006084 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859ab58-72e5-430f-ae7c-f1868eaaeea1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:20.018888 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859ab58-72e5-430f-ae7c-f1868eaaeea1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:20.020941 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859ab58-72e5-430f-ae7c-f1868eaaeea1 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:20.039457 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-6859ab58-72e5-430f-ae7c-f1868eaaeea1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:20.041109 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 253/495] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:20.047240 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa540e5-d538-4d37-a2f7-e7c6d8cba3d5 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:20.057312 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa540e5-d538-4d37-a2f7-e7c6d8cba3d5 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:20.062652 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae47dab-4120-4f94-b8d5-7af479473387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:20.063469 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae47dab-4120-4f94-b8d5-7af479473387 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:20.063846 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae47dab-4120-4f94-b8d5-7af479473387 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:20.064266 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae47dab-4120-4f94-b8d5-7af479473387 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:20.065180 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae47dab-4120-4f94-b8d5-7af479473387 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:20.065603 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae47dab-4120-4f94-b8d5-7af479473387 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:20.067336 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae47dab-4120-4f94-b8d5-7af479473387 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:20.080234 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 243/496] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:20.086158 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859ab58-72e5-430f-ae7c-f1868eaaeea1 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:20.096752 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859ab58-72e5-430f-ae7c-f1868eaaeea1 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:20.101490 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46776db-bc0a-45aa-8801-0bb7abb83096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:20.102456 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46776db-bc0a-45aa-8801-0bb7abb83096 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:20.102829 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46776db-bc0a-45aa-8801-0bb7abb83096 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:20.103198 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46776db-bc0a-45aa-8801-0bb7abb83096 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:20.111893 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46776db-bc0a-45aa-8801-0bb7abb83096 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:20.114268 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46776db-bc0a-45aa-8801-0bb7abb83096 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:20.128366 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-c46776db-bc0a-45aa-8801-0bb7abb83096 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 23 02:55:20.130028 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 254/497] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:55:20 2021] GET /identity/v3/users/swift => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:20.136112 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae47dab-4120-4f94-b8d5-7af479473387 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:20.147248 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae47dab-4120-4f94-b8d5-7af479473387 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:20.152077 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605518ac-c716-4eba-8d76-a46a044686a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:20.152932 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605518ac-c716-4eba-8d76-a46a044686a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:20.153313 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605518ac-c716-4eba-8d76-a46a044686a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:20.153742 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605518ac-c716-4eba-8d76-a46a044686a4 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:20.155221 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605518ac-c716-4eba-8d76-a46a044686a4 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:20.155629 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605518ac-c716-4eba-8d76-a46a044686a4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:20.157715 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605518ac-c716-4eba-8d76-a46a044686a4 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:20.182171 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 244/498] 10.222.0.23 () {56 vars in 1157 bytes} [Thu Sep 23 02:55:20 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:20.189083 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46776db-bc0a-45aa-8801-0bb7abb83096 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:20.199163 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46776db-bc0a-45aa-8801-0bb7abb83096 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:20.204121 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d58e3-2439-490d-ab1b-dd8439274e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:20.204960 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d58e3-2439-490d-ab1b-dd8439274e82 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:20.205348 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d58e3-2439-490d-ab1b-dd8439274e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:20.205782 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d58e3-2439-490d-ab1b-dd8439274e82 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:20.214294 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d58e3-2439-490d-ab1b-dd8439274e82 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:20.216269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d58e3-2439-490d-ab1b-dd8439274e82 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:20.226608 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 255/499] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:55:20 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:55:20.237645 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605518ac-c716-4eba-8d76-a46a044686a4 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:20.247912 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605518ac-c716-4eba-8d76-a46a044686a4 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:20.254566 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d9f77-7e12-4d91-a924-76317a18d1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:20.255541 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d9f77-7e12-4d91-a924-76317a18d1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:20.255966 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d9f77-7e12-4d91-a924-76317a18d1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:20.256345 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d9f77-7e12-4d91-a924-76317a18d1a8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:20.272180 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d9f77-7e12-4d91-a924-76317a18d1a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:20.274176 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d9f77-7e12-4d91-a924-76317a18d1a8 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:20.294496 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-333d9f77-7e12-4d91-a924-76317a18d1a8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:20.295935 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 245/500] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:20.302246 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d58e3-2439-490d-ab1b-dd8439274e82 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:20.312087 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d58e3-2439-490d-ab1b-dd8439274e82 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:20.320639 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56258ed9-f6a0-4c26-8aa0-787432f8b20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:20.321441 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56258ed9-f6a0-4c26-8aa0-787432f8b20a admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:20.321830 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56258ed9-f6a0-4c26-8aa0-787432f8b20a admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:20.322214 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56258ed9-f6a0-4c26-8aa0-787432f8b20a admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:20.323093 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56258ed9-f6a0-4c26-8aa0-787432f8b20a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:20.323505 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56258ed9-f6a0-4c26-8aa0-787432f8b20a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:20.325258 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56258ed9-f6a0-4c26-8aa0-787432f8b20a admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:20.347887 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 256/501] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:20.354103 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d9f77-7e12-4d91-a924-76317a18d1a8 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:20.369455 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d9f77-7e12-4d91-a924-76317a18d1a8 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:20.376566 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615c201-ab58-4288-a816-3f78f03d370f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:20.377476 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615c201-ab58-4288-a816-3f78f03d370f admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:20.377867 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615c201-ab58-4288-a816-3f78f03d370f admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:20.378250 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615c201-ab58-4288-a816-3f78f03d370f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:20.397615 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615c201-ab58-4288-a816-3f78f03d370f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:20.399729 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615c201-ab58-4288-a816-3f78f03d370f admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:20.419802 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-e615c201-ab58-4288-a816-3f78f03d370f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:20.426957 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 246/502] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:20.427935 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56258ed9-f6a0-4c26-8aa0-787432f8b20a admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:20.446206 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56258ed9-f6a0-4c26-8aa0-787432f8b20a admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:20.455312 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b78790-a2d5-4476-b583-7690c1196f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:20.455983 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b78790-a2d5-4476-b583-7690c1196f7d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:20.456266 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b78790-a2d5-4476-b583-7690c1196f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:20.456612 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b78790-a2d5-4476-b583-7690c1196f7d admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:20.457459 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b78790-a2d5-4476-b583-7690c1196f7d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:20.457766 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b78790-a2d5-4476-b583-7690c1196f7d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:20.459659 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b78790-a2d5-4476-b583-7690c1196f7d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:20.477428 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 257/503] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:20.484440 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615c201-ab58-4288-a816-3f78f03d370f admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:20.497317 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615c201-ab58-4288-a816-3f78f03d370f admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:20.504098 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec77606-a655-4f6d-8ac0-47ba893fd26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:20.504840 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec77606-a655-4f6d-8ac0-47ba893fd26c admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:20.505229 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec77606-a655-4f6d-8ac0-47ba893fd26c admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:20.505611 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec77606-a655-4f6d-8ac0-47ba893fd26c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:20.506545 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec77606-a655-4f6d-8ac0-47ba893fd26c admin admin] RBAC: Adding query filter params (role.id=8e064794445b4039b2cf2d06b26b49de, scope.project.id=73dcb70ac3714a428a717707e6be8201, user.id=df051fd059b34fe0993f501546d1610f) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:20.506984 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec77606-a655-4f6d-8ac0-47ba893fd26c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:20.508951 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec77606-a655-4f6d-8ac0-47ba893fd26c admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:20.517446 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 247/504] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:55:20 2021] GET /identity/v3/role_assignments?user.id=df051fd059b34fe0993f501546d1610f&scope.project.id=73dcb70ac3714a428a717707e6be8201&role.id=8e064794445b4039b2cf2d06b26b49de => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:20.943466 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8251a9-a249-4130-ad16-c0bd71eec88b None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:20.943974 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8251a9-a249-4130-ad16-c0bd71eec88b None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:20.944048 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8251a9-a249-4130-ad16-c0bd71eec88b None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:20.946027 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 258/505] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:20.953596 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d2330-4fc6-4b19-8000-668627be0826 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:20.954027 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d2330-4fc6-4b19-8000-668627be0826 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:20.954252 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d2330-4fc6-4b19-8000-668627be0826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:20.983825 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-c58d2330-4fc6-4b19-8000-668627be0826 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:20.985405 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-c58d2330-4fc6-4b19-8000-668627be0826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:20.995900 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 248/506] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:21.039269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8251a9-a249-4130-ad16-c0bd71eec88b None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:21.058056 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8251a9-a249-4130-ad16-c0bd71eec88b None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:21.063148 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f18fd7-9040-4afe-86ad-08f6bb096454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:21.063950 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f18fd7-9040-4afe-86ad-08f6bb096454 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:21.064268 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f18fd7-9040-4afe-86ad-08f6bb096454 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:21.064581 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f18fd7-9040-4afe-86ad-08f6bb096454 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:21.079586 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f18fd7-9040-4afe-86ad-08f6bb096454 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:21.086296 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-67f18fd7-9040-4afe-86ad-08f6bb096454 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 02:55:21.087846 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 259/507] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 23 02:55:21 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:21.094338 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d2330-4fc6-4b19-8000-668627be0826 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:21.108501 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d2330-4fc6-4b19-8000-668627be0826 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:21.113252 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2423c3d-4b7a-4660-9fce-8f175357b37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:21.114157 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2423c3d-4b7a-4660-9fce-8f175357b37d admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:21.114665 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2423c3d-4b7a-4660-9fce-8f175357b37d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:21.115146 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2423c3d-4b7a-4660-9fce-8f175357b37d admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:21.116111 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2423c3d-4b7a-4660-9fce-8f175357b37d admin admin] RBAC: Adding query filter params (name=service) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:21.116652 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2423c3d-4b7a-4660-9fce-8f175357b37d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:21.118444 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2423c3d-4b7a-4660-9fce-8f175357b37d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:21.131436 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 249/508] 10.222.0.23 () {56 vars in 1125 bytes} [Thu Sep 23 02:55:21 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:21.137132 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f18fd7-9040-4afe-86ad-08f6bb096454 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:21.153586 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f18fd7-9040-4afe-86ad-08f6bb096454 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:21.158370 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d544506-e5fd-4e8d-bc4b-76f871391b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:21.159219 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d544506-e5fd-4e8d-bc4b-76f871391b78 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:21.159504 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d544506-e5fd-4e8d-bc4b-76f871391b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:21.159782 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d544506-e5fd-4e8d-bc4b-76f871391b78 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:21.171391 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d544506-e5fd-4e8d-bc4b-76f871391b78 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:21.173333 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d544506-e5fd-4e8d-bc4b-76f871391b78 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:21.196031 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-5d544506-e5fd-4e8d-bc4b-76f871391b78 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:21.199904 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 260/509] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:21.206747 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2423c3d-4b7a-4660-9fce-8f175357b37d admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:21.222203 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2423c3d-4b7a-4660-9fce-8f175357b37d admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:21.226967 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd209f-2832-4403-be43-d5bc34648096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:21.227886 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd209f-2832-4403-be43-d5bc34648096 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:21.228384 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd209f-2832-4403-be43-d5bc34648096 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:21.232962 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd209f-2832-4403-be43-d5bc34648096 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:21.233931 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd209f-2832-4403-be43-d5bc34648096 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:21.234455 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd209f-2832-4403-be43-d5bc34648096 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:21.236258 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd209f-2832-4403-be43-d5bc34648096 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:21.252479 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 250/510] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:21.258482 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d544506-e5fd-4e8d-bc4b-76f871391b78 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:21.273659 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d544506-e5fd-4e8d-bc4b-76f871391b78 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:21.281290 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916f42b-0afb-4ce1-974e-f416be3bb4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:21.282142 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916f42b-0afb-4ce1-974e-f416be3bb4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:21.282427 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916f42b-0afb-4ce1-974e-f416be3bb4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:21.282706 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916f42b-0afb-4ce1-974e-f416be3bb4f4 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:21.290412 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916f42b-0afb-4ce1-974e-f416be3bb4f4 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:21.292510 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916f42b-0afb-4ce1-974e-f416be3bb4f4 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:21.306080 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-9916f42b-0afb-4ce1-974e-f416be3bb4f4 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 02:55:21.307534 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 261/511] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Sep 23 02:55:21 2021] GET /identity/v3/users/nova => generated 82 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:21.313346 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd209f-2832-4403-be43-d5bc34648096 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:21.325484 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd209f-2832-4403-be43-d5bc34648096 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:21.330831 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f075255-018e-4995-bbb5-9d38aea7b419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:21.336514 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f075255-018e-4995-bbb5-9d38aea7b419 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:21.336968 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f075255-018e-4995-bbb5-9d38aea7b419 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:21.337395 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f075255-018e-4995-bbb5-9d38aea7b419 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:21.338393 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f075255-018e-4995-bbb5-9d38aea7b419 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:21.338849 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f075255-018e-4995-bbb5-9d38aea7b419 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:21.340914 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f075255-018e-4995-bbb5-9d38aea7b419 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:21.366661 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 251/512] 10.222.0.23 () {56 vars in 1155 bytes} [Thu Sep 23 02:55:21 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:21.372412 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916f42b-0afb-4ce1-974e-f416be3bb4f4 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:21.384802 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916f42b-0afb-4ce1-974e-f416be3bb4f4 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:21.390426 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ca520-d1c7-4e6f-9fb6-2034b6037db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:21.391302 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ca520-d1c7-4e6f-9fb6-2034b6037db8 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:21.391695 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ca520-d1c7-4e6f-9fb6-2034b6037db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:21.392083 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ca520-d1c7-4e6f-9fb6-2034b6037db8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:21.400934 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ca520-d1c7-4e6f-9fb6-2034b6037db8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:21.402949 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ca520-d1c7-4e6f-9fb6-2034b6037db8 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:21.413416 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 262/513] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:55:21 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:55:21.419663 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f075255-018e-4995-bbb5-9d38aea7b419 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:21.433681 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f075255-018e-4995-bbb5-9d38aea7b419 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:21.444663 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761eb5d-5dfa-4bec-abdd-02b56587516f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:21.445484 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761eb5d-5dfa-4bec-abdd-02b56587516f admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:21.445772 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761eb5d-5dfa-4bec-abdd-02b56587516f admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:21.446055 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761eb5d-5dfa-4bec-abdd-02b56587516f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:21.461893 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761eb5d-5dfa-4bec-abdd-02b56587516f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:21.463781 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761eb5d-5dfa-4bec-abdd-02b56587516f admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:21.486093 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-a761eb5d-5dfa-4bec-abdd-02b56587516f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:21.487482 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 252/514] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:21.493882 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ca520-d1c7-4e6f-9fb6-2034b6037db8 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:21.509543 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ca520-d1c7-4e6f-9fb6-2034b6037db8 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:21.522082 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919cfe9-6981-4917-ae1d-26872e4aedba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:21.523053 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919cfe9-6981-4917-ae1d-26872e4aedba admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:21.523597 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919cfe9-6981-4917-ae1d-26872e4aedba admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:21.524119 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919cfe9-6981-4917-ae1d-26872e4aedba admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:21.525096 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919cfe9-6981-4917-ae1d-26872e4aedba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:21.525618 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919cfe9-6981-4917-ae1d-26872e4aedba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:21.527466 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919cfe9-6981-4917-ae1d-26872e4aedba admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:21.543544 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 263/515] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:21.550563 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761eb5d-5dfa-4bec-abdd-02b56587516f admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:21.561063 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761eb5d-5dfa-4bec-abdd-02b56587516f admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:21.570150 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfb5ba-9c2b-47fb-823a-ca4034dc35b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:21.571009 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfb5ba-9c2b-47fb-823a-ca4034dc35b9 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:21.571288 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfb5ba-9c2b-47fb-823a-ca4034dc35b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:21.571563 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfb5ba-9c2b-47fb-823a-ca4034dc35b9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:21.582056 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfb5ba-9c2b-47fb-823a-ca4034dc35b9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:21.583973 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfb5ba-9c2b-47fb-823a-ca4034dc35b9 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:21.604086 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-e4cfb5ba-9c2b-47fb-823a-ca4034dc35b9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:21.605379 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 253/516] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:21.613217 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919cfe9-6981-4917-ae1d-26872e4aedba admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:21.629823 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919cfe9-6981-4917-ae1d-26872e4aedba admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:21.641401 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034e790-180c-4fbb-aa2a-fe2be93043e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:21.642485 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034e790-180c-4fbb-aa2a-fe2be93043e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:21.643008 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034e790-180c-4fbb-aa2a-fe2be93043e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:21.643507 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034e790-180c-4fbb-aa2a-fe2be93043e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:21.644592 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034e790-180c-4fbb-aa2a-fe2be93043e3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:21.645124 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034e790-180c-4fbb-aa2a-fe2be93043e3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:21.647303 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034e790-180c-4fbb-aa2a-fe2be93043e3 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:21.670029 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 264/517] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:21.676666 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfb5ba-9c2b-47fb-823a-ca4034dc35b9 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:21.690982 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfb5ba-9c2b-47fb-823a-ca4034dc35b9 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:21.700397 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba777825-a510-4958-be3b-8e1f1285f49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:21.701231 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba777825-a510-4958-be3b-8e1f1285f49b admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:21.701568 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba777825-a510-4958-be3b-8e1f1285f49b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:21.701846 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba777825-a510-4958-be3b-8e1f1285f49b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:21.702765 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba777825-a510-4958-be3b-8e1f1285f49b admin admin] RBAC: Adding query filter params (role.id=8e064794445b4039b2cf2d06b26b49de, scope.project.id=73dcb70ac3714a428a717707e6be8201, user.id=83aa47f723434143b22aac1b96b6a610) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:21.703073 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba777825-a510-4958-be3b-8e1f1285f49b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:21.705127 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba777825-a510-4958-be3b-8e1f1285f49b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:21.717992 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 254/518] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:55:21 2021] GET /identity/v3/role_assignments?user.id=83aa47f723434143b22aac1b96b6a610&scope.project.id=73dcb70ac3714a428a717707e6be8201&role.id=8e064794445b4039b2cf2d06b26b49de => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:22.117673 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61f4ac-6d22-4583-b800-be723946ab02 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:22.118180 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61f4ac-6d22-4583-b800-be723946ab02 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:22.118255 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61f4ac-6d22-4583-b800-be723946ab02 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:22.120274 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 265/519] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:22.128182 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6306d-8ed8-40d5-a378-364d5fca015f None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:22.128702 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6306d-8ed8-40d5-a378-364d5fca015f None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:22.128952 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6306d-8ed8-40d5-a378-364d5fca015f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:22.150778 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-f9d6306d-8ed8-40d5-a378-364d5fca015f None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:22.151987 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-f9d6306d-8ed8-40d5-a378-364d5fca015f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:22.162800 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 255/520] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:22.188573 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61f4ac-6d22-4583-b800-be723946ab02 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:22.202129 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61f4ac-6d22-4583-b800-be723946ab02 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:22.207988 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37053d00-7e54-46ed-8b7b-3653cef9e676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:22.208808 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37053d00-7e54-46ed-8b7b-3653cef9e676 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:22.209089 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37053d00-7e54-46ed-8b7b-3653cef9e676 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:22.209368 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37053d00-7e54-46ed-8b7b-3653cef9e676 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:22.222757 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37053d00-7e54-46ed-8b7b-3653cef9e676 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:22.229516 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-37053d00-7e54-46ed-8b7b-3653cef9e676 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 02:55:22.230724 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 266/521] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 23 02:55:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:22.237785 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6306d-8ed8-40d5-a378-364d5fca015f None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:22.247361 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6306d-8ed8-40d5-a378-364d5fca015f None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:22.253173 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabfb77-fb46-440b-b5a7-66c507de589c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:22.253842 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabfb77-fb46-440b-b5a7-66c507de589c admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:22.254121 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabfb77-fb46-440b-b5a7-66c507de589c admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:22.254395 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabfb77-fb46-440b-b5a7-66c507de589c admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:22.255143 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfabfb77-fb46-440b-b5a7-66c507de589c admin admin] RBAC: Adding query filter params (name=service) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:22.255450 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfabfb77-fb46-440b-b5a7-66c507de589c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:22.257075 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfabfb77-fb46-440b-b5a7-66c507de589c admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:22.270958 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 256/522] 10.222.0.23 () {56 vars in 1125 bytes} [Thu Sep 23 02:55:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:22.276731 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37053d00-7e54-46ed-8b7b-3653cef9e676 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:22.287230 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37053d00-7e54-46ed-8b7b-3653cef9e676 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:22.293398 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab19b75-b143-43bf-b67b-acf04a94727b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:22.294258 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab19b75-b143-43bf-b67b-acf04a94727b admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:22.294539 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab19b75-b143-43bf-b67b-acf04a94727b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:22.294819 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab19b75-b143-43bf-b67b-acf04a94727b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:22.309440 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab19b75-b143-43bf-b67b-acf04a94727b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:22.311924 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab19b75-b143-43bf-b67b-acf04a94727b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:22.330802 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-1ab19b75-b143-43bf-b67b-acf04a94727b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:22.332412 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 267/523] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:22.338465 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabfb77-fb46-440b-b5a7-66c507de589c admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:22.352788 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabfb77-fb46-440b-b5a7-66c507de589c admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:22.368820 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690283a-a536-4aee-b21f-fcdf27a365c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:22.370460 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690283a-a536-4aee-b21f-fcdf27a365c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:22.371157 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690283a-a536-4aee-b21f-fcdf27a365c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:22.371664 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690283a-a536-4aee-b21f-fcdf27a365c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:22.372705 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690283a-a536-4aee-b21f-fcdf27a365c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:22.373275 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690283a-a536-4aee-b21f-fcdf27a365c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:22.375177 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690283a-a536-4aee-b21f-fcdf27a365c1 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:22.401202 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 257/524] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:22.407735 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab19b75-b143-43bf-b67b-acf04a94727b admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:22.419519 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cfd06-83b9-4f84-b60a-d6f577d22d90 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:22.420123 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cfd06-83b9-4f84-b60a-d6f577d22d90 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:22.421217 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cfd06-83b9-4f84-b60a-d6f577d22d90 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:22.422861 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab19b75-b143-43bf-b67b-acf04a94727b admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:22.423455 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 258/525] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:22 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 02:55:22.431044 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a82b32-ae90-4282-8c7e-e46edf2deead None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:22.431337 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a82b32-ae90-4282-8c7e-e46edf2deead None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:22.431624 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a82b32-ae90-4282-8c7e-e46edf2deead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:22.435319 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb1835-9720-49f8-a98c-4861c983c294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:22.436213 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb1835-9720-49f8-a98c-4861c983c294 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:22.436566 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb1835-9720-49f8-a98c-4861c983c294 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:22.436845 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb1835-9720-49f8-a98c-4861c983c294 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:22.449846 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-29a82b32-ae90-4282-8c7e-e46edf2deead None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:22.451066 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-29a82b32-ae90-4282-8c7e-e46edf2deead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:22.453803 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb1835-9720-49f8-a98c-4861c983c294 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:22.455932 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb1835-9720-49f8-a98c-4861c983c294 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:22.465700 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 259/526] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:22.475588 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-83cb1835-9720-49f8-a98c-4861c983c294 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 23 02:55:22.477117 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 268/527] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:55:22 2021] GET /identity/v3/users/glance => generated 84 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:22.483031 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a82b32-ae90-4282-8c7e-e46edf2deead None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:22.494720 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb1835-9720-49f8-a98c-4861c983c294 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:22.497828 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a82b32-ae90-4282-8c7e-e46edf2deead None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:22.502893 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad53591-4795-4aa7-ba5d-14f243d215ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:22.503571 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad53591-4795-4aa7-ba5d-14f243d215ac admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:22.503857 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad53591-4795-4aa7-ba5d-14f243d215ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:22.504136 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad53591-4795-4aa7-ba5d-14f243d215ac admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:22.505016 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad53591-4795-4aa7-ba5d-14f243d215ac admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:22.505328 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad53591-4795-4aa7-ba5d-14f243d215ac admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:22.505502 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb1835-9720-49f8-a98c-4861c983c294 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:22.507168 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad53591-4795-4aa7-ba5d-14f243d215ac admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:22.517032 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5ab05-2305-48c7-89a6-e31d858e92c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:22.517841 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5ab05-2305-48c7-89a6-e31d858e92c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:22.518118 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5ab05-2305-48c7-89a6-e31d858e92c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:22.518390 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5ab05-2305-48c7-89a6-e31d858e92c3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:22.527055 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 260/528] 10.222.0.23 () {56 vars in 1159 bytes} [Thu Sep 23 02:55:22 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:22.533397 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad53591-4795-4aa7-ba5d-14f243d215ac admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:22.545694 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad53591-4795-4aa7-ba5d-14f243d215ac admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:22.549398 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb5ab05-2305-48c7-89a6-e31d858e92c3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:22.551005 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4547553-70fb-44d0-b953-578601dd2e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:22.551847 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4547553-70fb-44d0-b953-578601dd2e24 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:22.552362 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4547553-70fb-44d0-b953-578601dd2e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:22.552832 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4547553-70fb-44d0-b953-578601dd2e24 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:22.556227 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-bfb5ab05-2305-48c7-89a6-e31d858e92c3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 02:55:22.557753 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 269/529] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 23 02:55:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:22.562724 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4547553-70fb-44d0-b953-578601dd2e24 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:22.565057 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4547553-70fb-44d0-b953-578601dd2e24 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:22.565613 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5ab05-2305-48c7-89a6-e31d858e92c3 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:22.575408 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 261/530] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:55:22 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 02:55:22.581307 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4547553-70fb-44d0-b953-578601dd2e24 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:22.586190 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5ab05-2305-48c7-89a6-e31d858e92c3 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:22.596663 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4547553-70fb-44d0-b953-578601dd2e24 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:22.597564 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726fa298-d5c5-45cb-b349-108ff27b14ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:22.598516 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fa298-d5c5-45cb-b349-108ff27b14ed admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:22.599755 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fa298-d5c5-45cb-b349-108ff27b14ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:22.600218 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fa298-d5c5-45cb-b349-108ff27b14ed admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:22.601550 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726fa298-d5c5-45cb-b349-108ff27b14ed admin admin] RBAC: Adding query filter params (name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:22.603078 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726fa298-d5c5-45cb-b349-108ff27b14ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:22.606352 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726fa298-d5c5-45cb-b349-108ff27b14ed admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:22.608328 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8b775-3405-41c3-b131-746f554c1500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:22.609433 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8b775-3405-41c3-b131-746f554c1500 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:22.609909 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8b775-3405-41c3-b131-746f554c1500 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:22.610826 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8b775-3405-41c3-b131-746f554c1500 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:22.623703 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 270/531] 10.222.0.23 () {56 vars in 1125 bytes} [Thu Sep 23 02:55:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:22.630120 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8b775-3405-41c3-b131-746f554c1500 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:22.631118 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726fa298-d5c5-45cb-b349-108ff27b14ed admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:22.632589 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8b775-3405-41c3-b131-746f554c1500 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:22.651348 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726fa298-d5c5-45cb-b349-108ff27b14ed admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:22.658049 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-f3f8b775-3405-41c3-b131-746f554c1500 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:22.663027 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d8c87-a2da-43a2-9e0e-26242e716905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:22.664286 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d8c87-a2da-43a2-9e0e-26242e716905 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:22.664810 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d8c87-a2da-43a2-9e0e-26242e716905 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:22.665282 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d8c87-a2da-43a2-9e0e-26242e716905 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:22.665838 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 262/532] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:22.672583 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8b775-3405-41c3-b131-746f554c1500 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:22.687630 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8b775-3405-41c3-b131-746f554c1500 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:22.689033 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d8c87-a2da-43a2-9e0e-26242e716905 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:22.692217 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d8c87-a2da-43a2-9e0e-26242e716905 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:22.698909 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47be03-5d59-44d2-8fda-e41a34e2c180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:22.700315 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47be03-5d59-44d2-8fda-e41a34e2c180 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:22.701290 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47be03-5d59-44d2-8fda-e41a34e2c180 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:22.702787 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47be03-5d59-44d2-8fda-e41a34e2c180 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:22.704963 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe47be03-5d59-44d2-8fda-e41a34e2c180 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:22.705543 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe47be03-5d59-44d2-8fda-e41a34e2c180 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:22.710115 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe47be03-5d59-44d2-8fda-e41a34e2c180 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:22.729582 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-da1d8c87-a2da-43a2-9e0e-26242e716905 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:22.733633 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 263/533] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:22.734244 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 271/534] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:22.742490 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d8c87-a2da-43a2-9e0e-26242e716905 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:22.751621 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47be03-5d59-44d2-8fda-e41a34e2c180 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:22.765313 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d8c87-a2da-43a2-9e0e-26242e716905 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:22.766245 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47be03-5d59-44d2-8fda-e41a34e2c180 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:22.773196 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09746c1d-8b15-43e7-b7aa-43f57a98d2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:22.773898 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09746c1d-8b15-43e7-b7aa-43f57a98d2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:22.774189 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09746c1d-8b15-43e7-b7aa-43f57a98d2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:22.774473 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09746c1d-8b15-43e7-b7aa-43f57a98d2d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:22.775228 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09746c1d-8b15-43e7-b7aa-43f57a98d2d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:22.775551 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09746c1d-8b15-43e7-b7aa-43f57a98d2d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:22.777254 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09746c1d-8b15-43e7-b7aa-43f57a98d2d3 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:22.780997 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38befab1-6fcf-428c-bfb5-c97632f0a143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:22.781819 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38befab1-6fcf-428c-bfb5-c97632f0a143 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:22.782100 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38befab1-6fcf-428c-bfb5-c97632f0a143 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:22.782448 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38befab1-6fcf-428c-bfb5-c97632f0a143 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:22.800239 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38befab1-6fcf-428c-bfb5-c97632f0a143 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:22.802277 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38befab1-6fcf-428c-bfb5-c97632f0a143 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:22.816723 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 264/535] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:22.818056 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09746c1d-8b15-43e7-b7aa-43f57a98d2d3 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:22.824720 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-38befab1-6fcf-428c-bfb5-c97632f0a143 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:22.826177 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 272/536] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:22.833940 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38befab1-6fcf-428c-bfb5-c97632f0a143 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:22.838793 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09746c1d-8b15-43e7-b7aa-43f57a98d2d3 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:22.845080 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38befab1-6fcf-428c-bfb5-c97632f0a143 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:22.849869 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c8c53-e167-403e-858d-1f4b6915ad50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:22.850579 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c8c53-e167-403e-858d-1f4b6915ad50 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:22.850862 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c8c53-e167-403e-858d-1f4b6915ad50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:22.851138 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c8c53-e167-403e-858d-1f4b6915ad50 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:22.852075 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c8c53-e167-403e-858d-1f4b6915ad50 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:22.852389 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c8c53-e167-403e-858d-1f4b6915ad50 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:22.854434 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c8c53-e167-403e-858d-1f4b6915ad50 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:22.859374 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88756ee3-0c9d-48eb-8c23-b65c94265dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:22.860190 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88756ee3-0c9d-48eb-8c23-b65c94265dcc admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:22.861744 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88756ee3-0c9d-48eb-8c23-b65c94265dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:22.862027 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88756ee3-0c9d-48eb-8c23-b65c94265dcc admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:22.871040 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 273/537] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:22.877098 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88756ee3-0c9d-48eb-8c23-b65c94265dcc admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:22.879246 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88756ee3-0c9d-48eb-8c23-b65c94265dcc admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:22.885430 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744b24b-dc0e-452f-af9b-f5bd0ed7c607 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:22.885973 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744b24b-dc0e-452f-af9b-f5bd0ed7c607 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:22.886457 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744b24b-dc0e-452f-af9b-f5bd0ed7c607 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:22.889449 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 274/538] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:22.890376 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744b24b-dc0e-452f-af9b-f5bd0ed7c607 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:22.896512 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-88756ee3-0c9d-48eb-8c23-b65c94265dcc admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 02:55:22.898003 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 265/539] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:55:22 2021] GET /identity/v3/users/cinder => generated 84 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:22.904446 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fcc46-9ed7-402b-bdf1-f383c9f129f3 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:22.904870 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fcc46-9ed7-402b-bdf1-f383c9f129f3 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:22.905165 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fcc46-9ed7-402b-bdf1-f383c9f129f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:22.906297 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744b24b-dc0e-452f-af9b-f5bd0ed7c607 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:22.911038 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8171710-db26-428d-9816-6950edeb8fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:22.911935 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8171710-db26-428d-9816-6950edeb8fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:22.912435 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8171710-db26-428d-9816-6950edeb8fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:22.912958 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8171710-db26-428d-9816-6950edeb8fb8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:22.913984 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8171710-db26-428d-9816-6950edeb8fb8 admin admin] RBAC: Adding query filter params (role.id=8e064794445b4039b2cf2d06b26b49de, scope.project.id=73dcb70ac3714a428a717707e6be8201, user.id=83242c1ef12d4a5b800e67346f4ad963) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:22.914499 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8171710-db26-428d-9816-6950edeb8fb8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:22.916544 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8171710-db26-428d-9816-6950edeb8fb8 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:22.923575 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 275/540] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:55:22 2021] GET /identity/v3/role_assignments?user.id=83242c1ef12d4a5b800e67346f4ad963&scope.project.id=73dcb70ac3714a428a717707e6be8201&role.id=8e064794445b4039b2cf2d06b26b49de => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:22.924620 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8171710-db26-428d-9816-6950edeb8fb8 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:22.928966 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-096fcc46-9ed7-402b-bdf1-f383c9f129f3 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:22.930898 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-096fcc46-9ed7-402b-bdf1-f383c9f129f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:22.946003 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 266/541] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:22.956653 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8171710-db26-428d-9816-6950edeb8fb8 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:22.970574 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fcc46-9ed7-402b-bdf1-f383c9f129f3 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:22.980772 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fcc46-9ed7-402b-bdf1-f383c9f129f3 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:22.981446 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9faac-1ada-48e8-822d-3978c9679646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:22.982157 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9faac-1ada-48e8-822d-3978c9679646 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:22.982439 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9faac-1ada-48e8-822d-3978c9679646 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:22.983240 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9faac-1ada-48e8-822d-3978c9679646 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:22.984116 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9faac-1ada-48e8-822d-3978c9679646 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:22.984421 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9faac-1ada-48e8-822d-3978c9679646 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:22.986343 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9faac-1ada-48e8-822d-3978c9679646 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:22.987723 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf7eca-529a-4068-b4ae-55c086f6180a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:22.989267 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf7eca-529a-4068-b4ae-55c086f6180a admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:22.989861 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf7eca-529a-4068-b4ae-55c086f6180a admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:22.990320 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf7eca-529a-4068-b4ae-55c086f6180a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.010651 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf7eca-529a-4068-b4ae-55c086f6180a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:23.020120 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-f4bf7eca-529a-4068-b4ae-55c086f6180a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 02:55:23.022086 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 267/542] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 23 02:55:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:23.028208 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf7eca-529a-4068-b4ae-55c086f6180a admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:23.032188 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 276/543] 10.222.0.23 () {56 vars in 1159 bytes} [Thu Sep 23 02:55:22 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:23.037414 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9faac-1ada-48e8-822d-3978c9679646 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:23.049674 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf7eca-529a-4068-b4ae-55c086f6180a admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:23.053751 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9faac-1ada-48e8-822d-3978c9679646 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:23.059479 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b1bc1-d98d-4b53-b4e1-ded5a4de1086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:23.062063 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b1bc1-d98d-4b53-b4e1-ded5a4de1086 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.063892 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b1bc1-d98d-4b53-b4e1-ded5a4de1086 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.064392 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b1bc1-d98d-4b53-b4e1-ded5a4de1086 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.065762 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b1bc1-d98d-4b53-b4e1-ded5a4de1086 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:23.066274 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0033ed1-a75b-4347-8d71-49023c1bcea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:23.067129 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0033ed1-a75b-4347-8d71-49023c1bcea4 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.067714 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b1bc1-d98d-4b53-b4e1-ded5a4de1086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:23.068179 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0033ed1-a75b-4347-8d71-49023c1bcea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.069039 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0033ed1-a75b-4347-8d71-49023c1bcea4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.070597 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b1bc1-d98d-4b53-b4e1-ded5a4de1086 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:23.085792 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0033ed1-a75b-4347-8d71-49023c1bcea4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:23.087619 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0033ed1-a75b-4347-8d71-49023c1bcea4 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:23.088750 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 268/544] 10.222.0.23 () {56 vars in 1125 bytes} [Thu Sep 23 02:55:23 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:23.090352 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db70cff-eaee-4ab9-96ba-138e721411cf None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.090846 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db70cff-eaee-4ab9-96ba-138e721411cf None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.091322 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db70cff-eaee-4ab9-96ba-138e721411cf None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.094904 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 269/545] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:23.096038 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db70cff-eaee-4ab9-96ba-138e721411cf None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:23.104897 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 277/546] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:55:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 02:55:23.106755 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2f7a3-ec77-4954-9ba5-2e12212aa1d3 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.107331 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2f7a3-ec77-4954-9ba5-2e12212aa1d3 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.107847 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2f7a3-ec77-4954-9ba5-2e12212aa1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.116878 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db70cff-eaee-4ab9-96ba-138e721411cf None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:23.121671 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565484e4-b11a-4759-a7a1-82b211426af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:23.122493 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565484e4-b11a-4759-a7a1-82b211426af6 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.122772 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565484e4-b11a-4759-a7a1-82b211426af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.123045 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565484e4-b11a-4759-a7a1-82b211426af6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.128845 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-9dc2f7a3-ec77-4954-9ba5-2e12212aa1d3 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:23.130560 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-9dc2f7a3-ec77-4954-9ba5-2e12212aa1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:23.135477 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565484e4-b11a-4759-a7a1-82b211426af6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:23.137420 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565484e4-b11a-4759-a7a1-82b211426af6 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:23.140391 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 278/547] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:23.141482 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2f7a3-ec77-4954-9ba5-2e12212aa1d3 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:23.151380 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2f7a3-ec77-4954-9ba5-2e12212aa1d3 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:23.156466 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702595f-57ce-4911-85fb-4eb884ce27d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:23.157281 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702595f-57ce-4911-85fb-4eb884ce27d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.157561 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702595f-57ce-4911-85fb-4eb884ce27d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.157836 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702595f-57ce-4911-85fb-4eb884ce27d2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.162062 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-565484e4-b11a-4759-a7a1-82b211426af6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:23.163483 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 270/548] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:23.168741 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702595f-57ce-4911-85fb-4eb884ce27d2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:23.169739 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565484e4-b11a-4759-a7a1-82b211426af6 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:23.171150 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702595f-57ce-4911-85fb-4eb884ce27d2 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:23.181194 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565484e4-b11a-4759-a7a1-82b211426af6 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:23.186701 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13488ad9-a134-41aa-a76e-8fb79f9f0533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:23.187358 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13488ad9-a134-41aa-a76e-8fb79f9f0533 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.187634 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13488ad9-a134-41aa-a76e-8fb79f9f0533 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.187907 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13488ad9-a134-41aa-a76e-8fb79f9f0533 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.188682 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13488ad9-a134-41aa-a76e-8fb79f9f0533 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:23.188973 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13488ad9-a134-41aa-a76e-8fb79f9f0533 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:23.190463 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-c702595f-57ce-4911-85fb-4eb884ce27d2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:23.190571 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13488ad9-a134-41aa-a76e-8fb79f9f0533 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:23.192317 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 279/549] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:23.193355 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702595f-57ce-4911-85fb-4eb884ce27d2 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:23.203093 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 271/550] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:23.203618 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702595f-57ce-4911-85fb-4eb884ce27d2 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:23.203984 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13488ad9-a134-41aa-a76e-8fb79f9f0533 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:23.209297 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558276a8-f358-492b-b8b3-d46b8e63d266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:23.210344 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558276a8-f358-492b-b8b3-d46b8e63d266 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.210834 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558276a8-f358-492b-b8b3-d46b8e63d266 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.211214 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558276a8-f358-492b-b8b3-d46b8e63d266 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.215612 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13488ad9-a134-41aa-a76e-8fb79f9f0533 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:23.221682 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cb9ee-28e2-42a1-8f37-854f7cb9c7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:23.222345 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cb9ee-28e2-42a1-8f37-854f7cb9c7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.222624 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cb9ee-28e2-42a1-8f37-854f7cb9c7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.222896 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cb9ee-28e2-42a1-8f37-854f7cb9c7d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.223605 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77cb9ee-28e2-42a1-8f37-854f7cb9c7d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:23.223911 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77cb9ee-28e2-42a1-8f37-854f7cb9c7d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:23.224005 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558276a8-f358-492b-b8b3-d46b8e63d266 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:23.226173 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77cb9ee-28e2-42a1-8f37-854f7cb9c7d3 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:23.230982 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-558276a8-f358-492b-b8b3-d46b8e63d266 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 02:55:23.232332 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 280/551] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 23 02:55:23 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:23.233040 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558276a8-f358-492b-b8b3-d46b8e63d266 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:23.240522 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 272/552] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:23.241394 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cb9ee-28e2-42a1-8f37-854f7cb9c7d3 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:23.251943 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cb9ee-28e2-42a1-8f37-854f7cb9c7d3 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:23.253080 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558276a8-f358-492b-b8b3-d46b8e63d266 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:23.256925 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc0f01-8b67-4d94-865e-7f877535fd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:23.257705 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c750e-b793-4ab8-b73b-c9aacd96cc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:23.257823 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc0f01-8b67-4d94-865e-7f877535fd53 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.258015 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc0f01-8b67-4d94-865e-7f877535fd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.258269 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc0f01-8b67-4d94-865e-7f877535fd53 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.258496 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c750e-b793-4ab8-b73b-c9aacd96cc92 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.258781 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c750e-b793-4ab8-b73b-c9aacd96cc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.259054 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc0f01-8b67-4d94-865e-7f877535fd53 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:23.259148 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c750e-b793-4ab8-b73b-c9aacd96cc92 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.259357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc0f01-8b67-4d94-865e-7f877535fd53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:23.261254 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc0f01-8b67-4d94-865e-7f877535fd53 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:23.267546 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c750e-b793-4ab8-b73b-c9aacd96cc92 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:23.269587 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c750e-b793-4ab8-b73b-c9aacd96cc92 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:23.271000 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 273/553] 10.222.0.23 () {56 vars in 1125 bytes} [Thu Sep 23 02:55:23 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:23.272739 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc0f01-8b67-4d94-865e-7f877535fd53 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:23.283332 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc0f01-8b67-4d94-865e-7f877535fd53 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:23.288899 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99587855-e820-4e78-8584-1d7ac5719eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:23.288899 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99587855-e820-4e78-8584-1d7ac5719eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.291281 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99587855-e820-4e78-8584-1d7ac5719eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.291281 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99587855-e820-4e78-8584-1d7ac5719eb7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.292421 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-b89c750e-b793-4ab8-b73b-c9aacd96cc92 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 23 02:55:23.293965 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 281/554] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 23 02:55:23 2021] GET /identity/v3/users/neutron => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:23.294857 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c750e-b793-4ab8-b73b-c9aacd96cc92 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:23.299123 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99587855-e820-4e78-8584-1d7ac5719eb7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:23.301332 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99587855-e820-4e78-8584-1d7ac5719eb7 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:23.304820 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c750e-b793-4ab8-b73b-c9aacd96cc92 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:23.309697 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bc565-ef1c-442f-927d-27b6d96c43b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:23.310484 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bc565-ef1c-442f-927d-27b6d96c43b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.310767 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bc565-ef1c-442f-927d-27b6d96c43b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.311576 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bc565-ef1c-442f-927d-27b6d96c43b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.316754 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-99587855-e820-4e78-8584-1d7ac5719eb7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:23.318460 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 274/555] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:23.319458 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99587855-e820-4e78-8584-1d7ac5719eb7 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:23.322636 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67bc565-ef1c-442f-927d-27b6d96c43b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:23.324816 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67bc565-ef1c-442f-927d-27b6d96c43b1 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:23.329695 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99587855-e820-4e78-8584-1d7ac5719eb7 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:23.334275 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031b3ce-162c-43b3-b160-426d60f2cf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:23.335116 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031b3ce-162c-43b3-b160-426d60f2cf3e admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.335567 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031b3ce-162c-43b3-b160-426d60f2cf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.336012 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031b3ce-162c-43b3-b160-426d60f2cf3e admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.337056 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031b3ce-162c-43b3-b160-426d60f2cf3e admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:23.337537 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031b3ce-162c-43b3-b160-426d60f2cf3e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:23.339550 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031b3ce-162c-43b3-b160-426d60f2cf3e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:23.341055 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-b67bc565-ef1c-442f-927d-27b6d96c43b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:23.342871 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 282/556] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:23.343635 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bc565-ef1c-442f-927d-27b6d96c43b1 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:23.354778 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bc565-ef1c-442f-927d-27b6d96c43b1 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:23.359507 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 275/557] 10.222.0.23 () {56 vars in 1161 bytes} [Thu Sep 23 02:55:23 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:23.360162 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076c1bf-1195-497d-b659-e89b83c349bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:23.360834 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031b3ce-162c-43b3-b160-426d60f2cf3e admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:23.364891 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076c1bf-1195-497d-b659-e89b83c349bd admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.365433 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076c1bf-1195-497d-b659-e89b83c349bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.366306 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076c1bf-1195-497d-b659-e89b83c349bd admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.369402 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076c1bf-1195-497d-b659-e89b83c349bd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:23.369881 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076c1bf-1195-497d-b659-e89b83c349bd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:23.372781 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076c1bf-1195-497d-b659-e89b83c349bd admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:23.375442 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031b3ce-162c-43b3-b160-426d60f2cf3e admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:23.380654 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850127d9-1387-43d7-8a02-e7ee77ba1b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:23.381336 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850127d9-1387-43d7-8a02-e7ee77ba1b7a admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.382092 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850127d9-1387-43d7-8a02-e7ee77ba1b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.382092 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850127d9-1387-43d7-8a02-e7ee77ba1b7a admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.382840 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850127d9-1387-43d7-8a02-e7ee77ba1b7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:23.383297 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850127d9-1387-43d7-8a02-e7ee77ba1b7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:23.385014 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850127d9-1387-43d7-8a02-e7ee77ba1b7a admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:23.388518 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 283/558] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:23.390079 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076c1bf-1195-497d-b659-e89b83c349bd admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:23.398373 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 276/559] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:23.399370 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850127d9-1387-43d7-8a02-e7ee77ba1b7a admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:23.401723 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076c1bf-1195-497d-b659-e89b83c349bd admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:23.407488 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ff8fc-bb0a-4458-8a93-14300e05acec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:23.408352 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ff8fc-bb0a-4458-8a93-14300e05acec admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.408803 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ff8fc-bb0a-4458-8a93-14300e05acec admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.409224 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ff8fc-bb0a-4458-8a93-14300e05acec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.409792 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850127d9-1387-43d7-8a02-e7ee77ba1b7a admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:23.414631 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bfc1d-30ae-4f33-a708-cdb4282fd4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:23.415354 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bfc1d-30ae-4f33-a708-cdb4282fd4bc admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.415726 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bfc1d-30ae-4f33-a708-cdb4282fd4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.416068 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bfc1d-30ae-4f33-a708-cdb4282fd4bc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.417076 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bfc1d-30ae-4f33-a708-cdb4282fd4bc admin admin] RBAC: Adding query filter params (role.id=8e064794445b4039b2cf2d06b26b49de, scope.project.id=73dcb70ac3714a428a717707e6be8201, user.id=5a435fd22fdc4160888f942e634c0a08) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:23.417454 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bfc1d-30ae-4f33-a708-cdb4282fd4bc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:23.419202 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ff8fc-bb0a-4458-8a93-14300e05acec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:23.419585 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bfc1d-30ae-4f33-a708-cdb4282fd4bc admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:23.421876 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ff8fc-bb0a-4458-8a93-14300e05acec admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:23.426391 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 277/560] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:55:23 2021] GET /identity/v3/role_assignments?user.id=5a435fd22fdc4160888f942e634c0a08&scope.project.id=73dcb70ac3714a428a717707e6be8201&role.id=8e064794445b4039b2cf2d06b26b49de => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:23.427514 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bfc1d-30ae-4f33-a708-cdb4282fd4bc admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:23.433599 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 284/561] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:55:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:55:23.441162 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ff8fc-bb0a-4458-8a93-14300e05acec admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:23.445008 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bfc1d-30ae-4f33-a708-cdb4282fd4bc admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:23.453038 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ff8fc-bb0a-4458-8a93-14300e05acec admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:23.454855 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291821fb-24d0-4926-a01c-01056fef3c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:23.456017 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291821fb-24d0-4926-a01c-01056fef3c3d admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.456527 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291821fb-24d0-4926-a01c-01056fef3c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.456941 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291821fb-24d0-4926-a01c-01056fef3c3d admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.460152 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a9d1b-b105-4f33-94ea-c615ca9163ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:23.460152 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a9d1b-b105-4f33-94ea-c615ca9163ca admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.460152 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a9d1b-b105-4f33-94ea-c615ca9163ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.460152 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a9d1b-b105-4f33-94ea-c615ca9163ca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.477737 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291821fb-24d0-4926-a01c-01056fef3c3d admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:23.481246 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291821fb-24d0-4926-a01c-01056fef3c3d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:23.482248 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a9d1b-b105-4f33-94ea-c615ca9163ca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:23.485292 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a9d1b-b105-4f33-94ea-c615ca9163ca admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:23.508844 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-291821fb-24d0-4926-a01c-01056fef3c3d admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 23 02:55:23.513746 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 278/562] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:55:23 2021] GET /identity/v3/users/swift => generated 83 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:23.519021 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-0e4a9d1b-b105-4f33-94ea-c615ca9163ca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:23.520384 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291821fb-24d0-4926-a01c-01056fef3c3d admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:23.522322 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 285/563] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:23.528988 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a9d1b-b105-4f33-94ea-c615ca9163ca admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:23.538709 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291821fb-24d0-4926-a01c-01056fef3c3d admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:23.547764 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d199f4-b2d7-464d-a9c4-5f64dc84b26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:23.548128 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a9d1b-b105-4f33-94ea-c615ca9163ca admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:23.548922 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d199f4-b2d7-464d-a9c4-5f64dc84b26b admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.549998 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d199f4-b2d7-464d-a9c4-5f64dc84b26b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.550749 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d199f4-b2d7-464d-a9c4-5f64dc84b26b admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.552515 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d199f4-b2d7-464d-a9c4-5f64dc84b26b admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:23.553488 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d199f4-b2d7-464d-a9c4-5f64dc84b26b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:23.557068 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d199f4-b2d7-464d-a9c4-5f64dc84b26b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:23.559214 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816788d7-69d0-43d0-8fc7-5328b0cdf1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:23.560072 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816788d7-69d0-43d0-8fc7-5328b0cdf1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.560989 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816788d7-69d0-43d0-8fc7-5328b0cdf1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.561602 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816788d7-69d0-43d0-8fc7-5328b0cdf1b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.563105 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816788d7-69d0-43d0-8fc7-5328b0cdf1b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:23.564555 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816788d7-69d0-43d0-8fc7-5328b0cdf1b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:23.566325 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816788d7-69d0-43d0-8fc7-5328b0cdf1b6 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:23.591393 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 286/564] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:23.593600 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 279/565] 10.222.0.23 () {56 vars in 1157 bytes} [Thu Sep 23 02:55:23 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:23.600876 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816788d7-69d0-43d0-8fc7-5328b0cdf1b6 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:23.601462 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d199f4-b2d7-464d-a9c4-5f64dc84b26b admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:23.613199 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d199f4-b2d7-464d-a9c4-5f64dc84b26b admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:23.624526 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816788d7-69d0-43d0-8fc7-5328b0cdf1b6 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:23.626260 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff599d8-2624-42dd-8aaa-f537b4059b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:23.626394 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb85aa-9883-4750-8957-91e87f656dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:23.628073 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff599d8-2624-42dd-8aaa-f537b4059b3e admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.628207 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb85aa-9883-4750-8957-91e87f656dad admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.628391 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb85aa-9883-4750-8957-91e87f656dad admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.629934 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff599d8-2624-42dd-8aaa-f537b4059b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.630058 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb85aa-9883-4750-8957-91e87f656dad admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.630130 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff599d8-2624-42dd-8aaa-f537b4059b3e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.645747 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb85aa-9883-4750-8957-91e87f656dad admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:23.647760 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb85aa-9883-4750-8957-91e87f656dad admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:23.651865 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff599d8-2624-42dd-8aaa-f537b4059b3e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:23.653735 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff599d8-2624-42dd-8aaa-f537b4059b3e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:23.664519 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-bcdb85aa-9883-4750-8957-91e87f656dad admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:23.666408 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 280/566] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:23.673493 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb85aa-9883-4750-8957-91e87f656dad admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:23.679768 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-5ff599d8-2624-42dd-8aaa-f537b4059b3e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:23.679768 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 287/567] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:23.687744 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb85aa-9883-4750-8957-91e87f656dad admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:23.692137 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff599d8-2624-42dd-8aaa-f537b4059b3e admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:23.692561 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8e3ec-2285-4832-b096-de58ab80ced2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:23.693229 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8e3ec-2285-4832-b096-de58ab80ced2 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.693509 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8e3ec-2285-4832-b096-de58ab80ced2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.693785 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8e3ec-2285-4832-b096-de58ab80ced2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.694569 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8e3ec-2285-4832-b096-de58ab80ced2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:23.694876 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8e3ec-2285-4832-b096-de58ab80ced2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:23.696740 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8e3ec-2285-4832-b096-de58ab80ced2 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:23.703528 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff599d8-2624-42dd-8aaa-f537b4059b3e admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:23.710488 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 281/568] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:23.720011 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dbaf3-8a4a-4bb5-87af-652c3f36d83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:23.720925 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dbaf3-8a4a-4bb5-87af-652c3f36d83f admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.721144 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8e3ec-2285-4832-b096-de58ab80ced2 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:23.721562 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dbaf3-8a4a-4bb5-87af-652c3f36d83f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.721976 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dbaf3-8a4a-4bb5-87af-652c3f36d83f admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.722900 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469dbaf3-8a4a-4bb5-87af-652c3f36d83f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:23.723366 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469dbaf3-8a4a-4bb5-87af-652c3f36d83f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:23.725189 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469dbaf3-8a4a-4bb5-87af-652c3f36d83f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:23.731914 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8e3ec-2285-4832-b096-de58ab80ced2 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:23.742385 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 288/569] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:23.743261 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4e246-3822-4b7b-b70d-e583afb29a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:23.744049 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4e246-3822-4b7b-b70d-e583afb29a12 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.744464 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4e246-3822-4b7b-b70d-e583afb29a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.744900 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4e246-3822-4b7b-b70d-e583afb29a12 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.745845 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4e246-3822-4b7b-b70d-e583afb29a12 admin admin] RBAC: Adding query filter params (role.id=8e064794445b4039b2cf2d06b26b49de, scope.project.id=73dcb70ac3714a428a717707e6be8201, user.id=621e97bd0914448c8afadba25510053d) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:23.746259 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4e246-3822-4b7b-b70d-e583afb29a12 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:23.748047 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dbaf3-8a4a-4bb5-87af-652c3f36d83f admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:23.749287 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4e246-3822-4b7b-b70d-e583afb29a12 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:23.756742 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 282/570] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:55:23 2021] GET /identity/v3/role_assignments?user.id=621e97bd0914448c8afadba25510053d&scope.project.id=73dcb70ac3714a428a717707e6be8201&role.id=8e064794445b4039b2cf2d06b26b49de => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:23.763370 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dbaf3-8a4a-4bb5-87af-652c3f36d83f admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:23.770768 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95bfa3-dd4b-453c-994a-9c5dbd34ed8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:23.771775 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95bfa3-dd4b-453c-994a-9c5dbd34ed8c admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.772060 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95bfa3-dd4b-453c-994a-9c5dbd34ed8c admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.772333 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95bfa3-dd4b-453c-994a-9c5dbd34ed8c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.782425 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95bfa3-dd4b-453c-994a-9c5dbd34ed8c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:23.784464 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95bfa3-dd4b-453c-994a-9c5dbd34ed8c admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:23.798936 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-1d95bfa3-dd4b-453c-994a-9c5dbd34ed8c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:23.800617 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 289/571] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:23.806741 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4e246-3822-4b7b-b70d-e583afb29a12 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:23.821986 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4e246-3822-4b7b-b70d-e583afb29a12 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:23.827087 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f51d1-79c2-4f13-9f03-2b1947d1cdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:23.827769 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f51d1-79c2-4f13-9f03-2b1947d1cdd7 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.828102 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f51d1-79c2-4f13-9f03-2b1947d1cdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.828383 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f51d1-79c2-4f13-9f03-2b1947d1cdd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.829270 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f51d1-79c2-4f13-9f03-2b1947d1cdd7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:23.829578 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f51d1-79c2-4f13-9f03-2b1947d1cdd7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:23.831926 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f51d1-79c2-4f13-9f03-2b1947d1cdd7 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:23.849115 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 283/572] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:23.855386 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95bfa3-dd4b-453c-994a-9c5dbd34ed8c admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:23.871357 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95bfa3-dd4b-453c-994a-9c5dbd34ed8c admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:23.881825 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffa0ce-6b67-442c-9192-7058ee4f9bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:23.882754 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffa0ce-6b67-442c-9192-7058ee4f9bf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:23.883033 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffa0ce-6b67-442c-9192-7058ee4f9bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:23.883304 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffa0ce-6b67-442c-9192-7058ee4f9bf1 admin admin] PATH_INFO: `/v3/projects/73dcb70ac3714a428a717707e6be8201/users/df051fd059b34fe0993f501546d1610f/roles/8e064794445b4039b2cf2d06b26b49de` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:23.905887 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffa0ce-6b67-442c-9192-7058ee4f9bf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73dcb70ac3714a428a717707e6be8201, user_id=df051fd059b34fe0993f501546d1610f, role_id=8e064794445b4039b2cf2d06b26b49de)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:23.908464 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffa0ce-6b67-442c-9192-7058ee4f9bf1 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:23.985999 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 290/573] 10.222.0.23 () {58 vars in 1461 bytes} [Thu Sep 23 02:55:23 2021] PUT /identity/v3/projects/73dcb70ac3714a428a717707e6be8201/users/df051fd059b34fe0993f501546d1610f/roles/8e064794445b4039b2cf2d06b26b49de => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 02:55:24.740622 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37474699-3045-443c-b32d-2641684c2804 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:24.741469 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37474699-3045-443c-b32d-2641684c2804 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:24.741913 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37474699-3045-443c-b32d-2641684c2804 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:24.744093 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 284/574] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:24.773562 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3c75e-8af3-4c8a-9e9d-d77a8bc9ecf6 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:24.774071 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3c75e-8af3-4c8a-9e9d-d77a8bc9ecf6 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:24.774154 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3c75e-8af3-4c8a-9e9d-d77a8bc9ecf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:24.801459 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-07d3c75e-8af3-4c8a-9e9d-d77a8bc9ecf6 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:24.802668 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-07d3c75e-8af3-4c8a-9e9d-d77a8bc9ecf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:24.884128 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 291/575] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:24.930013 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37474699-3045-443c-b32d-2641684c2804 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:24.946991 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37474699-3045-443c-b32d-2641684c2804 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:24.956529 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff32073-6304-4e11-a282-582f146db536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:24.957608 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff32073-6304-4e11-a282-582f146db536 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:24.958107 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff32073-6304-4e11-a282-582f146db536 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:24.958606 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff32073-6304-4e11-a282-582f146db536 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:24.984285 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff32073-6304-4e11-a282-582f146db536 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:24.991535 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-fff32073-6304-4e11-a282-582f146db536 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:55:24.993334 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 285/576] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:55:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:25.000475 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3c75e-8af3-4c8a-9e9d-d77a8bc9ecf6 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:25.014397 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3c75e-8af3-4c8a-9e9d-d77a8bc9ecf6 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:25.025206 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf760cb-cea8-4748-9aa4-7edfd44d3cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:25.025913 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf760cb-cea8-4748-9aa4-7edfd44d3cba admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:25.026203 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf760cb-cea8-4748-9aa4-7edfd44d3cba admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:25.026474 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf760cb-cea8-4748-9aa4-7edfd44d3cba admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:25.027243 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf760cb-cea8-4748-9aa4-7edfd44d3cba admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:25.027553 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf760cb-cea8-4748-9aa4-7edfd44d3cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:25.029231 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf760cb-cea8-4748-9aa4-7edfd44d3cba admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:25.039153 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 292/577] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:55:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:25.045760 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff32073-6304-4e11-a282-582f146db536 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:25.062116 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff32073-6304-4e11-a282-582f146db536 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:25.069752 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8c03f-e09d-4b8a-935e-0410bcabd07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:25.070897 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8c03f-e09d-4b8a-935e-0410bcabd07c admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:25.071389 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8c03f-e09d-4b8a-935e-0410bcabd07c admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:25.071868 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8c03f-e09d-4b8a-935e-0410bcabd07c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:25.094582 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8c03f-e09d-4b8a-935e-0410bcabd07c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:25.096828 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8c03f-e09d-4b8a-935e-0410bcabd07c admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:25.127378 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-d3a8c03f-e09d-4b8a-935e-0410bcabd07c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:25.129660 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 286/578] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:25.135559 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf760cb-cea8-4748-9aa4-7edfd44d3cba admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:25.153464 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf760cb-cea8-4748-9aa4-7edfd44d3cba admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:25.166039 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371b422-e8e2-4276-bb8b-7f71797887c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:25.166766 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371b422-e8e2-4276-bb8b-7f71797887c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:25.167057 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371b422-e8e2-4276-bb8b-7f71797887c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:25.167337 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371b422-e8e2-4276-bb8b-7f71797887c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:25.168064 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371b422-e8e2-4276-bb8b-7f71797887c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:25.168375 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371b422-e8e2-4276-bb8b-7f71797887c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:25.169996 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371b422-e8e2-4276-bb8b-7f71797887c2 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:25.190147 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 293/579] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:25.196002 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8c03f-e09d-4b8a-935e-0410bcabd07c admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:25.209361 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8c03f-e09d-4b8a-935e-0410bcabd07c admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:25.216473 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05831f01-b758-451d-9d09-ca1173fcb7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:25.217607 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05831f01-b758-451d-9d09-ca1173fcb7ff admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:25.218089 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05831f01-b758-451d-9d09-ca1173fcb7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:25.218571 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05831f01-b758-451d-9d09-ca1173fcb7ff admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:25.234102 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05831f01-b758-451d-9d09-ca1173fcb7ff admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:25.236449 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05831f01-b758-451d-9d09-ca1173fcb7ff admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:25.259921 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-05831f01-b758-451d-9d09-ca1173fcb7ff admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 02:55:25.261456 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 287/580] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Sep 23 02:55:25 2021] GET /identity/v3/users/nova => generated 82 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:25.268023 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371b422-e8e2-4276-bb8b-7f71797887c2 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:25.282079 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371b422-e8e2-4276-bb8b-7f71797887c2 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:25.294457 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daef0d3-fe8f-4354-91f9-91eae32ec9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:25.295197 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daef0d3-fe8f-4354-91f9-91eae32ec9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:25.295482 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daef0d3-fe8f-4354-91f9-91eae32ec9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:25.295762 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daef0d3-fe8f-4354-91f9-91eae32ec9a8 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:25.296636 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daef0d3-fe8f-4354-91f9-91eae32ec9a8 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:25.296952 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daef0d3-fe8f-4354-91f9-91eae32ec9a8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:25.298797 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daef0d3-fe8f-4354-91f9-91eae32ec9a8 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:25.327767 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 294/581] 10.222.0.23 () {56 vars in 1155 bytes} [Thu Sep 23 02:55:25 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:25.333807 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05831f01-b758-451d-9d09-ca1173fcb7ff admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:25.359525 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05831f01-b758-451d-9d09-ca1173fcb7ff admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:25.368582 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d1ee7-337c-4bc1-8b9b-0f4b9159043b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:25.369503 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d1ee7-337c-4bc1-8b9b-0f4b9159043b admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:25.369994 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d1ee7-337c-4bc1-8b9b-0f4b9159043b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:25.370466 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d1ee7-337c-4bc1-8b9b-0f4b9159043b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:25.388397 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d1ee7-337c-4bc1-8b9b-0f4b9159043b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:25.390578 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d1ee7-337c-4bc1-8b9b-0f4b9159043b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:25.402129 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 288/582] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:55:25 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:55:25.408982 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daef0d3-fe8f-4354-91f9-91eae32ec9a8 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:25.428024 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daef0d3-fe8f-4354-91f9-91eae32ec9a8 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:25.441844 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fce24a-4a0d-4451-8a3d-b7081ebbd56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:25.442687 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fce24a-4a0d-4451-8a3d-b7081ebbd56e admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:25.442972 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fce24a-4a0d-4451-8a3d-b7081ebbd56e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:25.443254 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fce24a-4a0d-4451-8a3d-b7081ebbd56e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:25.464482 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fce24a-4a0d-4451-8a3d-b7081ebbd56e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:25.466351 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fce24a-4a0d-4451-8a3d-b7081ebbd56e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:25.495490 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-b3fce24a-4a0d-4451-8a3d-b7081ebbd56e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:25.497127 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 295/583] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:25.503691 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d1ee7-337c-4bc1-8b9b-0f4b9159043b admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:25.522824 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d1ee7-337c-4bc1-8b9b-0f4b9159043b admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:25.530099 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213f88a-0c3c-4486-9d0e-4ddcb6652f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:25.530767 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213f88a-0c3c-4486-9d0e-4ddcb6652f10 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:25.531046 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213f88a-0c3c-4486-9d0e-4ddcb6652f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:25.531322 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213f88a-0c3c-4486-9d0e-4ddcb6652f10 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:25.532040 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213f88a-0c3c-4486-9d0e-4ddcb6652f10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:25.532340 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213f88a-0c3c-4486-9d0e-4ddcb6652f10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:25.533960 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213f88a-0c3c-4486-9d0e-4ddcb6652f10 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:25.557887 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 289/584] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:25.564418 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fce24a-4a0d-4451-8a3d-b7081ebbd56e admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:25.577694 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fce24a-4a0d-4451-8a3d-b7081ebbd56e admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:25.585528 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dde3a5-361e-41f2-ae5b-ccb7963edcec None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:25.586135 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dde3a5-361e-41f2-ae5b-ccb7963edcec None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:25.586628 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dde3a5-361e-41f2-ae5b-ccb7963edcec None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:25.589162 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 290/585] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:25 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 02:55:25.592511 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c905d3-8c05-40f3-b030-9994e199a1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:25.592511 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c905d3-8c05-40f3-b030-9994e199a1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:25.592511 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c905d3-8c05-40f3-b030-9994e199a1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:25.592511 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c905d3-8c05-40f3-b030-9994e199a1d3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:25.601307 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbface-a04c-447f-a27f-fb961f6b9784 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:25.602202 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbface-a04c-447f-a27f-fb961f6b9784 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:25.602708 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbface-a04c-447f-a27f-fb961f6b9784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:25.604148 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c905d3-8c05-40f3-b030-9994e199a1d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:25.608349 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c905d3-8c05-40f3-b030-9994e199a1d3 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:25.635369 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-39c905d3-8c05-40f3-b030-9994e199a1d3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:25.641934 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 296/586] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:25.642969 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-3cdbface-a04c-447f-a27f-fb961f6b9784 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:25.644740 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c905d3-8c05-40f3-b030-9994e199a1d3 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:25.646216 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-3cdbface-a04c-447f-a27f-fb961f6b9784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:25.659993 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c905d3-8c05-40f3-b030-9994e199a1d3 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:25.665928 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 291/587] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:25.668867 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1999b59-60df-4784-a798-878d063e2720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:25.669606 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1999b59-60df-4784-a798-878d063e2720 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:25.670004 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1999b59-60df-4784-a798-878d063e2720 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:25.670374 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1999b59-60df-4784-a798-878d063e2720 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:25.671291 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1999b59-60df-4784-a798-878d063e2720 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:25.671666 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1999b59-60df-4784-a798-878d063e2720 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:25.673812 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1999b59-60df-4784-a798-878d063e2720 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:25.690298 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 297/588] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:25 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:25.696454 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdbface-a04c-447f-a27f-fb961f6b9784 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:25.704607 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1999b59-60df-4784-a798-878d063e2720 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:25.707829 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdbface-a04c-447f-a27f-fb961f6b9784 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:25.712760 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c3578-2f27-46ef-ab50-02d5e49833d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:25.713487 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c3578-2f27-46ef-ab50-02d5e49833d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:25.713757 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c3578-2f27-46ef-ab50-02d5e49833d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:25.714092 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c3578-2f27-46ef-ab50-02d5e49833d3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:25.714925 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c3578-2f27-46ef-ab50-02d5e49833d3 admin admin] RBAC: Adding query filter params (role.id=3e7d7427203a4a4097e2c9a642b9bf69, scope.project.id=73dcb70ac3714a428a717707e6be8201, user.id=83aa47f723434143b22aac1b96b6a610) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:25.720614 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c3578-2f27-46ef-ab50-02d5e49833d3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:25.720614 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c3578-2f27-46ef-ab50-02d5e49833d3 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:25.722200 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1999b59-60df-4784-a798-878d063e2720 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:25.725017 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 292/589] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:55:25 2021] GET /identity/v3/role_assignments?user.id=83aa47f723434143b22aac1b96b6a610&scope.project.id=73dcb70ac3714a428a717707e6be8201&role.id=3e7d7427203a4a4097e2c9a642b9bf69 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:25.728824 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6de51f-6336-4e3a-90c6-99b5f7e733b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:25.729649 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6de51f-6336-4e3a-90c6-99b5f7e733b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:25.730025 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6de51f-6336-4e3a-90c6-99b5f7e733b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:25.730309 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6de51f-6336-4e3a-90c6-99b5f7e733b7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:25.742943 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6de51f-6336-4e3a-90c6-99b5f7e733b7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:25.744948 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6de51f-6336-4e3a-90c6-99b5f7e733b7 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:25.762145 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-0e6de51f-6336-4e3a-90c6-99b5f7e733b7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:25.764558 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 298/590] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:25.770944 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c3578-2f27-46ef-ab50-02d5e49833d3 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:25.786928 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c3578-2f27-46ef-ab50-02d5e49833d3 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:25.797990 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd32faa-caf8-4126-83ab-e0bf601510d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:25.798692 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd32faa-caf8-4126-83ab-e0bf601510d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:25.798973 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd32faa-caf8-4126-83ab-e0bf601510d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:25.799249 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd32faa-caf8-4126-83ab-e0bf601510d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:25.799995 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd32faa-caf8-4126-83ab-e0bf601510d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:25.800306 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd32faa-caf8-4126-83ab-e0bf601510d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:25.802010 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd32faa-caf8-4126-83ab-e0bf601510d8 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:25.823409 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 293/591] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:25.829404 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6de51f-6336-4e3a-90c6-99b5f7e733b7 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:25.846027 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6de51f-6336-4e3a-90c6-99b5f7e733b7 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:25.857171 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31b8e1-7924-4bdd-9a39-321972b3229a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:25.858569 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31b8e1-7924-4bdd-9a39-321972b3229a admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:25.858950 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31b8e1-7924-4bdd-9a39-321972b3229a admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:25.859379 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31b8e1-7924-4bdd-9a39-321972b3229a admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:25.860257 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31b8e1-7924-4bdd-9a39-321972b3229a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:25.862440 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31b8e1-7924-4bdd-9a39-321972b3229a admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:25.954378 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 299/592] 10.222.0.23 () {60 vars in 1154 bytes} [Thu Sep 23 02:55:25 2021] POST /identity/v3/users => generated 254 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 02:55:26.298527 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721feae-cea5-4fb2-ab71-8e4b5500e3bb None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:26.298926 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721feae-cea5-4fb2-ab71-8e4b5500e3bb None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:26.299110 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721feae-cea5-4fb2-ab71-8e4b5500e3bb None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:26.301230 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 294/593] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:26.309704 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1609451-84d9-4546-8945-3d2f0dabaee4 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:26.310010 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1609451-84d9-4546-8945-3d2f0dabaee4 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:26.310447 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1609451-84d9-4546-8945-3d2f0dabaee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:26.332732 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-e1609451-84d9-4546-8945-3d2f0dabaee4 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:26.333941 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-e1609451-84d9-4546-8945-3d2f0dabaee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:26.346297 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 300/594] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:26.374814 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721feae-cea5-4fb2-ab71-8e4b5500e3bb None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:26.391939 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721feae-cea5-4fb2-ab71-8e4b5500e3bb None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:26.396249 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19b1fc-2504-435b-ba67-daa27795e4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:26.397094 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19b1fc-2504-435b-ba67-daa27795e4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:26.397380 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19b1fc-2504-435b-ba67-daa27795e4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:26.397663 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19b1fc-2504-435b-ba67-daa27795e4e5 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:26.398320 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19b1fc-2504-435b-ba67-daa27795e4e5 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:26.399392 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING py.warnings [None req-2b19b1fc-2504-435b-ba67-daa27795e4e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:55:26.399392 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: warnings.warn(msg) Sep 23 02:55:26.399392 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: Sep 23 02:55:26.400325 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19b1fc-2504-435b-ba67-daa27795e4e5 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:26.414813 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-2b19b1fc-2504-435b-ba67-daa27795e4e5 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 02:55:26.416017 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 295/595] 10.222.0.23 () {56 vars in 1151 bytes} [Thu Sep 23 02:55:26 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:26.424631 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1609451-84d9-4546-8945-3d2f0dabaee4 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:26.433882 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1609451-84d9-4546-8945-3d2f0dabaee4 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:26.440799 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e02aee-2333-4006-b798-264c9cb3c560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:26.441534 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e02aee-2333-4006-b798-264c9cb3c560 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:26.441817 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e02aee-2333-4006-b798-264c9cb3c560 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:26.442147 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e02aee-2333-4006-b798-264c9cb3c560 admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:26.442864 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e02aee-2333-4006-b798-264c9cb3c560 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:26.443171 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e02aee-2333-4006-b798-264c9cb3c560 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:26.444190 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING py.warnings [None req-d6e02aee-2333-4006-b798-264c9cb3c560 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:55:26.444190 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: warnings.warn(msg) Sep 23 02:55:26.444190 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: Sep 23 02:55:26.445105 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e02aee-2333-4006-b798-264c9cb3c560 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:26.451969 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 301/596] 10.222.0.23 () {56 vars in 1146 bytes} [Thu Sep 23 02:55:26 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:26.458187 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19b1fc-2504-435b-ba67-daa27795e4e5 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:26.469584 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19b1fc-2504-435b-ba67-daa27795e4e5 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:26.476697 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a1d80-17f8-4eb5-8f91-e5a32908f980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:26.477368 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a1d80-17f8-4eb5-8f91-e5a32908f980 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:26.477655 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a1d80-17f8-4eb5-8f91-e5a32908f980 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:26.477938 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a1d80-17f8-4eb5-8f91-e5a32908f980 admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:26.478641 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a1d80-17f8-4eb5-8f91-e5a32908f980 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:26.478952 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a1d80-17f8-4eb5-8f91-e5a32908f980 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:26.479963 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING py.warnings [None req-377a1d80-17f8-4eb5-8f91-e5a32908f980 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:55:26.479963 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: warnings.warn(msg) Sep 23 02:55:26.479963 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: Sep 23 02:55:26.480915 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a1d80-17f8-4eb5-8f91-e5a32908f980 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:26.489640 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 296/597] 10.222.0.23 () {56 vars in 1146 bytes} [Thu Sep 23 02:55:26 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:26.645284 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f747e-0ecd-454a-840b-2f51a970a7b1 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:26.645585 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f747e-0ecd-454a-840b-2f51a970a7b1 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:26.645857 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f747e-0ecd-454a-840b-2f51a970a7b1 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:26.648030 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 302/598] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:26.656054 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba06de-6fbe-4b93-b461-69216497b635 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:26.656367 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba06de-6fbe-4b93-b461-69216497b635 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:26.656653 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba06de-6fbe-4b93-b461-69216497b635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:26.681243 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-95ba06de-6fbe-4b93-b461-69216497b635 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:26.682499 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-95ba06de-6fbe-4b93-b461-69216497b635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:26.693320 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 297/599] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:26.719934 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f747e-0ecd-454a-840b-2f51a970a7b1 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:26.734535 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f747e-0ecd-454a-840b-2f51a970a7b1 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:26.740527 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8b027-e1a3-4cef-bcb0-54929e211dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:26.741618 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8b027-e1a3-4cef-bcb0-54929e211dfb admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:26.742098 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8b027-e1a3-4cef-bcb0-54929e211dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:26.742668 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8b027-e1a3-4cef-bcb0-54929e211dfb admin admin] PATH_INFO: `/v3/services/network` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:26.743562 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8b027-e1a3-4cef-bcb0-54929e211dfb admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:26.744860 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING py.warnings [None req-cfc8b027-e1a3-4cef-bcb0-54929e211dfb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:55:26.744860 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: warnings.warn(msg) Sep 23 02:55:26.744860 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: Sep 23 02:55:26.746416 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8b027-e1a3-4cef-bcb0-54929e211dfb admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:26.758573 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa44f25-1dc1-4992-be13-6fb5b62e8e8d None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:26.758849 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa44f25-1dc1-4992-be13-6fb5b62e8e8d None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:26.759128 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa44f25-1dc1-4992-be13-6fb5b62e8e8d None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:26.760146 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-cfc8b027-e1a3-4cef-bcb0-54929e211dfb admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 02:55:26.761201 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 298/600] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:26.761668 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 303/601] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:26 2021] GET /identity/v3/services/network => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:26.768574 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa44f25-1dc1-4992-be13-6fb5b62e8e8d None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:26.769833 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bbf24-02bc-48c2-a2f6-2d9d6d4e4e1e None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:26.770125 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bbf24-02bc-48c2-a2f6-2d9d6d4e4e1e None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:26.770497 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bbf24-02bc-48c2-a2f6-2d9d6d4e4e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:26.787483 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa44f25-1dc1-4992-be13-6fb5b62e8e8d None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:26.789187 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-e90bbf24-02bc-48c2-a2f6-2d9d6d4e4e1e None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:26.790426 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-e90bbf24-02bc-48c2-a2f6-2d9d6d4e4e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:26.798625 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44cff7-d074-4db7-af64-e06ad8b6d0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:26.798851 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 304/602] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:26.800206 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44cff7-d074-4db7-af64-e06ad8b6d0bb admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:26.800926 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44cff7-d074-4db7-af64-e06ad8b6d0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:26.801623 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44cff7-d074-4db7-af64-e06ad8b6d0bb admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:26.803092 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44cff7-d074-4db7-af64-e06ad8b6d0bb admin admin] RBAC: Adding query filter params (name=network) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:26.803849 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44cff7-d074-4db7-af64-e06ad8b6d0bb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:26.806673 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44cff7-d074-4db7-af64-e06ad8b6d0bb admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:26.813267 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 299/603] 10.222.0.23 () {56 vars in 1134 bytes} [Thu Sep 23 02:55:26 2021] GET /identity/v3/services?name=network => generated 124 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:26.822457 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90bbf24-02bc-48c2-a2f6-2d9d6d4e4e1e None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:26.831184 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90bbf24-02bc-48c2-a2f6-2d9d6d4e4e1e None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:26.835987 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc15fb0-d766-4772-9931-988f2a0e4a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:26.836753 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc15fb0-d766-4772-9931-988f2a0e4a16 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:26.837036 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc15fb0-d766-4772-9931-988f2a0e4a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:26.837310 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc15fb0-d766-4772-9931-988f2a0e4a16 admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:26.838114 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc15fb0-d766-4772-9931-988f2a0e4a16 admin admin] RBAC: Adding query filter params (type=network) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:26.838422 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc15fb0-d766-4772-9931-988f2a0e4a16 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:26.840278 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44cff7-d074-4db7-af64-e06ad8b6d0bb admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:26.840518 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc15fb0-d766-4772-9931-988f2a0e4a16 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:26.848669 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 305/604] 10.222.0.23 () {56 vars in 1134 bytes} [Thu Sep 23 02:55:26 2021] GET /identity/v3/services?type=network => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:26.852140 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44cff7-d074-4db7-af64-e06ad8b6d0bb admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:26.863934 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159a962-6c53-4e88-911c-4225a4d69012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:26.865222 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159a962-6c53-4e88-911c-4225a4d69012 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:26.865732 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159a962-6c53-4e88-911c-4225a4d69012 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:26.866257 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159a962-6c53-4e88-911c-4225a4d69012 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:26.893394 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159a962-6c53-4e88-911c-4225a4d69012 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:26.900995 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-e159a962-6c53-4e88-911c-4225a4d69012 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 02:55:26.902943 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 300/605] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 23 02:55:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:26.909712 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc15fb0-d766-4772-9931-988f2a0e4a16 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:26.928251 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc15fb0-d766-4772-9931-988f2a0e4a16 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:26.945279 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8403af0-6345-4df3-8698-dbbca519c4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:26.946049 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8403af0-6345-4df3-8698-dbbca519c4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:26.946270 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8403af0-6345-4df3-8698-dbbca519c4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:26.946551 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8403af0-6345-4df3-8698-dbbca519c4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:26.947315 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8403af0-6345-4df3-8698-dbbca519c4c9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:26.947624 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8403af0-6345-4df3-8698-dbbca519c4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:26.949276 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8403af0-6345-4df3-8698-dbbca519c4c9 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:26.962986 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 306/606] 10.222.0.23 () {56 vars in 1125 bytes} [Thu Sep 23 02:55:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:26.970099 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159a962-6c53-4e88-911c-4225a4d69012 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:26.985045 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159a962-6c53-4e88-911c-4225a4d69012 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:26.992020 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36996f-93f0-444f-884c-f045e01554a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:26.993251 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36996f-93f0-444f-884c-f045e01554a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:26.993736 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36996f-93f0-444f-884c-f045e01554a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:26.994262 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36996f-93f0-444f-884c-f045e01554a9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:27.009567 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36996f-93f0-444f-884c-f045e01554a9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:27.011825 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36996f-93f0-444f-884c-f045e01554a9 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:27.034437 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-5e36996f-93f0-444f-884c-f045e01554a9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:27.036095 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 301/607] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:27.042655 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8403af0-6345-4df3-8698-dbbca519c4c9 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:27.057167 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8403af0-6345-4df3-8698-dbbca519c4c9 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:27.065148 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b066500-2992-4336-b638-e3c062e7f475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:27.065844 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b066500-2992-4336-b638-e3c062e7f475 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:27.066126 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b066500-2992-4336-b638-e3c062e7f475 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:27.066401 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b066500-2992-4336-b638-e3c062e7f475 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:27.067153 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b066500-2992-4336-b638-e3c062e7f475 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:27.067467 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b066500-2992-4336-b638-e3c062e7f475 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:27.069163 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b066500-2992-4336-b638-e3c062e7f475 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:27.084433 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 307/608] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:27.091213 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36996f-93f0-444f-884c-f045e01554a9 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:27.105914 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36996f-93f0-444f-884c-f045e01554a9 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:27.111988 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d5a7e-e4c5-4f79-ad51-c8896fe13e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:27.112826 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d5a7e-e4c5-4f79-ad51-c8896fe13e00 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:27.113113 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d5a7e-e4c5-4f79-ad51-c8896fe13e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:27.113396 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d5a7e-e4c5-4f79-ad51-c8896fe13e00 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:27.122651 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d5a7e-e4c5-4f79-ad51-c8896fe13e00 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:27.124826 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d5a7e-e4c5-4f79-ad51-c8896fe13e00 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:27.139255 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-0d9d5a7e-e4c5-4f79-ad51-c8896fe13e00 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 23 02:55:27.140801 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 302/609] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:55:27 2021] GET /identity/v3/users/swift => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:27.147118 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b066500-2992-4336-b638-e3c062e7f475 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:27.161515 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b066500-2992-4336-b638-e3c062e7f475 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:27.166354 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577902c4-3f23-404c-b4f2-7a8410c2b214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:27.167253 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577902c4-3f23-404c-b4f2-7a8410c2b214 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:27.167758 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577902c4-3f23-404c-b4f2-7a8410c2b214 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:27.168272 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577902c4-3f23-404c-b4f2-7a8410c2b214 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:27.169393 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577902c4-3f23-404c-b4f2-7a8410c2b214 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:27.169906 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577902c4-3f23-404c-b4f2-7a8410c2b214 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:27.171980 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577902c4-3f23-404c-b4f2-7a8410c2b214 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:27.192927 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 308/610] 10.222.0.23 () {56 vars in 1157 bytes} [Thu Sep 23 02:55:27 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:27.198702 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d5a7e-e4c5-4f79-ad51-c8896fe13e00 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:27.210116 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d5a7e-e4c5-4f79-ad51-c8896fe13e00 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:27.215015 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca82c22-defc-4896-addd-59524b327c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:27.216012 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca82c22-defc-4896-addd-59524b327c8f admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:27.216530 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca82c22-defc-4896-addd-59524b327c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:27.217072 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca82c22-defc-4896-addd-59524b327c8f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:27.225918 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca82c22-defc-4896-addd-59524b327c8f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:27.228023 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca82c22-defc-4896-addd-59524b327c8f admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:27.238410 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 303/611] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:55:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 02:55:27.249869 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577902c4-3f23-404c-b4f2-7a8410c2b214 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:27.262209 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577902c4-3f23-404c-b4f2-7a8410c2b214 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:27.274098 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e0abc-02ee-4214-acaa-dea549686a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:27.275192 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e0abc-02ee-4214-acaa-dea549686a30 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:27.275711 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e0abc-02ee-4214-acaa-dea549686a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:27.276206 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e0abc-02ee-4214-acaa-dea549686a30 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:27.288968 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e0abc-02ee-4214-acaa-dea549686a30 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:27.291219 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e0abc-02ee-4214-acaa-dea549686a30 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:27.311859 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-021e0abc-02ee-4214-acaa-dea549686a30 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:27.313362 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 309/612] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:27.319454 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca82c22-defc-4896-addd-59524b327c8f admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:27.335743 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca82c22-defc-4896-addd-59524b327c8f admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:27.345573 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c456e-ef5a-4ed0-aeae-775df64dacb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:27.348082 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c456e-ef5a-4ed0-aeae-775df64dacb7 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:27.350106 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c456e-ef5a-4ed0-aeae-775df64dacb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:27.350783 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c456e-ef5a-4ed0-aeae-775df64dacb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:27.351852 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c456e-ef5a-4ed0-aeae-775df64dacb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:27.352368 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c456e-ef5a-4ed0-aeae-775df64dacb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:27.354250 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c456e-ef5a-4ed0-aeae-775df64dacb7 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:27.369552 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 304/613] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:27.375859 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e0abc-02ee-4214-acaa-dea549686a30 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:27.397447 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e0abc-02ee-4214-acaa-dea549686a30 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:27.404620 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366eafae-bf56-440f-b78c-e469f500d655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:27.405429 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366eafae-bf56-440f-b78c-e469f500d655 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:27.405704 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366eafae-bf56-440f-b78c-e469f500d655 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:27.405967 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366eafae-bf56-440f-b78c-e469f500d655 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:27.425643 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366eafae-bf56-440f-b78c-e469f500d655 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:27.427532 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366eafae-bf56-440f-b78c-e469f500d655 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:27.443489 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-366eafae-bf56-440f-b78c-e469f500d655 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:27.445000 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 310/614] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:27.450969 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c456e-ef5a-4ed0-aeae-775df64dacb7 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:27.469461 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c456e-ef5a-4ed0-aeae-775df64dacb7 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:27.474331 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd344ee3-1272-4e7d-9d4a-d93cb320b018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:27.475226 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd344ee3-1272-4e7d-9d4a-d93cb320b018 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:27.475650 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd344ee3-1272-4e7d-9d4a-d93cb320b018 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:27.476118 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd344ee3-1272-4e7d-9d4a-d93cb320b018 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:27.477118 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd344ee3-1272-4e7d-9d4a-d93cb320b018 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:27.477568 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd344ee3-1272-4e7d-9d4a-d93cb320b018 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:27.479715 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd344ee3-1272-4e7d-9d4a-d93cb320b018 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:27.494172 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 305/615] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:27.500409 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366eafae-bf56-440f-b78c-e469f500d655 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:27.517234 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366eafae-bf56-440f-b78c-e469f500d655 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:27.541164 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1cc40-3e3a-49e1-a42d-6c664343891c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:27.541991 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1cc40-3e3a-49e1-a42d-6c664343891c admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:27.542380 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1cc40-3e3a-49e1-a42d-6c664343891c admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:27.542759 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1cc40-3e3a-49e1-a42d-6c664343891c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:27.543726 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1cc40-3e3a-49e1-a42d-6c664343891c admin admin] RBAC: Adding query filter params (role.id=8e064794445b4039b2cf2d06b26b49de, scope.project.id=73dcb70ac3714a428a717707e6be8201, user.id=df051fd059b34fe0993f501546d1610f) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:27.544143 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1cc40-3e3a-49e1-a42d-6c664343891c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:27.546154 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1cc40-3e3a-49e1-a42d-6c664343891c admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:27.557303 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 311/616] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:55:27 2021] GET /identity/v3/role_assignments?user.id=df051fd059b34fe0993f501546d1610f&scope.project.id=73dcb70ac3714a428a717707e6be8201&role.id=8e064794445b4039b2cf2d06b26b49de => generated 608 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:28.249460 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d168d-668a-492f-be58-44df06102c03 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:28.250461 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d168d-668a-492f-be58-44df06102c03 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:28.250947 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d168d-668a-492f-be58-44df06102c03 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:28.253248 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 306/617] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:28 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:28.260859 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1750d54-d57e-4c72-92df-a6025cdd1999 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:28.261777 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1750d54-d57e-4c72-92df-a6025cdd1999 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:28.262295 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1750d54-d57e-4c72-92df-a6025cdd1999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:28.281277 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-a1750d54-d57e-4c72-92df-a6025cdd1999 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:28.282802 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-a1750d54-d57e-4c72-92df-a6025cdd1999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:28.290832 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 312/618] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:28.317417 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d168d-668a-492f-be58-44df06102c03 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:28.330386 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d168d-668a-492f-be58-44df06102c03 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:28.335109 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5da66-18f5-4f23-83c6-21bbdd303fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:28.336137 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5da66-18f5-4f23-83c6-21bbdd303fdd admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:28.336667 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5da66-18f5-4f23-83c6-21bbdd303fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:28.337135 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5da66-18f5-4f23-83c6-21bbdd303fdd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:28.348788 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5da66-18f5-4f23-83c6-21bbdd303fdd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:28.355837 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-74b5da66-18f5-4f23-83c6-21bbdd303fdd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:55:28.358196 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 307/619] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:55:28 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:28.364936 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1750d54-d57e-4c72-92df-a6025cdd1999 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:28.377011 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1750d54-d57e-4c72-92df-a6025cdd1999 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:28.382824 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f04e02-7818-44f0-87f5-b71872b761a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:28.383522 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f04e02-7818-44f0-87f5-b71872b761a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:28.383804 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f04e02-7818-44f0-87f5-b71872b761a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:28.384074 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f04e02-7818-44f0-87f5-b71872b761a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:28.384883 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f04e02-7818-44f0-87f5-b71872b761a3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:28.385185 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f04e02-7818-44f0-87f5-b71872b761a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:28.386792 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f04e02-7818-44f0-87f5-b71872b761a3 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:28.402148 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 313/620] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:55:28 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:28.403743 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5da66-18f5-4f23-83c6-21bbdd303fdd admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:28.414882 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5da66-18f5-4f23-83c6-21bbdd303fdd admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:28.419535 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781e8f2-8907-429d-81b6-bb5c2658316f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:28.420993 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781e8f2-8907-429d-81b6-bb5c2658316f admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:28.421277 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781e8f2-8907-429d-81b6-bb5c2658316f admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:28.421546 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781e8f2-8907-429d-81b6-bb5c2658316f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:28.432208 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781e8f2-8907-429d-81b6-bb5c2658316f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:28.434122 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781e8f2-8907-429d-81b6-bb5c2658316f admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:28.451441 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-5781e8f2-8907-429d-81b6-bb5c2658316f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:28.452850 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 308/621] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:28.459186 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f04e02-7818-44f0-87f5-b71872b761a3 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:28.469707 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f04e02-7818-44f0-87f5-b71872b761a3 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:28.474298 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49151a6-989b-4d54-b0cb-49e1bfb4f031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:28.475024 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49151a6-989b-4d54-b0cb-49e1bfb4f031 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:28.475300 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49151a6-989b-4d54-b0cb-49e1bfb4f031 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:28.475575 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49151a6-989b-4d54-b0cb-49e1bfb4f031 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:28.476352 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49151a6-989b-4d54-b0cb-49e1bfb4f031 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:28.476697 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49151a6-989b-4d54-b0cb-49e1bfb4f031 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:28.478404 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49151a6-989b-4d54-b0cb-49e1bfb4f031 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:28.496552 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 314/622] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:28.497954 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781e8f2-8907-429d-81b6-bb5c2658316f admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:28.508968 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781e8f2-8907-429d-81b6-bb5c2658316f admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:28.516933 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c286cbe-f7b7-42ca-a98b-03247b9f247b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:28.517773 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c286cbe-f7b7-42ca-a98b-03247b9f247b admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:28.518097 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c286cbe-f7b7-42ca-a98b-03247b9f247b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:28.518376 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c286cbe-f7b7-42ca-a98b-03247b9f247b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:28.528274 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c286cbe-f7b7-42ca-a98b-03247b9f247b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:28.530976 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c286cbe-f7b7-42ca-a98b-03247b9f247b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:28.544536 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-8c286cbe-f7b7-42ca-a98b-03247b9f247b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 02:55:28.550833 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 309/623] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Sep 23 02:55:28 2021] GET /identity/v3/users/nova => generated 82 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:28.552167 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49151a6-989b-4d54-b0cb-49e1bfb4f031 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:28.562661 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49151a6-989b-4d54-b0cb-49e1bfb4f031 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:28.567184 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3724c-53e7-4840-886b-13e64a73bbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:28.567898 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3724c-53e7-4840-886b-13e64a73bbed admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:28.568173 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3724c-53e7-4840-886b-13e64a73bbed admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:28.568511 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3724c-53e7-4840-886b-13e64a73bbed admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:28.569343 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3724c-53e7-4840-886b-13e64a73bbed admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:28.569645 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3724c-53e7-4840-886b-13e64a73bbed admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:28.571568 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3724c-53e7-4840-886b-13e64a73bbed admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:28.594266 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 315/624] 10.222.0.23 () {56 vars in 1155 bytes} [Thu Sep 23 02:55:28 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:28.600391 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c286cbe-f7b7-42ca-a98b-03247b9f247b admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:28.613603 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c286cbe-f7b7-42ca-a98b-03247b9f247b admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:28.619542 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5063bb-5251-47bc-b089-14ac0b0b9e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:28.620396 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5063bb-5251-47bc-b089-14ac0b0b9e20 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:28.620701 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5063bb-5251-47bc-b089-14ac0b0b9e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:28.620973 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5063bb-5251-47bc-b089-14ac0b0b9e20 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:28.635156 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5063bb-5251-47bc-b089-14ac0b0b9e20 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:28.637091 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5063bb-5251-47bc-b089-14ac0b0b9e20 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:28.657410 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-9b5063bb-5251-47bc-b089-14ac0b0b9e20 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:28.661848 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 310/625] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:28.665236 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3724c-53e7-4840-886b-13e64a73bbed admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:28.675853 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3724c-53e7-4840-886b-13e64a73bbed admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:28.680689 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac75611-6b5d-471e-9649-26ae595a7918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:28.681402 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac75611-6b5d-471e-9649-26ae595a7918 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:28.681760 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac75611-6b5d-471e-9649-26ae595a7918 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:28.682035 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac75611-6b5d-471e-9649-26ae595a7918 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:28.682793 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac75611-6b5d-471e-9649-26ae595a7918 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:28.683104 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac75611-6b5d-471e-9649-26ae595a7918 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:28.684826 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac75611-6b5d-471e-9649-26ae595a7918 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:28.700612 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 316/626] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:28.703847 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5063bb-5251-47bc-b089-14ac0b0b9e20 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:28.713970 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5063bb-5251-47bc-b089-14ac0b0b9e20 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:28.718730 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9481c-691b-414e-bfc2-a00a2d075037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:28.719565 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9481c-691b-414e-bfc2-a00a2d075037 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:28.719846 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9481c-691b-414e-bfc2-a00a2d075037 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:28.720116 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9481c-691b-414e-bfc2-a00a2d075037 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:28.727278 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9481c-691b-414e-bfc2-a00a2d075037 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:28.729385 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9481c-691b-414e-bfc2-a00a2d075037 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:28.743195 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-03c9481c-691b-414e-bfc2-a00a2d075037 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:28.744432 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 311/627] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:28.751524 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac75611-6b5d-471e-9649-26ae595a7918 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:28.761567 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac75611-6b5d-471e-9649-26ae595a7918 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:28.766520 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9973220-39bb-4db5-9193-a564c1005b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:28.767224 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9973220-39bb-4db5-9193-a564c1005b04 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:28.767501 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9973220-39bb-4db5-9193-a564c1005b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:28.767818 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9973220-39bb-4db5-9193-a564c1005b04 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:28.768633 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9973220-39bb-4db5-9193-a564c1005b04 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:28.768941 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9973220-39bb-4db5-9193-a564c1005b04 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:28.770871 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9973220-39bb-4db5-9193-a564c1005b04 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:28.787624 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 317/628] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:28.794334 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9481c-691b-414e-bfc2-a00a2d075037 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:28.808943 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9481c-691b-414e-bfc2-a00a2d075037 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:28.817746 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fc870-592b-4f36-9c9f-1ee202f328f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:28.818642 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fc870-592b-4f36-9c9f-1ee202f328f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:28.818920 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fc870-592b-4f36-9c9f-1ee202f328f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:28.819246 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fc870-592b-4f36-9c9f-1ee202f328f9 admin admin] PATH_INFO: `/v3/projects/73dcb70ac3714a428a717707e6be8201/users/83aa47f723434143b22aac1b96b6a610/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:28.825926 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fc870-592b-4f36-9c9f-1ee202f328f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73dcb70ac3714a428a717707e6be8201, user_id=83aa47f723434143b22aac1b96b6a610, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:28.828741 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fc870-592b-4f36-9c9f-1ee202f328f9 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:28.922637 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 312/629] 10.222.0.23 () {58 vars in 1461 bytes} [Thu Sep 23 02:55:28 2021] PUT /identity/v3/projects/73dcb70ac3714a428a717707e6be8201/users/83aa47f723434143b22aac1b96b6a610/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 02:55:28.956710 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4509e-0713-431b-9daf-758d481ab639 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:28.957084 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4509e-0713-431b-9daf-758d481ab639 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:28.957244 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4509e-0713-431b-9daf-758d481ab639 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:28.959444 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 318/630] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:28.968015 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a549c-fedb-4bd2-bb67-0e75eb2b4eb8 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:28.968317 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a549c-fedb-4bd2-bb67-0e75eb2b4eb8 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:28.968602 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a549c-fedb-4bd2-bb67-0e75eb2b4eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:28.997346 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-114a549c-fedb-4bd2-bb67-0e75eb2b4eb8 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:28.999177 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-114a549c-fedb-4bd2-bb67-0e75eb2b4eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:29.089094 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 313/631] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:29.129099 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4509e-0713-431b-9daf-758d481ab639 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:29.142467 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4509e-0713-431b-9daf-758d481ab639 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:29.146896 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef2ae9-d984-4a46-b206-5d0b599cc8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:29.147691 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef2ae9-d984-4a46-b206-5d0b599cc8bb admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:29.147971 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef2ae9-d984-4a46-b206-5d0b599cc8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:29.148243 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef2ae9-d984-4a46-b206-5d0b599cc8bb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:29.161813 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef2ae9-d984-4a46-b206-5d0b599cc8bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:29.168576 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-30ef2ae9-d984-4a46-b206-5d0b599cc8bb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 02:55:29.170199 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 319/632] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 23 02:55:29 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:29.176631 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a549c-fedb-4bd2-bb67-0e75eb2b4eb8 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:29.186531 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a549c-fedb-4bd2-bb67-0e75eb2b4eb8 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:29.191187 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d3cfb-0aa1-4bf1-bd24-b7df52ea7bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:29.191969 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d3cfb-0aa1-4bf1-bd24-b7df52ea7bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:29.192251 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d3cfb-0aa1-4bf1-bd24-b7df52ea7bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:29.192551 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d3cfb-0aa1-4bf1-bd24-b7df52ea7bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:29.193322 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d3cfb-0aa1-4bf1-bd24-b7df52ea7bc8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:29.193631 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d3cfb-0aa1-4bf1-bd24-b7df52ea7bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:29.195282 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d3cfb-0aa1-4bf1-bd24-b7df52ea7bc8 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:29.205665 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 314/633] 10.222.0.23 () {56 vars in 1125 bytes} [Thu Sep 23 02:55:29 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:29.211959 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef2ae9-d984-4a46-b206-5d0b599cc8bb admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:29.222958 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef2ae9-d984-4a46-b206-5d0b599cc8bb admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:29.228023 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc55d81-51d7-482b-bc26-f9596291e3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:29.228913 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc55d81-51d7-482b-bc26-f9596291e3da admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:29.229192 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc55d81-51d7-482b-bc26-f9596291e3da admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:29.229462 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc55d81-51d7-482b-bc26-f9596291e3da admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:29.241513 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc55d81-51d7-482b-bc26-f9596291e3da admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:29.243444 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc55d81-51d7-482b-bc26-f9596291e3da admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:29.260808 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-6fc55d81-51d7-482b-bc26-f9596291e3da admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:29.262025 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 320/634] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:29.268650 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d3cfb-0aa1-4bf1-bd24-b7df52ea7bc8 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:29.278860 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d3cfb-0aa1-4bf1-bd24-b7df52ea7bc8 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:29.284167 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b9eb9-e1eb-4862-89da-bfa5c8eee11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:29.284964 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b9eb9-e1eb-4862-89da-bfa5c8eee11a admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:29.285249 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b9eb9-e1eb-4862-89da-bfa5c8eee11a admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:29.285529 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b9eb9-e1eb-4862-89da-bfa5c8eee11a admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:29.286312 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b9eb9-e1eb-4862-89da-bfa5c8eee11a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:29.286623 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b9eb9-e1eb-4862-89da-bfa5c8eee11a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:29.288344 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b9eb9-e1eb-4862-89da-bfa5c8eee11a admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:29.301615 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 315/635] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:29.307749 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc55d81-51d7-482b-bc26-f9596291e3da admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:29.318515 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc55d81-51d7-482b-bc26-f9596291e3da admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:29.323272 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a1d19-fdcb-4621-aa73-1cda1e5bd5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:29.326006 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb1dea-de5d-4201-a177-33e336727117 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:29.326355 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb1dea-de5d-4201-a177-33e336727117 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:29.326634 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb1dea-de5d-4201-a177-33e336727117 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:29.328665 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 316/636] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:29.328850 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a1d19-fdcb-4621-aa73-1cda1e5bd5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:29.329000 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a1d19-fdcb-4621-aa73-1cda1e5bd5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:29.329284 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a1d19-fdcb-4621-aa73-1cda1e5bd5e3 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:29.340887 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079d921-b6ed-4d5c-86c7-349b2d59585c None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:29.340887 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079d921-b6ed-4d5c-86c7-349b2d59585c None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:29.340887 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079d921-b6ed-4d5c-86c7-349b2d59585c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:29.345254 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a1d19-fdcb-4621-aa73-1cda1e5bd5e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:29.346061 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a1d19-fdcb-4621-aa73-1cda1e5bd5e3 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:29.369920 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-619a1d19-fdcb-4621-aa73-1cda1e5bd5e3 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 02:55:29.374249 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-c079d921-b6ed-4d5c-86c7-349b2d59585c None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:29.376771 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-c079d921-b6ed-4d5c-86c7-349b2d59585c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:29.377331 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 321/637] 10.222.0.23 () {56 vars in 1139 bytes} [Thu Sep 23 02:55:29 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:29.383316 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a1d19-fdcb-4621-aa73-1cda1e5bd5e3 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:29.394872 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 317/638] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:29.397472 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a1d19-fdcb-4621-aa73-1cda1e5bd5e3 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:29.402292 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52822a5-654a-46f5-8fa0-ebb278ff17e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:29.403306 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52822a5-654a-46f5-8fa0-ebb278ff17e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:29.403785 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52822a5-654a-46f5-8fa0-ebb278ff17e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:29.404349 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52822a5-654a-46f5-8fa0-ebb278ff17e2 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:29.405462 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52822a5-654a-46f5-8fa0-ebb278ff17e2 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:29.406025 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52822a5-654a-46f5-8fa0-ebb278ff17e2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:29.408210 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52822a5-654a-46f5-8fa0-ebb278ff17e2 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:29.427240 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 322/639] 10.222.0.23 () {56 vars in 1171 bytes} [Thu Sep 23 02:55:29 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:29.433181 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079d921-b6ed-4d5c-86c7-349b2d59585c None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:29.440424 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52822a5-654a-46f5-8fa0-ebb278ff17e2 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:29.444765 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079d921-b6ed-4d5c-86c7-349b2d59585c None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:29.454355 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1816a-e26e-42a5-8eea-96757aa16d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:29.456382 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1816a-e26e-42a5-8eea-96757aa16d14 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:29.456890 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1816a-e26e-42a5-8eea-96757aa16d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:29.457865 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1816a-e26e-42a5-8eea-96757aa16d14 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:29.463510 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52822a5-654a-46f5-8fa0-ebb278ff17e2 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:29.473091 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60185b31-fa01-4258-a50a-ba2528f2d756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:29.474589 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1816a-e26e-42a5-8eea-96757aa16d14 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:29.475230 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60185b31-fa01-4258-a50a-ba2528f2d756 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:29.475836 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60185b31-fa01-4258-a50a-ba2528f2d756 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:29.478020 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60185b31-fa01-4258-a50a-ba2528f2d756 admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:29.479029 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60185b31-fa01-4258-a50a-ba2528f2d756 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:29.480261 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING py.warnings [None req-60185b31-fa01-4258-a50a-ba2528f2d756 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:55:29.480261 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: warnings.warn(msg) Sep 23 02:55:29.480261 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: Sep 23 02:55:29.480743 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1816a-e26e-42a5-8eea-96757aa16d14 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:29.486036 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60185b31-fa01-4258-a50a-ba2528f2d756 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:29.495695 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 318/640] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:55:29 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:55:29.504863 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1816a-e26e-42a5-8eea-96757aa16d14 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:29.515631 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1816a-e26e-42a5-8eea-96757aa16d14 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:29.520857 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738fcbc-abc1-47a3-9dfe-23db90f37ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:29.521892 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738fcbc-abc1-47a3-9dfe-23db90f37ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:29.522502 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738fcbc-abc1-47a3-9dfe-23db90f37ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:29.523002 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738fcbc-abc1-47a3-9dfe-23db90f37ea4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:29.534630 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738fcbc-abc1-47a3-9dfe-23db90f37ea4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:29.536891 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738fcbc-abc1-47a3-9dfe-23db90f37ea4 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:29.555329 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-f738fcbc-abc1-47a3-9dfe-23db90f37ea4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:29.557153 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 319/641] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:29.564535 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738fcbc-abc1-47a3-9dfe-23db90f37ea4 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:29.574680 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738fcbc-abc1-47a3-9dfe-23db90f37ea4 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:29.580513 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e9a80-bd97-48e3-8875-9df299809bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:29.581385 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e9a80-bd97-48e3-8875-9df299809bdc admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:29.582607 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e9a80-bd97-48e3-8875-9df299809bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:29.582607 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e9a80-bd97-48e3-8875-9df299809bdc admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:29.583274 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e9a80-bd97-48e3-8875-9df299809bdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:29.583727 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e9a80-bd97-48e3-8875-9df299809bdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:29.585596 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e9a80-bd97-48e3-8875-9df299809bdc admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:29.598375 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 320/642] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:29.605143 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e9a80-bd97-48e3-8875-9df299809bdc admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:29.612079 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 323/643] 10.222.0.23 () {60 vars in 1163 bytes} [Thu Sep 23 02:55:29 2021] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 02:55:29.624658 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e9a80-bd97-48e3-8875-9df299809bdc admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:29.661282 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7eca89-bb15-40a9-91ed-c83fb8436bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:29.662379 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7eca89-bb15-40a9-91ed-c83fb8436bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:29.662839 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7eca89-bb15-40a9-91ed-c83fb8436bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:29.663300 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7eca89-bb15-40a9-91ed-c83fb8436bf3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:29.671786 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7eca89-bb15-40a9-91ed-c83fb8436bf3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:29.674249 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7eca89-bb15-40a9-91ed-c83fb8436bf3 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:29.695203 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-7d7eca89-bb15-40a9-91ed-c83fb8436bf3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:29.697114 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 321/644] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:29.705599 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60185b31-fa01-4258-a50a-ba2528f2d756 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:29.722129 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60185b31-fa01-4258-a50a-ba2528f2d756 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:29.737456 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055be10-4ee8-4bff-ae66-d09363e0d240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:29.738323 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055be10-4ee8-4bff-ae66-d09363e0d240 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:29.738715 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055be10-4ee8-4bff-ae66-d09363e0d240 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:29.739122 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055be10-4ee8-4bff-ae66-d09363e0d240 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:29.740054 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055be10-4ee8-4bff-ae66-d09363e0d240 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:29.740474 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055be10-4ee8-4bff-ae66-d09363e0d240 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:29.742509 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055be10-4ee8-4bff-ae66-d09363e0d240 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:29.757487 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 324/645] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:29.759560 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bde10-cad6-4288-b63f-f8de8c8a5223 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:29.759996 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bde10-cad6-4288-b63f-f8de8c8a5223 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:29.760415 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bde10-cad6-4288-b63f-f8de8c8a5223 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:29.762412 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 322/646] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:29.769965 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055be10-4ee8-4bff-ae66-d09363e0d240 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:29.771368 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10d501-9722-4019-b138-36bbe44276ad None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:29.771839 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10d501-9722-4019-b138-36bbe44276ad None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:29.772250 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10d501-9722-4019-b138-36bbe44276ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:29.780998 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055be10-4ee8-4bff-ae66-d09363e0d240 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:29.786971 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2532045-3d4f-43a9-9b68-e93fe116d6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:29.787755 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2532045-3d4f-43a9-9b68-e93fe116d6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:29.788141 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2532045-3d4f-43a9-9b68-e93fe116d6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:29.788541 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2532045-3d4f-43a9-9b68-e93fe116d6f1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:29.789485 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2532045-3d4f-43a9-9b68-e93fe116d6f1 admin admin] RBAC: Adding query filter params (role.id=8e064794445b4039b2cf2d06b26b49de, scope.project.id=73dcb70ac3714a428a717707e6be8201, user.id=96c9b76133d74b79a0d2da9a884651e1) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:29.789914 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2532045-3d4f-43a9-9b68-e93fe116d6f1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:29.793491 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2532045-3d4f-43a9-9b68-e93fe116d6f1 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:29.799236 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 325/647] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:55:29 2021] GET /identity/v3/role_assignments?user.id=96c9b76133d74b79a0d2da9a884651e1&scope.project.id=73dcb70ac3714a428a717707e6be8201&role.id=8e064794445b4039b2cf2d06b26b49de => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:29.803772 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-0c10d501-9722-4019-b138-36bbe44276ad None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:29.805199 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-0c10d501-9722-4019-b138-36bbe44276ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:29.837588 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 323/648] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:29 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:29.881611 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2532045-3d4f-43a9-9b68-e93fe116d6f1 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:29.892632 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2532045-3d4f-43a9-9b68-e93fe116d6f1 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:29.899359 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3df7e-1d33-4fee-b1c7-5ed27822fa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:29.900208 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3df7e-1d33-4fee-b1c7-5ed27822fa61 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:29.900625 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3df7e-1d33-4fee-b1c7-5ed27822fa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:29.901005 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3df7e-1d33-4fee-b1c7-5ed27822fa61 admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:29.901868 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3df7e-1d33-4fee-b1c7-5ed27822fa61 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:29.903652 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3df7e-1d33-4fee-b1c7-5ed27822fa61 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:29.997910 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 326/649] 10.222.0.23 () {60 vars in 1163 bytes} [Thu Sep 23 02:55:29 2021] POST /identity/v3/services => generated 240 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 02:55:30.854934 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0290a3-ed53-43a0-9091-d563a636f165 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:30.855621 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0290a3-ed53-43a0-9091-d563a636f165 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:30.856276 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0290a3-ed53-43a0-9091-d563a636f165 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:30.860049 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 324/650] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:30 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 02:55:30.868371 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943a8cc-6e94-4d51-be5f-177933611e68 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:30.869057 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943a8cc-6e94-4d51-be5f-177933611e68 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:30.869656 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943a8cc-6e94-4d51-be5f-177933611e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:30.907442 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-3943a8cc-6e94-4d51-be5f-177933611e68 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:30.909696 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-3943a8cc-6e94-4d51-be5f-177933611e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:30.939146 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 327/651] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:30 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:30.982208 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0290a3-ed53-43a0-9091-d563a636f165 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:31.010119 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0290a3-ed53-43a0-9091-d563a636f165 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:31.022496 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce90a47-a09a-48ac-8e67-646efcf86930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:31.024076 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce90a47-a09a-48ac-8e67-646efcf86930 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:31.024810 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce90a47-a09a-48ac-8e67-646efcf86930 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:31.025446 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce90a47-a09a-48ac-8e67-646efcf86930 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:31.045484 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce90a47-a09a-48ac-8e67-646efcf86930 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:31.059441 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-2ce90a47-a09a-48ac-8e67-646efcf86930 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:55:31.062232 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 325/652] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:55:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:31.069587 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943a8cc-6e94-4d51-be5f-177933611e68 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:31.088985 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943a8cc-6e94-4d51-be5f-177933611e68 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:31.101402 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c55877-62c1-498d-a0c2-d25642ae80df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:31.102633 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c55877-62c1-498d-a0c2-d25642ae80df admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:31.103217 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c55877-62c1-498d-a0c2-d25642ae80df admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:31.103799 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c55877-62c1-498d-a0c2-d25642ae80df admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:31.105323 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c55877-62c1-498d-a0c2-d25642ae80df admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:31.105961 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c55877-62c1-498d-a0c2-d25642ae80df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:31.109782 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c55877-62c1-498d-a0c2-d25642ae80df admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:31.130416 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 328/653] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:55:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:31.136913 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce90a47-a09a-48ac-8e67-646efcf86930 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:31.159303 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce90a47-a09a-48ac-8e67-646efcf86930 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:31.171861 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992b04b-5378-4162-9197-8a9e84f259ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:31.173425 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992b04b-5378-4162-9197-8a9e84f259ff admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:31.174019 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992b04b-5378-4162-9197-8a9e84f259ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:31.174600 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992b04b-5378-4162-9197-8a9e84f259ff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:31.201555 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992b04b-5378-4162-9197-8a9e84f259ff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:31.209496 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992b04b-5378-4162-9197-8a9e84f259ff admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:31.242087 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-1992b04b-5378-4162-9197-8a9e84f259ff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:31.244839 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 326/654] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:31.251431 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c55877-62c1-498d-a0c2-d25642ae80df admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:31.273004 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c55877-62c1-498d-a0c2-d25642ae80df admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:31.284909 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cefe77-baa5-429c-9471-72faa0160e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:31.286171 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cefe77-baa5-429c-9471-72faa0160e03 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:31.286762 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cefe77-baa5-429c-9471-72faa0160e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:31.287356 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cefe77-baa5-429c-9471-72faa0160e03 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:31.288857 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cefe77-baa5-429c-9471-72faa0160e03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:31.289503 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cefe77-baa5-429c-9471-72faa0160e03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:31.292675 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cefe77-baa5-429c-9471-72faa0160e03 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:31.313618 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 329/655] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:31.320342 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992b04b-5378-4162-9197-8a9e84f259ff admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:31.345795 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992b04b-5378-4162-9197-8a9e84f259ff admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:31.362352 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b9431-75a2-439d-990d-96579ac91cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:31.363849 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b9431-75a2-439d-990d-96579ac91cca admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:31.364468 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b9431-75a2-439d-990d-96579ac91cca admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:31.365102 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b9431-75a2-439d-990d-96579ac91cca admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:31.383878 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b9431-75a2-439d-990d-96579ac91cca admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:31.388229 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b9431-75a2-439d-990d-96579ac91cca admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:31.422119 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-c47b9431-75a2-439d-990d-96579ac91cca admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 23 02:55:31.424795 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 327/656] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:55:31 2021] GET /identity/v3/users/swift => generated 83 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:31.430742 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cefe77-baa5-429c-9471-72faa0160e03 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:31.444217 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cefe77-baa5-429c-9471-72faa0160e03 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:31.457280 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1ee84-cad1-4d77-80da-120105261985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:31.458192 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1ee84-cad1-4d77-80da-120105261985 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:31.458615 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1ee84-cad1-4d77-80da-120105261985 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:31.459080 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1ee84-cad1-4d77-80da-120105261985 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:31.460051 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1ee84-cad1-4d77-80da-120105261985 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:31.460553 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1ee84-cad1-4d77-80da-120105261985 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:31.462591 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1ee84-cad1-4d77-80da-120105261985 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:31.496053 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 330/657] 10.222.0.23 () {56 vars in 1157 bytes} [Thu Sep 23 02:55:31 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:31.502921 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b9431-75a2-439d-990d-96579ac91cca admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:31.513082 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b9431-75a2-439d-990d-96579ac91cca admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:31.524636 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac27267-c284-4f24-97a3-7b6400191f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:31.525429 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac27267-c284-4f24-97a3-7b6400191f4e admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:31.525807 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac27267-c284-4f24-97a3-7b6400191f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:31.526182 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac27267-c284-4f24-97a3-7b6400191f4e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:31.538929 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac27267-c284-4f24-97a3-7b6400191f4e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:31.540803 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac27267-c284-4f24-97a3-7b6400191f4e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:31.550633 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 328/658] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:55:31 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:55:31.556838 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1ee84-cad1-4d77-80da-120105261985 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:31.566648 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1ee84-cad1-4d77-80da-120105261985 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:31.571277 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce9d5a-9318-4247-9a45-39f3b44018f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:31.572186 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce9d5a-9318-4247-9a45-39f3b44018f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:31.572593 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce9d5a-9318-4247-9a45-39f3b44018f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:31.572968 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce9d5a-9318-4247-9a45-39f3b44018f8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:31.583549 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce9d5a-9318-4247-9a45-39f3b44018f8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:31.585531 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce9d5a-9318-4247-9a45-39f3b44018f8 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:31.607005 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-edce9d5a-9318-4247-9a45-39f3b44018f8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:31.611090 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 331/659] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:31.617101 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac27267-c284-4f24-97a3-7b6400191f4e admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:31.626366 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac27267-c284-4f24-97a3-7b6400191f4e admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:31.631069 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b5c75-e2b7-456e-9300-f0d9b8f82468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:31.631856 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b5c75-e2b7-456e-9300-f0d9b8f82468 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:31.632235 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b5c75-e2b7-456e-9300-f0d9b8f82468 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:31.632649 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b5c75-e2b7-456e-9300-f0d9b8f82468 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:31.633460 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b5c75-e2b7-456e-9300-f0d9b8f82468 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:31.633863 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b5c75-e2b7-456e-9300-f0d9b8f82468 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:31.635532 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b5c75-e2b7-456e-9300-f0d9b8f82468 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:31.649119 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 329/660] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:31.655876 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce9d5a-9318-4247-9a45-39f3b44018f8 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:31.665704 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce9d5a-9318-4247-9a45-39f3b44018f8 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:31.670355 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c828fd-4409-4034-ab23-de80c809af88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:31.671252 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c828fd-4409-4034-ab23-de80c809af88 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:31.671636 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c828fd-4409-4034-ab23-de80c809af88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:31.672004 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c828fd-4409-4034-ab23-de80c809af88 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:31.679261 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c828fd-4409-4034-ab23-de80c809af88 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:31.681518 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c828fd-4409-4034-ab23-de80c809af88 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:31.694525 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-96c828fd-4409-4034-ab23-de80c809af88 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:31.696113 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 332/661] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:31.703153 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b5c75-e2b7-456e-9300-f0d9b8f82468 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:31.713233 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b5c75-e2b7-456e-9300-f0d9b8f82468 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:31.722095 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71bc8f-d2c7-4b82-8534-90c25c4beda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:31.722895 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71bc8f-d2c7-4b82-8534-90c25c4beda1 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:31.723285 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71bc8f-d2c7-4b82-8534-90c25c4beda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:31.723661 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71bc8f-d2c7-4b82-8534-90c25c4beda1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:31.724582 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71bc8f-d2c7-4b82-8534-90c25c4beda1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:31.725019 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71bc8f-d2c7-4b82-8534-90c25c4beda1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:31.726973 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71bc8f-d2c7-4b82-8534-90c25c4beda1 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:31.740302 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 330/662] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:31.747041 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c828fd-4409-4034-ab23-de80c809af88 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:31.758169 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c828fd-4409-4034-ab23-de80c809af88 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:31.763035 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43e864-0749-45c0-b2b2-1ab931ea35e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:31.763813 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43e864-0749-45c0-b2b2-1ab931ea35e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:31.764189 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43e864-0749-45c0-b2b2-1ab931ea35e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:31.764592 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43e864-0749-45c0-b2b2-1ab931ea35e6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:31.765534 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43e864-0749-45c0-b2b2-1ab931ea35e6 admin admin] RBAC: Adding query filter params (role.id=3e7d7427203a4a4097e2c9a642b9bf69, scope.project.id=73dcb70ac3714a428a717707e6be8201, user.id=df051fd059b34fe0993f501546d1610f) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:31.765945 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43e864-0749-45c0-b2b2-1ab931ea35e6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:31.767890 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43e864-0749-45c0-b2b2-1ab931ea35e6 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:31.778814 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 333/663] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:55:31 2021] GET /identity/v3/role_assignments?user.id=df051fd059b34fe0993f501546d1610f&scope.project.id=73dcb70ac3714a428a717707e6be8201&role.id=3e7d7427203a4a4097e2c9a642b9bf69 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:31.887896 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17f7bb-9ca3-4039-887d-e80d5ed0cccc None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:31.888938 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17f7bb-9ca3-4039-887d-e80d5ed0cccc None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:31.889449 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17f7bb-9ca3-4039-887d-e80d5ed0cccc None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:31.891900 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 331/664] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:31 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:31.900106 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39f43a-906f-421d-a272-689a4ff0423e None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:31.902318 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39f43a-906f-421d-a272-689a4ff0423e None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:31.902837 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39f43a-906f-421d-a272-689a4ff0423e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:31.922712 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-ad39f43a-906f-421d-a272-689a4ff0423e None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:31.924269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-ad39f43a-906f-421d-a272-689a4ff0423e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:31.936910 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 334/665] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:31 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:31.958815 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17f7bb-9ca3-4039-887d-e80d5ed0cccc None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:31.976821 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17f7bb-9ca3-4039-887d-e80d5ed0cccc None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:31.984850 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c731b-bbdd-4374-a8ee-fadaf1bec716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:31.986847 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c731b-bbdd-4374-a8ee-fadaf1bec716 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:31.987618 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c731b-bbdd-4374-a8ee-fadaf1bec716 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:31.988394 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c731b-bbdd-4374-a8ee-fadaf1bec716 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.018117 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c731b-bbdd-4374-a8ee-fadaf1bec716 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:32.026372 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-2a6c731b-bbdd-4374-a8ee-fadaf1bec716 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:55:32.028085 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 332/666] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:55:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:32.041993 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39f43a-906f-421d-a272-689a4ff0423e None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:32.052580 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39f43a-906f-421d-a272-689a4ff0423e None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:32.066845 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3ec88-76f6-4ba8-8d92-d8e539388bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:32.067551 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3ec88-76f6-4ba8-8d92-d8e539388bbd admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:32.067842 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3ec88-76f6-4ba8-8d92-d8e539388bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:32.068121 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3ec88-76f6-4ba8-8d92-d8e539388bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.068915 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3ec88-76f6-4ba8-8d92-d8e539388bbd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:32.069226 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3ec88-76f6-4ba8-8d92-d8e539388bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:32.070849 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3ec88-76f6-4ba8-8d92-d8e539388bbd admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:32.086182 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 335/667] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:55:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:32.091937 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c731b-bbdd-4374-a8ee-fadaf1bec716 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:32.103612 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c731b-bbdd-4374-a8ee-fadaf1bec716 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:32.108582 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392f7af-4a42-4b8d-bfec-ba0d2af6e1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:32.109499 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392f7af-4a42-4b8d-bfec-ba0d2af6e1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:32.109789 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392f7af-4a42-4b8d-bfec-ba0d2af6e1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:32.110069 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392f7af-4a42-4b8d-bfec-ba0d2af6e1d5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.121282 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392f7af-4a42-4b8d-bfec-ba0d2af6e1d5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:32.123718 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392f7af-4a42-4b8d-bfec-ba0d2af6e1d5 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:32.143632 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-d392f7af-4a42-4b8d-bfec-ba0d2af6e1d5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:32.148612 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 333/668] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:32.151785 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3ec88-76f6-4ba8-8d92-d8e539388bbd admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:32.165086 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3ec88-76f6-4ba8-8d92-d8e539388bbd admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:32.173524 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966acc5-72dc-4baa-9648-fea81b39345d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:32.174197 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966acc5-72dc-4baa-9648-fea81b39345d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:32.174537 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966acc5-72dc-4baa-9648-fea81b39345d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:32.174817 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966acc5-72dc-4baa-9648-fea81b39345d admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.175537 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966acc5-72dc-4baa-9648-fea81b39345d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:32.175903 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966acc5-72dc-4baa-9648-fea81b39345d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:32.177604 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966acc5-72dc-4baa-9648-fea81b39345d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:32.195911 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 336/669] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:32.202230 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392f7af-4a42-4b8d-bfec-ba0d2af6e1d5 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:32.213589 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392f7af-4a42-4b8d-bfec-ba0d2af6e1d5 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:32.221262 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a9c80-3254-4c06-b5f4-1ef8679bc786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:32.222080 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a9c80-3254-4c06-b5f4-1ef8679bc786 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:32.222365 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a9c80-3254-4c06-b5f4-1ef8679bc786 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:32.222643 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a9c80-3254-4c06-b5f4-1ef8679bc786 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.241823 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a9c80-3254-4c06-b5f4-1ef8679bc786 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:32.243860 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a9c80-3254-4c06-b5f4-1ef8679bc786 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:32.264284 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-4a6a9c80-3254-4c06-b5f4-1ef8679bc786 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 02:55:32.265862 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 334/670] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Sep 23 02:55:32 2021] GET /identity/v3/users/nova => generated 82 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:32.273211 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966acc5-72dc-4baa-9648-fea81b39345d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:32.289791 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966acc5-72dc-4baa-9648-fea81b39345d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:32.301505 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6dfef-6ab8-4b7a-a776-6a7704c60e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:32.302380 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6dfef-6ab8-4b7a-a776-6a7704c60e22 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:32.302844 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6dfef-6ab8-4b7a-a776-6a7704c60e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:32.303275 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6dfef-6ab8-4b7a-a776-6a7704c60e22 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.304462 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6dfef-6ab8-4b7a-a776-6a7704c60e22 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:32.304970 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6dfef-6ab8-4b7a-a776-6a7704c60e22 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:32.307739 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6dfef-6ab8-4b7a-a776-6a7704c60e22 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:32.339410 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 337/671] 10.222.0.23 () {56 vars in 1155 bytes} [Thu Sep 23 02:55:32 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:32.345857 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a9c80-3254-4c06-b5f4-1ef8679bc786 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:32.361952 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a9c80-3254-4c06-b5f4-1ef8679bc786 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:32.370451 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29cb28-8860-4347-8e1a-26e4223f5b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:32.371390 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29cb28-8860-4347-8e1a-26e4223f5b7b admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:32.371875 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29cb28-8860-4347-8e1a-26e4223f5b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:32.372348 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29cb28-8860-4347-8e1a-26e4223f5b7b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.384635 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29cb28-8860-4347-8e1a-26e4223f5b7b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:32.386691 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29cb28-8860-4347-8e1a-26e4223f5b7b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:32.401043 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 335/672] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:55:32 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:55:32.403218 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21e4eb-87bd-4a16-a76b-a304a02e484d None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:32.403511 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21e4eb-87bd-4a16-a76b-a304a02e484d None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:32.403800 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21e4eb-87bd-4a16-a76b-a304a02e484d None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.406034 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 338/673] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:32.409802 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29cb28-8860-4347-8e1a-26e4223f5b7b admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:32.413985 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece32de-5aaf-4a98-99f8-b0cab0200a0c None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:32.414273 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece32de-5aaf-4a98-99f8-b0cab0200a0c None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:32.414553 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece32de-5aaf-4a98-99f8-b0cab0200a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.420539 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29cb28-8860-4347-8e1a-26e4223f5b7b admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:32.426660 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20d276-1039-4eef-8829-0b841723a2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:32.427473 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20d276-1039-4eef-8829-0b841723a2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:32.427758 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20d276-1039-4eef-8829-0b841723a2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:32.428037 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20d276-1039-4eef-8829-0b841723a2a1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.435447 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-5ece32de-5aaf-4a98-99f8-b0cab0200a0c None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:32.436947 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-5ece32de-5aaf-4a98-99f8-b0cab0200a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:32.440303 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20d276-1039-4eef-8829-0b841723a2a1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:32.442375 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20d276-1039-4eef-8829-0b841723a2a1 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:32.446341 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 339/674] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:32 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:32.448072 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551bcd3-e7af-4a27-b58f-79b3c1e1aaaa None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:32.448646 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551bcd3-e7af-4a27-b58f-79b3c1e1aaaa None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:32.449144 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551bcd3-e7af-4a27-b58f-79b3c1e1aaaa None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.451892 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 340/675] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:32 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:32.459554 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c838b-55f3-400d-9eed-7958c3568a1d None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:32.460132 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c838b-55f3-400d-9eed-7958c3568a1d None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:32.460579 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-0e20d276-1039-4eef-8829-0b841723a2a1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:32.460906 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c838b-55f3-400d-9eed-7958c3568a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.462027 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 336/676] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:32.470798 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20d276-1039-4eef-8829-0b841723a2a1 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:32.486346 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20d276-1039-4eef-8829-0b841723a2a1 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:32.489262 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-360c838b-55f3-400d-9eed-7958c3568a1d None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:32.490873 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-360c838b-55f3-400d-9eed-7958c3568a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:32.491339 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4bb20-bb51-4b78-b3db-ac8034a80dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:32.492106 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4bb20-bb51-4b78-b3db-ac8034a80dcf admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:32.492503 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4bb20-bb51-4b78-b3db-ac8034a80dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:32.492892 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4bb20-bb51-4b78-b3db-ac8034a80dcf admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.493833 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4bb20-bb51-4b78-b3db-ac8034a80dcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:32.494241 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4bb20-bb51-4b78-b3db-ac8034a80dcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:32.496022 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4bb20-bb51-4b78-b3db-ac8034a80dcf admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:32.500579 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 341/677] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:32 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:32.508508 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c838b-55f3-400d-9eed-7958c3568a1d None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:32.509288 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 337/678] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:32.515545 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4bb20-bb51-4b78-b3db-ac8034a80dcf admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:32.530879 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4bb20-bb51-4b78-b3db-ac8034a80dcf admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:32.531056 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c838b-55f3-400d-9eed-7958c3568a1d None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:32.536442 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9938f-8690-480c-a943-9199e18922c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:32.537422 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0cffc-5999-4fe1-adc7-65b415796364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:32.538012 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9938f-8690-480c-a943-9199e18922c5 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:32.538220 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0cffc-5999-4fe1-adc7-65b415796364 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:32.538504 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0cffc-5999-4fe1-adc7-65b415796364 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:32.538781 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0cffc-5999-4fe1-adc7-65b415796364 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.539174 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9938f-8690-480c-a943-9199e18922c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:32.539811 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9938f-8690-480c-a943-9199e18922c5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.548614 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9938f-8690-480c-a943-9199e18922c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:32.552631 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9938f-8690-480c-a943-9199e18922c5 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:32.555804 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0cffc-5999-4fe1-adc7-65b415796364 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:32.563479 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-32a0cffc-5999-4fe1-adc7-65b415796364 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 02:55:32.564882 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 342/679] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 23 02:55:32 2021] GET /identity/v3/roles/service => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:32.565490 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0cffc-5999-4fe1-adc7-65b415796364 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:32.568982 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-47e9938f-8690-480c-a943-9199e18922c5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:32.570659 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 338/680] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:32.571938 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9938f-8690-480c-a943-9199e18922c5 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:32.582052 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9938f-8690-480c-a943-9199e18922c5 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:32.582329 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0cffc-5999-4fe1-adc7-65b415796364 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:32.586770 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1e9e4-695c-4f08-bf95-2676f11b8d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:32.587572 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1e9e4-695c-4f08-bf95-2676f11b8d30 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:32.587679 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec32f83-90f8-4d24-a9a0-e00af4884103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:32.587852 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1e9e4-695c-4f08-bf95-2676f11b8d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:32.588127 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1e9e4-695c-4f08-bf95-2676f11b8d30 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.588816 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1e9e4-695c-4f08-bf95-2676f11b8d30 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:32.589145 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec32f83-90f8-4d24-a9a0-e00af4884103 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:32.589649 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec32f83-90f8-4d24-a9a0-e00af4884103 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:32.590110 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec32f83-90f8-4d24-a9a0-e00af4884103 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.590419 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1e9e4-695c-4f08-bf95-2676f11b8d30 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:32.591427 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec32f83-90f8-4d24-a9a0-e00af4884103 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:32.592030 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec32f83-90f8-4d24-a9a0-e00af4884103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:32.593838 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec32f83-90f8-4d24-a9a0-e00af4884103 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:32.602718 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 339/681] 10.222.0.23 () {56 vars in 1125 bytes} [Thu Sep 23 02:55:32 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:32.603520 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-81d1e9e4-695c-4f08-bf95-2676f11b8d30 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 02:55:32.604037 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec32f83-90f8-4d24-a9a0-e00af4884103 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:32.609474 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 343/682] 10.222.0.23 () {56 vars in 1151 bytes} [Thu Sep 23 02:55:32 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:32.617693 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1e9e4-695c-4f08-bf95-2676f11b8d30 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:32.621954 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec32f83-90f8-4d24-a9a0-e00af4884103 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:32.627506 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83604994-0c81-4353-b2f3-b949250d9fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:32.628450 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83604994-0c81-4353-b2f3-b949250d9fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:32.628609 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1e9e4-695c-4f08-bf95-2676f11b8d30 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:32.629087 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83604994-0c81-4353-b2f3-b949250d9fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:32.629590 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83604994-0c81-4353-b2f3-b949250d9fc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.630701 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83604994-0c81-4353-b2f3-b949250d9fc2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:32.631283 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83604994-0c81-4353-b2f3-b949250d9fc2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:32.633347 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fd774-17ad-421c-ab52-b5dc1b780a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:32.633944 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83604994-0c81-4353-b2f3-b949250d9fc2 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:32.634133 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fd774-17ad-421c-ab52-b5dc1b780a22 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:32.634414 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fd774-17ad-421c-ab52-b5dc1b780a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:32.634691 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fd774-17ad-421c-ab52-b5dc1b780a22 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.647448 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fd774-17ad-421c-ab52-b5dc1b780a22 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:32.649118 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 340/683] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:32.649296 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fd774-17ad-421c-ab52-b5dc1b780a22 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:32.650577 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83604994-0c81-4353-b2f3-b949250d9fc2 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:32.660894 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83604994-0c81-4353-b2f3-b949250d9fc2 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:32.665853 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703bee8-f858-45a3-992d-488fa2b39daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:32.666776 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703bee8-f858-45a3-992d-488fa2b39daa admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:32.667341 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703bee8-f858-45a3-992d-488fa2b39daa admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:32.667567 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-1a0fd774-17ad-421c-ab52-b5dc1b780a22 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:32.667999 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703bee8-f858-45a3-992d-488fa2b39daa admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.669002 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8703bee8-f858-45a3-992d-488fa2b39daa admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:32.669118 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 344/684] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:32.669621 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8703bee8-f858-45a3-992d-488fa2b39daa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:32.670330 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fd774-17ad-421c-ab52-b5dc1b780a22 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:32.672213 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8703bee8-f858-45a3-992d-488fa2b39daa admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:32.679695 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 341/685] 10.222.0.23 () {56 vars in 1146 bytes} [Thu Sep 23 02:55:32 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:32.684520 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703bee8-f858-45a3-992d-488fa2b39daa admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:32.686751 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fd774-17ad-421c-ab52-b5dc1b780a22 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:32.691051 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c39ce-5403-4235-b35a-c0edb9d8d84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:32.691725 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c39ce-5403-4235-b35a-c0edb9d8d84d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:32.692163 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c39ce-5403-4235-b35a-c0edb9d8d84d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:32.692447 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c39ce-5403-4235-b35a-c0edb9d8d84d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.693302 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c39ce-5403-4235-b35a-c0edb9d8d84d admin admin] RBAC: Adding query filter params (role.id=3e7d7427203a4a4097e2c9a642b9bf69, scope.project.id=73dcb70ac3714a428a717707e6be8201, user.id=83aa47f723434143b22aac1b96b6a610) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:32.693615 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c39ce-5403-4235-b35a-c0edb9d8d84d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:32.696305 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c39ce-5403-4235-b35a-c0edb9d8d84d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:32.698229 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703bee8-f858-45a3-992d-488fa2b39daa admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:32.702860 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 345/686] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:55:32 2021] GET /identity/v3/role_assignments?user.id=83aa47f723434143b22aac1b96b6a610&scope.project.id=73dcb70ac3714a428a717707e6be8201&role.id=3e7d7427203a4a4097e2c9a642b9bf69 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:32.703651 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c39ce-5403-4235-b35a-c0edb9d8d84d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:32.704126 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d10eb-2e33-4aa3-9c99-d34f59ff47e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:32.705191 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d10eb-2e33-4aa3-9c99-d34f59ff47e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:32.705667 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d10eb-2e33-4aa3-9c99-d34f59ff47e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:32.706135 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d10eb-2e33-4aa3-9c99-d34f59ff47e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.707094 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d10eb-2e33-4aa3-9c99-d34f59ff47e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:32.707668 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d10eb-2e33-4aa3-9c99-d34f59ff47e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:32.709694 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d10eb-2e33-4aa3-9c99-d34f59ff47e7 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:32.716573 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c39ce-5403-4235-b35a-c0edb9d8d84d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:32.719988 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13cc1ab-3a7a-4da0-abe9-59d6c01714bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:32.724538 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cc1ab-3a7a-4da0-abe9-59d6c01714bf admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:32.724538 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cc1ab-3a7a-4da0-abe9-59d6c01714bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:32.724538 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cc1ab-3a7a-4da0-abe9-59d6c01714bf admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.724538 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13cc1ab-3a7a-4da0-abe9-59d6c01714bf admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:32.724538 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13cc1ab-3a7a-4da0-abe9-59d6c01714bf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:32.724538 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13cc1ab-3a7a-4da0-abe9-59d6c01714bf admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:32.732721 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 346/687] 10.222.0.23 () {56 vars in 1146 bytes} [Thu Sep 23 02:55:32 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:32.742301 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13cc1ab-3a7a-4da0-abe9-59d6c01714bf admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:32.745065 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 342/688] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:32.751715 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d10eb-2e33-4aa3-9c99-d34f59ff47e7 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:32.763695 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d10eb-2e33-4aa3-9c99-d34f59ff47e7 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:32.768206 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13cc1ab-3a7a-4da0-abe9-59d6c01714bf admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:32.772527 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3e044-58f1-4dc9-b11e-95fb71345b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:32.772527 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3e044-58f1-4dc9-b11e-95fb71345b53 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:32.772527 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3e044-58f1-4dc9-b11e-95fb71345b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:32.772527 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3e044-58f1-4dc9-b11e-95fb71345b53 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.781452 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c3e044-58f1-4dc9-b11e-95fb71345b53 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:32.782182 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d328ed-7729-403f-bff5-c771abb523bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:32.783029 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d328ed-7729-403f-bff5-c771abb523bf admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:32.783451 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d328ed-7729-403f-bff5-c771abb523bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:32.783864 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d328ed-7729-403f-bff5-c771abb523bf admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.784197 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c3e044-58f1-4dc9-b11e-95fb71345b53 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:32.785018 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d328ed-7729-403f-bff5-c771abb523bf admin admin] RBAC: Adding query filter params (interface=public, service_id=b6b2eaa4b9db4bd197afe3842ee18214, region_id=RegionOne) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:32.785469 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d328ed-7729-403f-bff5-c771abb523bf admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:32.786634 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING py.warnings [None req-58d328ed-7729-403f-bff5-c771abb523bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:55:32.786634 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: warnings.warn(msg) Sep 23 02:55:32.786634 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: Sep 23 02:55:32.787786 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d328ed-7729-403f-bff5-c771abb523bf admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:32.802254 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-64c3e044-58f1-4dc9-b11e-95fb71345b53 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 02:55:32.803875 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 347/690] 10.222.0.23 () {56 vars in 1273 bytes} [Thu Sep 23 02:55:32 2021] GET /identity/v3/endpoints?service_id=b6b2eaa4b9db4bd197afe3842ee18214&interface=public®ion_id=RegionOne => generated 194 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:32.808668 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 343/690] 10.222.0.23 () {56 vars in 1139 bytes} [Thu Sep 23 02:55:32 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:32.810644 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d328ed-7729-403f-bff5-c771abb523bf admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:32.822965 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3e044-58f1-4dc9-b11e-95fb71345b53 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:32.832213 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d328ed-7729-403f-bff5-c771abb523bf admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:32.835027 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3e044-58f1-4dc9-b11e-95fb71345b53 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:32.847437 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffb669-577e-4284-8a5c-eab3a8ee88f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:32.848567 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55d214-5d6d-4418-9ea6-6de4146aff16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:32.849506 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffb669-577e-4284-8a5c-eab3a8ee88f6 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:32.849789 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffb669-577e-4284-8a5c-eab3a8ee88f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:32.850065 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffb669-577e-4284-8a5c-eab3a8ee88f6 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.850656 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55d214-5d6d-4418-9ea6-6de4146aff16 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:32.850981 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55d214-5d6d-4418-9ea6-6de4146aff16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:32.851785 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ffb669-577e-4284-8a5c-eab3a8ee88f6 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:32.852100 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ffb669-577e-4284-8a5c-eab3a8ee88f6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:32.852648 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55d214-5d6d-4418-9ea6-6de4146aff16 admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.853433 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55d214-5d6d-4418-9ea6-6de4146aff16 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:32.856421 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ffb669-577e-4284-8a5c-eab3a8ee88f6 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:32.856922 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55d214-5d6d-4418-9ea6-6de4146aff16 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:32.866951 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 348/691] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 23 02:55:32 2021] GET /identity/v3/services => generated 772 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:32.886031 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 344/692] 10.222.0.23 () {56 vars in 1171 bytes} [Thu Sep 23 02:55:32 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:32.893235 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55d214-5d6d-4418-9ea6-6de4146aff16 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:32.905783 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55d214-5d6d-4418-9ea6-6de4146aff16 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:32.910589 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99bbfc-3980-4402-a500-6dd4bcc7a574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:32.911477 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99bbfc-3980-4402-a500-6dd4bcc7a574 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:32.911704 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99bbfc-3980-4402-a500-6dd4bcc7a574 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:32.911983 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99bbfc-3980-4402-a500-6dd4bcc7a574 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.926943 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99bbfc-3980-4402-a500-6dd4bcc7a574 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:32.928896 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99bbfc-3980-4402-a500-6dd4bcc7a574 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:32.947377 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-7a99bbfc-3980-4402-a500-6dd4bcc7a574 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:32.948994 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 349/693] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:32.955879 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffb669-577e-4284-8a5c-eab3a8ee88f6 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:32.967271 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffb669-577e-4284-8a5c-eab3a8ee88f6 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:32.972079 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e3597-da8e-49eb-a6f2-8acbef568a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:32.972835 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e3597-da8e-49eb-a6f2-8acbef568a34 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:32.973167 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e3597-da8e-49eb-a6f2-8acbef568a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:32.973499 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e3597-da8e-49eb-a6f2-8acbef568a34 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:32.974252 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e3597-da8e-49eb-a6f2-8acbef568a34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:32.974622 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e3597-da8e-49eb-a6f2-8acbef568a34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:32.976345 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e3597-da8e-49eb-a6f2-8acbef568a34 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:32.990887 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 345/694] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:32.997120 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99bbfc-3980-4402-a500-6dd4bcc7a574 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:33.008263 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99bbfc-3980-4402-a500-6dd4bcc7a574 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:33.013703 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5abfaea-9734-4888-9275-8238b94fb2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:33.014804 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abfaea-9734-4888-9275-8238b94fb2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:33.015084 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abfaea-9734-4888-9275-8238b94fb2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:33.015366 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abfaea-9734-4888-9275-8238b94fb2a2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:33.025991 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5abfaea-9734-4888-9275-8238b94fb2a2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:33.028109 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5abfaea-9734-4888-9275-8238b94fb2a2 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:33.043852 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-f5abfaea-9734-4888-9275-8238b94fb2a2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:33.048800 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 350/695] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:33.052296 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e3597-da8e-49eb-a6f2-8acbef568a34 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:33.064930 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e3597-da8e-49eb-a6f2-8acbef568a34 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:33.072954 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e675867-1dfa-4d94-91d2-1e02ce966399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:33.073715 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e675867-1dfa-4d94-91d2-1e02ce966399 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:33.074071 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e675867-1dfa-4d94-91d2-1e02ce966399 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:33.074411 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e675867-1dfa-4d94-91d2-1e02ce966399 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:33.075282 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e675867-1dfa-4d94-91d2-1e02ce966399 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:33.075658 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e675867-1dfa-4d94-91d2-1e02ce966399 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:33.078252 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e675867-1dfa-4d94-91d2-1e02ce966399 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:33.091587 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 346/696] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:33.097833 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5abfaea-9734-4888-9275-8238b94fb2a2 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:33.109238 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5abfaea-9734-4888-9275-8238b94fb2a2 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:33.114151 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee9bca-2326-4fbe-b7de-52172803aecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:33.115195 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee9bca-2326-4fbe-b7de-52172803aecc admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:33.115622 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee9bca-2326-4fbe-b7de-52172803aecc admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:33.115991 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee9bca-2326-4fbe-b7de-52172803aecc admin admin] PATH_INFO: `/v3/projects/73dcb70ac3714a428a717707e6be8201/users/96c9b76133d74b79a0d2da9a884651e1/roles/8e064794445b4039b2cf2d06b26b49de` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:33.132230 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee9bca-2326-4fbe-b7de-52172803aecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=73dcb70ac3714a428a717707e6be8201, user_id=96c9b76133d74b79a0d2da9a884651e1, role_id=8e064794445b4039b2cf2d06b26b49de)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:33.135101 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee9bca-2326-4fbe-b7de-52172803aecc admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:33.205764 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 351/697] 10.222.0.23 () {58 vars in 1461 bytes} [Thu Sep 23 02:55:33 2021] PUT /identity/v3/projects/73dcb70ac3714a428a717707e6be8201/users/96c9b76133d74b79a0d2da9a884651e1/roles/8e064794445b4039b2cf2d06b26b49de => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 02:55:33.490408 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8569c-6399-468c-9235-3a894e89e50b None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:33.490814 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8569c-6399-468c-9235-3a894e89e50b None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:33.491205 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8569c-6399-468c-9235-3a894e89e50b None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:33.493416 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 347/698] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:33.501565 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c41cc-8405-44cb-a735-f081b4b24690 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:33.501854 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c41cc-8405-44cb-a735-f081b4b24690 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:33.502132 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c41cc-8405-44cb-a735-f081b4b24690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:33.520758 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-ae8c41cc-8405-44cb-a735-f081b4b24690 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:33.521965 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-ae8c41cc-8405-44cb-a735-f081b4b24690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:33.581163 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 352/699] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:33 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:33.629170 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8569c-6399-468c-9235-3a894e89e50b None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:33.646309 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8569c-6399-468c-9235-3a894e89e50b None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:33.657427 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11b7dc-ab36-4fb0-a4df-e29ed7a9aacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:33.657681 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11b7dc-ab36-4fb0-a4df-e29ed7a9aacc admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:33.657681 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11b7dc-ab36-4fb0-a4df-e29ed7a9aacc admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:33.657681 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11b7dc-ab36-4fb0-a4df-e29ed7a9aacc admin admin] PATH_INFO: `/v3/services/network` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:33.659318 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11b7dc-ab36-4fb0-a4df-e29ed7a9aacc admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:33.660868 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11b7dc-ab36-4fb0-a4df-e29ed7a9aacc admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:33.672836 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-ac11b7dc-ab36-4fb0-a4df-e29ed7a9aacc admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 02:55:33.674383 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 348/700] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:33 2021] GET /identity/v3/services/network => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:33.680777 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c41cc-8405-44cb-a735-f081b4b24690 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:33.697578 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c41cc-8405-44cb-a735-f081b4b24690 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:33.702960 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fe350-6f58-4a78-801b-fba5860aaf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:33.703731 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fe350-6f58-4a78-801b-fba5860aaf35 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:33.704137 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fe350-6f58-4a78-801b-fba5860aaf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:33.704598 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fe350-6f58-4a78-801b-fba5860aaf35 admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:33.705413 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fe350-6f58-4a78-801b-fba5860aaf35 admin admin] RBAC: Adding query filter params (name=network) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:33.705821 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fe350-6f58-4a78-801b-fba5860aaf35 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:33.707553 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fe350-6f58-4a78-801b-fba5860aaf35 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:33.712639 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 353/701] 10.222.0.23 () {56 vars in 1134 bytes} [Thu Sep 23 02:55:33 2021] GET /identity/v3/services?name=network => generated 124 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:33.721845 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11b7dc-ab36-4fb0-a4df-e29ed7a9aacc admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:33.733629 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11b7dc-ab36-4fb0-a4df-e29ed7a9aacc admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:33.740979 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd0f56-85be-410b-93cc-8383e81c21e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:33.741763 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd0f56-85be-410b-93cc-8383e81c21e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:33.742195 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd0f56-85be-410b-93cc-8383e81c21e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:33.742718 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd0f56-85be-410b-93cc-8383e81c21e9 admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:33.743577 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd0f56-85be-410b-93cc-8383e81c21e9 admin admin] RBAC: Adding query filter params (type=network) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:33.743986 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd0f56-85be-410b-93cc-8383e81c21e9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:33.745924 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd0f56-85be-410b-93cc-8383e81c21e9 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:33.752841 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 349/702] 10.222.0.23 () {56 vars in 1134 bytes} [Thu Sep 23 02:55:33 2021] GET /identity/v3/services?type=network => generated 350 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:33.758947 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fe350-6f58-4a78-801b-fba5860aaf35 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:33.770332 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fe350-6f58-4a78-801b-fba5860aaf35 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:33.776933 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7ca5d-53f0-49c9-9da4-28e8bd192bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:33.777782 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7ca5d-53f0-49c9-9da4-28e8bd192bdd admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:33.778161 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7ca5d-53f0-49c9-9da4-28e8bd192bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:33.778589 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7ca5d-53f0-49c9-9da4-28e8bd192bdd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:33.780244 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7ca5d-53f0-49c9-9da4-28e8bd192bdd admin admin] RBAC: Adding query filter params (interface=public, service_id=a005db9326ba400f83783a9c94f4f0f0, region_id=RegionOne) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:33.780694 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7ca5d-53f0-49c9-9da4-28e8bd192bdd admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:33.782471 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7ca5d-53f0-49c9-9da4-28e8bd192bdd admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:33.790285 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 354/703] 10.222.0.23 () {56 vars in 1273 bytes} [Thu Sep 23 02:55:33 2021] GET /identity/v3/endpoints?service_id=a005db9326ba400f83783a9c94f4f0f0&interface=public®ion_id=RegionOne => generated 194 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:33.796447 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd0f56-85be-410b-93cc-8383e81c21e9 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:33.809553 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd0f56-85be-410b-93cc-8383e81c21e9 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:33.818565 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7cfc5-79cb-4f41-8c41-0094ae587577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:33.818565 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7cfc5-79cb-4f41-8c41-0094ae587577 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:33.818565 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7cfc5-79cb-4f41-8c41-0094ae587577 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:33.818565 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7cfc5-79cb-4f41-8c41-0094ae587577 admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:33.819623 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7cfc5-79cb-4f41-8c41-0094ae587577 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:33.824660 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7cfc5-79cb-4f41-8c41-0094ae587577 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:33.829546 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 350/704] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 23 02:55:33 2021] GET /identity/v3/services => generated 772 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:34.867527 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820db0d-5c3b-4973-9079-6be8b3b173b5 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:34.868077 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820db0d-5c3b-4973-9079-6be8b3b173b5 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:34.868077 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820db0d-5c3b-4973-9079-6be8b3b173b5 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:34.870079 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 355/705] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:34.877927 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cc0c7-01b3-4eb2-9dc7-976ca18c39ae None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:34.878409 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cc0c7-01b3-4eb2-9dc7-976ca18c39ae None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:34.878486 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cc0c7-01b3-4eb2-9dc7-976ca18c39ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:34.904690 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-e14cc0c7-01b3-4eb2-9dc7-976ca18c39ae None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:34.905891 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-e14cc0c7-01b3-4eb2-9dc7-976ca18c39ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:34.920592 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 351/706] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:34 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:34.943954 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820db0d-5c3b-4973-9079-6be8b3b173b5 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:34.962334 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820db0d-5c3b-4973-9079-6be8b3b173b5 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:34.972583 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cb3e7-654c-4334-a2c9-d0fac517c89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:34.973384 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cb3e7-654c-4334-a2c9-d0fac517c89f admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:34.973665 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cb3e7-654c-4334-a2c9-d0fac517c89f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:34.973937 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cb3e7-654c-4334-a2c9-d0fac517c89f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:34.993663 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cb3e7-654c-4334-a2c9-d0fac517c89f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:35.000388 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-1a3cb3e7-654c-4334-a2c9-d0fac517c89f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:55:35.001936 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 356/707] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:55:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:35.008091 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cc0c7-01b3-4eb2-9dc7-976ca18c39ae None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:35.021691 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cc0c7-01b3-4eb2-9dc7-976ca18c39ae None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:35.028701 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1aac5a-69bd-46fe-bc50-ba0aa7afb4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:35.029910 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1aac5a-69bd-46fe-bc50-ba0aa7afb4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:35.030195 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1aac5a-69bd-46fe-bc50-ba0aa7afb4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:35.030477 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1aac5a-69bd-46fe-bc50-ba0aa7afb4d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:35.031302 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1aac5a-69bd-46fe-bc50-ba0aa7afb4d0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:35.031608 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1aac5a-69bd-46fe-bc50-ba0aa7afb4d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:35.033326 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1aac5a-69bd-46fe-bc50-ba0aa7afb4d0 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:35.051668 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 352/708] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:55:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:35.058012 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cb3e7-654c-4334-a2c9-d0fac517c89f admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:35.074246 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cb3e7-654c-4334-a2c9-d0fac517c89f admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:35.081145 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d9b24-6dd9-4409-b4f8-2d47155158c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:35.081936 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d9b24-6dd9-4409-b4f8-2d47155158c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:35.082218 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d9b24-6dd9-4409-b4f8-2d47155158c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:35.082492 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d9b24-6dd9-4409-b4f8-2d47155158c2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:35.104145 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d9b24-6dd9-4409-b4f8-2d47155158c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:35.106012 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d9b24-6dd9-4409-b4f8-2d47155158c2 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:35.129770 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-7a3d9b24-6dd9-4409-b4f8-2d47155158c2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:35.131295 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 357/709] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:35.137567 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1aac5a-69bd-46fe-bc50-ba0aa7afb4d0 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:35.152548 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1aac5a-69bd-46fe-bc50-ba0aa7afb4d0 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:35.160159 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd60d07-f642-47b9-817b-7f114cf36bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:35.161029 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd60d07-f642-47b9-817b-7f114cf36bfe admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:35.161456 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd60d07-f642-47b9-817b-7f114cf36bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:35.161875 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd60d07-f642-47b9-817b-7f114cf36bfe admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:35.162732 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd60d07-f642-47b9-817b-7f114cf36bfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:35.163206 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd60d07-f642-47b9-817b-7f114cf36bfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:35.164971 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd60d07-f642-47b9-817b-7f114cf36bfe admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:35.187443 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 353/710] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:35.193241 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d9b24-6dd9-4409-b4f8-2d47155158c2 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:35.210583 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d9b24-6dd9-4409-b4f8-2d47155158c2 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:35.218244 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619fe26-1b9c-4714-8721-624e2cc99d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:35.219058 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619fe26-1b9c-4714-8721-624e2cc99d66 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:35.219337 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619fe26-1b9c-4714-8721-624e2cc99d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:35.219610 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619fe26-1b9c-4714-8721-624e2cc99d66 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:35.229801 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619fe26-1b9c-4714-8721-624e2cc99d66 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:35.231825 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619fe26-1b9c-4714-8721-624e2cc99d66 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:35.252434 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-4619fe26-1b9c-4714-8721-624e2cc99d66 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 23 02:55:35.253972 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 358/711] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:55:35 2021] GET /identity/v3/users/swift => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:35.260315 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd60d07-f642-47b9-817b-7f114cf36bfe admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:35.273459 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd60d07-f642-47b9-817b-7f114cf36bfe admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:35.281212 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf77b98-4e71-4b2f-8244-932344338c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:35.281898 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf77b98-4e71-4b2f-8244-932344338c73 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:35.282238 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf77b98-4e71-4b2f-8244-932344338c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:35.282519 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf77b98-4e71-4b2f-8244-932344338c73 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:35.283356 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf77b98-4e71-4b2f-8244-932344338c73 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:35.283735 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf77b98-4e71-4b2f-8244-932344338c73 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:35.285830 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf77b98-4e71-4b2f-8244-932344338c73 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:35.311073 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 354/712] 10.222.0.23 () {56 vars in 1157 bytes} [Thu Sep 23 02:55:35 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:35.317331 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619fe26-1b9c-4714-8721-624e2cc99d66 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:35.330865 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619fe26-1b9c-4714-8721-624e2cc99d66 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:35.347106 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ca8db-571f-42ad-aeca-f778fb9387a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:35.348315 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ca8db-571f-42ad-aeca-f778fb9387a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:35.348832 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ca8db-571f-42ad-aeca-f778fb9387a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:35.349339 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ca8db-571f-42ad-aeca-f778fb9387a1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:35.365923 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ca8db-571f-42ad-aeca-f778fb9387a1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:35.368150 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ca8db-571f-42ad-aeca-f778fb9387a1 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:35.394818 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-c17ca8db-571f-42ad-aeca-f778fb9387a1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:35.396682 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 359/713] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:35.402594 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf77b98-4e71-4b2f-8244-932344338c73 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:35.417395 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf77b98-4e71-4b2f-8244-932344338c73 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:35.431738 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56d8c4-ea2f-4737-a1c4-0c798b9f6a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:35.432469 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56d8c4-ea2f-4737-a1c4-0c798b9f6a86 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:35.432773 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56d8c4-ea2f-4737-a1c4-0c798b9f6a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:35.433113 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56d8c4-ea2f-4737-a1c4-0c798b9f6a86 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:35.433934 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56d8c4-ea2f-4737-a1c4-0c798b9f6a86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:35.434245 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56d8c4-ea2f-4737-a1c4-0c798b9f6a86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:35.435993 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56d8c4-ea2f-4737-a1c4-0c798b9f6a86 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:35.439679 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a4110-ca92-42c7-b5f5-a7748fe8e7b5 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:35.440200 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a4110-ca92-42c7-b5f5-a7748fe8e7b5 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:35.440705 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a4110-ca92-42c7-b5f5-a7748fe8e7b5 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:35.442908 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 360/714] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:35.450750 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f72d6-e828-471b-9fdf-af25c14fb912 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:35.451872 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f72d6-e828-471b-9fdf-af25c14fb912 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:35.452371 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f72d6-e828-471b-9fdf-af25c14fb912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:35.460138 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 355/715] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:35.461581 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56d8c4-ea2f-4737-a1c4-0c798b9f6a86 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:35.485398 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56d8c4-ea2f-4737-a1c4-0c798b9f6a86 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:35.495351 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-d39f72d6-e828-471b-9fdf-af25c14fb912 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:35.497242 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c9e9e-dfc1-4819-8e9b-215c857cd8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:35.498351 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c9e9e-dfc1-4819-8e9b-215c857cd8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:35.498812 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c9e9e-dfc1-4819-8e9b-215c857cd8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:35.499290 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c9e9e-dfc1-4819-8e9b-215c857cd8e6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:35.501533 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-d39f72d6-e828-471b-9fdf-af25c14fb912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:35.511593 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c9e9e-dfc1-4819-8e9b-215c857cd8e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:35.515674 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c9e9e-dfc1-4819-8e9b-215c857cd8e6 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:35.521080 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 361/716] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:35 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:35.534314 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-cb2c9e9e-dfc1-4819-8e9b-215c857cd8e6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:35.536125 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 356/717] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:35.542222 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f72d6-e828-471b-9fdf-af25c14fb912 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:35.557654 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f72d6-e828-471b-9fdf-af25c14fb912 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:35.563552 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6cfec-2b3d-4b30-bb9f-e4a423a2c05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:35.564577 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6cfec-2b3d-4b30-bb9f-e4a423a2c05f admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:35.565079 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6cfec-2b3d-4b30-bb9f-e4a423a2c05f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:35.565521 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6cfec-2b3d-4b30-bb9f-e4a423a2c05f admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:35.566560 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6cfec-2b3d-4b30-bb9f-e4a423a2c05f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:35.567056 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6cfec-2b3d-4b30-bb9f-e4a423a2c05f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:35.569292 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6cfec-2b3d-4b30-bb9f-e4a423a2c05f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:35.573174 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c9e9e-dfc1-4819-8e9b-215c857cd8e6 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:35.584783 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c9e9e-dfc1-4819-8e9b-215c857cd8e6 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:35.589555 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9b384-02bb-44d1-ae1e-6a5070a15208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:35.590565 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9b384-02bb-44d1-ae1e-6a5070a15208 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:35.590728 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 362/718] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:35.591167 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9b384-02bb-44d1-ae1e-6a5070a15208 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:35.591695 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9b384-02bb-44d1-ae1e-6a5070a15208 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:35.592098 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffde269-ea0e-48f8-8fc4-3630af8fe255 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:35.592754 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9b384-02bb-44d1-ae1e-6a5070a15208 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:35.594573 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9b384-02bb-44d1-ae1e-6a5070a15208 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:35.597754 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffde269-ea0e-48f8-8fc4-3630af8fe255 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:35.598045 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffde269-ea0e-48f8-8fc4-3630af8fe255 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:35.599934 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 363/719] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:35 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:35.600734 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffde269-ea0e-48f8-8fc4-3630af8fe255 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:35.608463 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-b4f9b384-02bb-44d1-ae1e-6a5070a15208 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 02:55:35.615350 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 357/720] 10.222.0.23 () {56 vars in 1151 bytes} [Thu Sep 23 02:55:35 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:35.616760 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9b384-02bb-44d1-ae1e-6a5070a15208 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:35.620426 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffde269-ea0e-48f8-8fc4-3630af8fe255 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:35.626308 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5032e38-25ab-43c9-b891-3994f84255e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:35.627298 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5032e38-25ab-43c9-b891-3994f84255e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:35.627630 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5032e38-25ab-43c9-b891-3994f84255e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:35.627906 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5032e38-25ab-43c9-b891-3994f84255e2 admin admin] PATH_INFO: `/v3/projects/73dcb70ac3714a428a717707e6be8201/users/df051fd059b34fe0993f501546d1610f/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:35.628743 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9b384-02bb-44d1-ae1e-6a5070a15208 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:35.630681 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5032e38-25ab-43c9-b891-3994f84255e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73dcb70ac3714a428a717707e6be8201, user_id=df051fd059b34fe0993f501546d1610f, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:35.633393 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6aa844-85f4-4aaf-84f9-d730817e85ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:35.633886 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5032e38-25ab-43c9-b891-3994f84255e2 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:35.634193 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6aa844-85f4-4aaf-84f9-d730817e85ee admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:35.634544 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6aa844-85f4-4aaf-84f9-d730817e85ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:35.634888 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6aa844-85f4-4aaf-84f9-d730817e85ee admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:35.635655 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6aa844-85f4-4aaf-84f9-d730817e85ee admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:35.636030 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6aa844-85f4-4aaf-84f9-d730817e85ee admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:35.637957 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6aa844-85f4-4aaf-84f9-d730817e85ee admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:35.643571 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 358/721] 10.222.0.23 () {56 vars in 1146 bytes} [Thu Sep 23 02:55:35 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:35.649635 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf6ea9-975e-4049-89fe-17596b18cef6 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:35.649928 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf6ea9-975e-4049-89fe-17596b18cef6 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:35.650205 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf6ea9-975e-4049-89fe-17596b18cef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:35.667770 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-1caf6ea9-975e-4049-89fe-17596b18cef6 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:35.668963 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-1caf6ea9-975e-4049-89fe-17596b18cef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:35.678145 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 359/722] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:35 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:35.682798 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf6ea9-975e-4049-89fe-17596b18cef6 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:35.688133 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf6ea9-975e-4049-89fe-17596b18cef6 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:35.692739 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30050ed3-6ef5-4062-b9e2-700f81039431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:35.693395 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30050ed3-6ef5-4062-b9e2-700f81039431 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:35.693679 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30050ed3-6ef5-4062-b9e2-700f81039431 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:35.693950 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30050ed3-6ef5-4062-b9e2-700f81039431 admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:35.694736 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30050ed3-6ef5-4062-b9e2-700f81039431 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:35.695043 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30050ed3-6ef5-4062-b9e2-700f81039431 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:35.696649 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30050ed3-6ef5-4062-b9e2-700f81039431 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:35.702623 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 360/723] 10.222.0.23 () {56 vars in 1146 bytes} [Thu Sep 23 02:55:35 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:35.707971 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30050ed3-6ef5-4062-b9e2-700f81039431 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:35.717491 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30050ed3-6ef5-4062-b9e2-700f81039431 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:35.721990 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3facbc-dfc7-4e0d-9ff6-12344a8d4969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:35.722794 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3facbc-dfc7-4e0d-9ff6-12344a8d4969 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:35.723074 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3facbc-dfc7-4e0d-9ff6-12344a8d4969 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:35.723347 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3facbc-dfc7-4e0d-9ff6-12344a8d4969 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:35.723986 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3facbc-dfc7-4e0d-9ff6-12344a8d4969 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:35.725689 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3facbc-dfc7-4e0d-9ff6-12344a8d4969 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:35.740705 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 364/724] 10.222.0.23 () {58 vars in 1461 bytes} [Thu Sep 23 02:55:35 2021] PUT /identity/v3/projects/73dcb70ac3714a428a717707e6be8201/users/df051fd059b34fe0993f501546d1610f/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 02:55:35.741052 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-dd3facbc-dfc7-4e0d-9ff6-12344a8d4969 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 02:55:35.741499 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5032e38-25ab-43c9-b891-3994f84255e2 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:35.743137 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 361/725] 10.222.0.23 () {56 vars in 1154 bytes} [Thu Sep 23 02:55:35 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:35.767356 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3facbc-dfc7-4e0d-9ff6-12344a8d4969 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:35.778304 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3facbc-dfc7-4e0d-9ff6-12344a8d4969 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:35.867171 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020de6a-a2ab-4d0f-b55f-24b6e2532abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:35.868154 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020de6a-a2ab-4d0f-b55f-24b6e2532abe admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:35.868628 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020de6a-a2ab-4d0f-b55f-24b6e2532abe admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:35.869064 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020de6a-a2ab-4d0f-b55f-24b6e2532abe admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:35.869927 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020de6a-a2ab-4d0f-b55f-24b6e2532abe admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:35.870376 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020de6a-a2ab-4d0f-b55f-24b6e2532abe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:35.873533 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020de6a-a2ab-4d0f-b55f-24b6e2532abe admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:35.880094 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5032e38-25ab-43c9-b891-3994f84255e2 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:35.882409 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 362/726] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 23 02:55:35 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:35.889081 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020de6a-a2ab-4d0f-b55f-24b6e2532abe admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:35.895263 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0941d9-036d-40d4-a6f9-d51fbb43f38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:35.896215 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0941d9-036d-40d4-a6f9-d51fbb43f38e admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:35.896657 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0941d9-036d-40d4-a6f9-d51fbb43f38e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:35.897096 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0941d9-036d-40d4-a6f9-d51fbb43f38e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:35.898043 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0941d9-036d-40d4-a6f9-d51fbb43f38e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:35.899108 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020de6a-a2ab-4d0f-b55f-24b6e2532abe admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:35.899351 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING py.warnings [None req-0b0941d9-036d-40d4-a6f9-d51fbb43f38e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:55:35.899351 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: warnings.warn(msg) Sep 23 02:55:35.899351 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: Sep 23 02:55:35.900688 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0941d9-036d-40d4-a6f9-d51fbb43f38e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:35.906385 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cf246-f8b4-4258-9d8c-9ebc86e96432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:35.907776 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cf246-f8b4-4258-9d8c-9ebc86e96432 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:35.907776 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cf246-f8b4-4258-9d8c-9ebc86e96432 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:35.907776 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cf246-f8b4-4258-9d8c-9ebc86e96432 admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:35.908246 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cf246-f8b4-4258-9d8c-9ebc86e96432 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:35.908576 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cf246-f8b4-4258-9d8c-9ebc86e96432 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:35.910226 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cf246-f8b4-4258-9d8c-9ebc86e96432 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:35.921008 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 363/727] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 23 02:55:35 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:36.025745 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 365/728] 10.222.0.23 () {60 vars in 1166 bytes} [Thu Sep 23 02:55:35 2021] POST /identity/v3/endpoints => generated 346 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 02:55:36.074283 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca336fc4-5633-4b5b-aeb2-1b95ecfa5c1b None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:36.074610 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca336fc4-5633-4b5b-aeb2-1b95ecfa5c1b None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:36.074842 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca336fc4-5633-4b5b-aeb2-1b95ecfa5c1b None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:36.077004 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 364/729] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:36.085274 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4945c-2989-484a-a223-4f1a825866f3 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:36.085909 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4945c-2989-484a-a223-4f1a825866f3 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:36.086428 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4945c-2989-484a-a223-4f1a825866f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:36.107925 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-54b4945c-2989-484a-a223-4f1a825866f3 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:36.109558 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-54b4945c-2989-484a-a223-4f1a825866f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:36.131874 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 366/730] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:36 2021] POST /identity/v3/auth/tokens => generated 1456 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:36.155774 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca336fc4-5633-4b5b-aeb2-1b95ecfa5c1b None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:36.173231 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca336fc4-5633-4b5b-aeb2-1b95ecfa5c1b None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:36.179172 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cd003-265d-461d-a906-2e8a15947cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:36.180149 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cd003-265d-461d-a906-2e8a15947cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:36.180515 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cd003-265d-461d-a906-2e8a15947cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:36.180875 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cd003-265d-461d-a906-2e8a15947cc6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:36.193462 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88cd003-265d-461d-a906-2e8a15947cc6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:36.200631 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-c88cd003-265d-461d-a906-2e8a15947cc6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 02:55:36.202792 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 365/731] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 23 02:55:36 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:36.209458 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4945c-2989-484a-a223-4f1a825866f3 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:36.226864 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4945c-2989-484a-a223-4f1a825866f3 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:36.237231 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858033f-d08b-4e2d-ba24-99937abdc0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:36.238130 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858033f-d08b-4e2d-ba24-99937abdc0ba admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:36.238560 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858033f-d08b-4e2d-ba24-99937abdc0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:36.238974 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858033f-d08b-4e2d-ba24-99937abdc0ba admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:36.239902 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858033f-d08b-4e2d-ba24-99937abdc0ba admin admin] RBAC: Adding query filter params (name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:36.240206 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858033f-d08b-4e2d-ba24-99937abdc0ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:36.241850 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858033f-d08b-4e2d-ba24-99937abdc0ba admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:36.255075 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 367/732] 10.222.0.23 () {56 vars in 1125 bytes} [Thu Sep 23 02:55:36 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:36.261130 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cd003-265d-461d-a906-2e8a15947cc6 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:36.272708 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cd003-265d-461d-a906-2e8a15947cc6 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:36.278406 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b2622-f35e-49ea-943c-a3f216210f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:36.279380 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b2622-f35e-49ea-943c-a3f216210f85 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:36.279759 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b2622-f35e-49ea-943c-a3f216210f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:36.280130 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b2622-f35e-49ea-943c-a3f216210f85 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:36.291044 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b2622-f35e-49ea-943c-a3f216210f85 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:36.293063 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b2622-f35e-49ea-943c-a3f216210f85 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:36.311366 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-625b2622-f35e-49ea-943c-a3f216210f85 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:36.313037 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 366/733] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:36.319553 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858033f-d08b-4e2d-ba24-99937abdc0ba admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:36.330580 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858033f-d08b-4e2d-ba24-99937abdc0ba admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:36.335411 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8480d3-20a1-4a5a-b81d-f4ee65f9e79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:36.336199 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8480d3-20a1-4a5a-b81d-f4ee65f9e79b admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:36.336646 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8480d3-20a1-4a5a-b81d-f4ee65f9e79b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:36.337017 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8480d3-20a1-4a5a-b81d-f4ee65f9e79b admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:36.337839 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8480d3-20a1-4a5a-b81d-f4ee65f9e79b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:36.338240 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8480d3-20a1-4a5a-b81d-f4ee65f9e79b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:36.339971 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8480d3-20a1-4a5a-b81d-f4ee65f9e79b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:36.352696 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 368/734] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:36.359555 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b2622-f35e-49ea-943c-a3f216210f85 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:36.369589 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b2622-f35e-49ea-943c-a3f216210f85 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:36.375525 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4626f4-1143-45d7-9cbb-d2f7e3f0f2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:36.376513 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4626f4-1143-45d7-9cbb-d2f7e3f0f2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:36.376901 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4626f4-1143-45d7-9cbb-d2f7e3f0f2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:36.377323 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4626f4-1143-45d7-9cbb-d2f7e3f0f2f9 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:36.385476 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4626f4-1143-45d7-9cbb-d2f7e3f0f2f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:36.387851 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4626f4-1143-45d7-9cbb-d2f7e3f0f2f9 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:36.403070 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-cd4626f4-1143-45d7-9cbb-d2f7e3f0f2f9 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 02:55:36.404813 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 367/735] 10.222.0.23 () {56 vars in 1139 bytes} [Thu Sep 23 02:55:36 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:36.413843 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8480d3-20a1-4a5a-b81d-f4ee65f9e79b admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:36.425530 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8480d3-20a1-4a5a-b81d-f4ee65f9e79b admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:36.431107 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da30491-6354-4a24-8cd0-c4198702eb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:36.431943 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da30491-6354-4a24-8cd0-c4198702eb47 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:36.432331 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da30491-6354-4a24-8cd0-c4198702eb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:36.432755 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da30491-6354-4a24-8cd0-c4198702eb47 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:36.433813 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da30491-6354-4a24-8cd0-c4198702eb47 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:36.434219 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da30491-6354-4a24-8cd0-c4198702eb47 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:36.436306 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da30491-6354-4a24-8cd0-c4198702eb47 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:36.460956 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 369/736] 10.222.0.23 () {56 vars in 1171 bytes} [Thu Sep 23 02:55:36 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:36.467228 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4626f4-1143-45d7-9cbb-d2f7e3f0f2f9 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:36.481691 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4626f4-1143-45d7-9cbb-d2f7e3f0f2f9 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:36.487573 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ea2b9-7a3b-4ed5-838e-794b431ad7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:36.488438 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ea2b9-7a3b-4ed5-838e-794b431ad7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:36.488843 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ea2b9-7a3b-4ed5-838e-794b431ad7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:36.489239 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ea2b9-7a3b-4ed5-838e-794b431ad7a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:36.499222 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ea2b9-7a3b-4ed5-838e-794b431ad7a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:36.505247 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ea2b9-7a3b-4ed5-838e-794b431ad7a1 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:36.514919 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 368/737] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:55:36 2021] GET /identity/v3/auth/tokens => generated 1456 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:55:36.521211 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da30491-6354-4a24-8cd0-c4198702eb47 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:36.534214 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da30491-6354-4a24-8cd0-c4198702eb47 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:36.544250 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4e64f-200a-4f9c-8969-1625e58e9e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:36.545280 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4e64f-200a-4f9c-8969-1625e58e9e3d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:36.545688 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4e64f-200a-4f9c-8969-1625e58e9e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:36.546060 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4e64f-200a-4f9c-8969-1625e58e9e3d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:36.558709 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307a81f-ee28-421d-97b7-a796d4dfdc2f None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:36.558709 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307a81f-ee28-421d-97b7-a796d4dfdc2f None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:36.558709 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307a81f-ee28-421d-97b7-a796d4dfdc2f None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:36.559256 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 369/738] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 02:55:36.560055 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4e64f-200a-4f9c-8969-1625e58e9e3d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:36.562637 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4e64f-200a-4f9c-8969-1625e58e9e3d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:36.566909 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25fe80-7ef2-4aed-bfa8-2fca56c9e471 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:36.567202 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25fe80-7ef2-4aed-bfa8-2fca56c9e471 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:36.567485 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25fe80-7ef2-4aed-bfa8-2fca56c9e471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:36.587018 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-3d25fe80-7ef2-4aed-bfa8-2fca56c9e471 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:36.588214 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-3d25fe80-7ef2-4aed-bfa8-2fca56c9e471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:36.588989 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-22f4e64f-200a-4f9c-8969-1625e58e9e3d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:36.590196 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 370/739] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:36.597211 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4e64f-200a-4f9c-8969-1625e58e9e3d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:36.598084 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 370/740] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:36 2021] POST /identity/v3/auth/tokens => generated 1456 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:36.609308 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4e64f-200a-4f9c-8969-1625e58e9e3d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:36.621073 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d8139-7de6-4848-a5d2-97297f3a204e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:36.621715 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d8139-7de6-4848-a5d2-97297f3a204e admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:36.621995 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d8139-7de6-4848-a5d2-97297f3a204e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:36.622267 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d8139-7de6-4848-a5d2-97297f3a204e admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:36.623514 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d8139-7de6-4848-a5d2-97297f3a204e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:36.623818 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d8139-7de6-4848-a5d2-97297f3a204e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:36.624821 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25fe80-7ef2-4aed-bfa8-2fca56c9e471 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:36.625416 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d8139-7de6-4848-a5d2-97297f3a204e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:36.635298 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25fe80-7ef2-4aed-bfa8-2fca56c9e471 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:36.641151 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c924e-a17d-4a22-a306-f2dac4f0f2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:36.641759 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 371/741] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:36.642164 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c924e-a17d-4a22-a306-f2dac4f0f2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:36.642638 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c924e-a17d-4a22-a306-f2dac4f0f2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:36.643012 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c924e-a17d-4a22-a306-f2dac4f0f2a0 admin admin] PATH_INFO: `/v3/services/network` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:36.643818 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c924e-a17d-4a22-a306-f2dac4f0f2a0 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:36.645576 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c924e-a17d-4a22-a306-f2dac4f0f2a0 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:36.647474 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d8139-7de6-4848-a5d2-97297f3a204e admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:36.659696 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-481c924e-a17d-4a22-a306-f2dac4f0f2a0 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 02:55:36.661144 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d8139-7de6-4848-a5d2-97297f3a204e admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:36.661356 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 371/742] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:36 2021] GET /identity/v3/services/network => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:36.667830 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c924e-a17d-4a22-a306-f2dac4f0f2a0 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:36.670757 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f7074-c79f-417c-94b4-737e413569a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:36.671547 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f7074-c79f-417c-94b4-737e413569a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:36.671832 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f7074-c79f-417c-94b4-737e413569a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:36.672108 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f7074-c79f-417c-94b4-737e413569a9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:36.679479 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c924e-a17d-4a22-a306-f2dac4f0f2a0 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:36.684379 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feea75b-78cf-49bd-bbf7-936306115e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:36.685207 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feea75b-78cf-49bd-bbf7-936306115e7c admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:36.685595 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feea75b-78cf-49bd-bbf7-936306115e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:36.686043 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feea75b-78cf-49bd-bbf7-936306115e7c admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:36.686839 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feea75b-78cf-49bd-bbf7-936306115e7c admin admin] RBAC: Adding query filter params (name=network) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:36.687296 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feea75b-78cf-49bd-bbf7-936306115e7c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:36.689232 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feea75b-78cf-49bd-bbf7-936306115e7c admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:36.689609 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f7074-c79f-417c-94b4-737e413569a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:36.691564 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f7074-c79f-417c-94b4-737e413569a9 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:36.694912 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 372/743] 10.222.0.23 () {56 vars in 1134 bytes} [Thu Sep 23 02:55:36 2021] GET /identity/v3/services?name=network => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:36.701090 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feea75b-78cf-49bd-bbf7-936306115e7c admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:36.710716 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feea75b-78cf-49bd-bbf7-936306115e7c admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:36.711754 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-fa8f7074-c79f-417c-94b4-737e413569a9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:36.715729 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc64d6-60fc-47de-8dc3-04a8b0f3fac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:36.717184 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc64d6-60fc-47de-8dc3-04a8b0f3fac8 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:36.717363 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 372/744] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:36.717824 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc64d6-60fc-47de-8dc3-04a8b0f3fac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:36.718332 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc64d6-60fc-47de-8dc3-04a8b0f3fac8 admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:36.719211 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc64d6-60fc-47de-8dc3-04a8b0f3fac8 admin admin] RBAC: Adding query filter params (type=network) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:36.719770 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc64d6-60fc-47de-8dc3-04a8b0f3fac8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:36.721618 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc64d6-60fc-47de-8dc3-04a8b0f3fac8 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:36.723683 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f7074-c79f-417c-94b4-737e413569a9 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:36.727174 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 373/745] 10.222.0.23 () {56 vars in 1134 bytes} [Thu Sep 23 02:55:36 2021] GET /identity/v3/services?type=network => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:36.733791 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc64d6-60fc-47de-8dc3-04a8b0f3fac8 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:36.742206 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f7074-c79f-417c-94b4-737e413569a9 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:36.744475 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc64d6-60fc-47de-8dc3-04a8b0f3fac8 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:36.749660 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157225f-43ac-46b8-9e6b-d1f0f73fbee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:36.750664 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157225f-43ac-46b8-9e6b-d1f0f73fbee6 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:36.751163 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157225f-43ac-46b8-9e6b-d1f0f73fbee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:36.751680 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157225f-43ac-46b8-9e6b-d1f0f73fbee6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:36.752635 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157225f-43ac-46b8-9e6b-d1f0f73fbee6 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:36.754124 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING py.warnings [None req-c157225f-43ac-46b8-9e6b-d1f0f73fbee6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:55:36.754124 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: warnings.warn(msg) Sep 23 02:55:36.754124 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: Sep 23 02:55:36.755363 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157225f-43ac-46b8-9e6b-d1f0f73fbee6 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:36.757178 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe76c1-f3ef-4316-b5af-6249f7ede7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:36.757854 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe76c1-f3ef-4316-b5af-6249f7ede7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:36.758122 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe76c1-f3ef-4316-b5af-6249f7ede7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:36.758398 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe76c1-f3ef-4316-b5af-6249f7ede7f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:36.759184 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe76c1-f3ef-4316-b5af-6249f7ede7f4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:36.759491 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe76c1-f3ef-4316-b5af-6249f7ede7f4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:36.761357 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe76c1-f3ef-4316-b5af-6249f7ede7f4 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:36.782924 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 373/746] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:36.789411 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe76c1-f3ef-4316-b5af-6249f7ede7f4 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:36.804968 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe76c1-f3ef-4316-b5af-6249f7ede7f4 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:36.826200 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a261b-bf45-4baf-8ddd-4804f08ada1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:36.826876 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a261b-bf45-4baf-8ddd-4804f08ada1b admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:36.827162 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a261b-bf45-4baf-8ddd-4804f08ada1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:36.827500 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a261b-bf45-4baf-8ddd-4804f08ada1b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:36.828282 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a261b-bf45-4baf-8ddd-4804f08ada1b admin admin] RBAC: Adding query filter params (role.id=8e064794445b4039b2cf2d06b26b49de, scope.project.id=73dcb70ac3714a428a717707e6be8201, user.id=96c9b76133d74b79a0d2da9a884651e1) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:36.832610 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a261b-bf45-4baf-8ddd-4804f08ada1b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:36.832610 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a261b-bf45-4baf-8ddd-4804f08ada1b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:36.844650 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 374/747] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:55:36 2021] GET /identity/v3/role_assignments?user.id=96c9b76133d74b79a0d2da9a884651e1&scope.project.id=73dcb70ac3714a428a717707e6be8201&role.id=8e064794445b4039b2cf2d06b26b49de => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:36.878150 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 374/748] 10.222.0.23 () {60 vars in 1166 bytes} [Thu Sep 23 02:55:36 2021] POST /identity/v3/endpoints => generated 327 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 02:55:38.417064 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58502f66-ff7b-498a-a474-ad96053fb6ea None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:38.417931 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58502f66-ff7b-498a-a474-ad96053fb6ea None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:38.418352 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58502f66-ff7b-498a-a474-ad96053fb6ea None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:38.421072 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 375/749] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:38 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:38.422813 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae58f7-441f-477c-ab43-c0e8a0284260 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:38.423231 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae58f7-441f-477c-ab43-c0e8a0284260 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:38.423559 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae58f7-441f-477c-ab43-c0e8a0284260 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:38.425791 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 375/750] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:38.429581 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae89732-5c3a-46a2-a1c5-87469d9b1a09 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:38.430065 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae89732-5c3a-46a2-a1c5-87469d9b1a09 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:38.430486 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae89732-5c3a-46a2-a1c5-87469d9b1a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:38.433898 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca683f-e862-4819-8f8b-26c5a4b03664 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:38.434303 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca683f-e862-4819-8f8b-26c5a4b03664 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:38.434686 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca683f-e862-4819-8f8b-26c5a4b03664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:38.452459 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-7ae89732-5c3a-46a2-a1c5-87469d9b1a09 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:38.454030 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-7ae89732-5c3a-46a2-a1c5-87469d9b1a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:38.454780 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-4bca683f-e862-4819-8f8b-26c5a4b03664 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:38.456076 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-4bca683f-e862-4819-8f8b-26c5a4b03664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:38.473161 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 376/751] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:38 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:38.473454 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 376/752] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:38 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:38.482391 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5cce3-15fd-41f5-9304-b05aa4bc3970 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:38.482697 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5cce3-15fd-41f5-9304-b05aa4bc3970 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:38.482977 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5cce3-15fd-41f5-9304-b05aa4bc3970 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:38.484960 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 377/753] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:38 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:38.495993 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ead1f-008a-4ef4-b7d8-3670a13c1f97 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:38.496414 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ead1f-008a-4ef4-b7d8-3670a13c1f97 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:38.496834 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ead1f-008a-4ef4-b7d8-3670a13c1f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:38.500181 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5cce3-15fd-41f5-9304-b05aa4bc3970 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:38.515310 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5cce3-15fd-41f5-9304-b05aa4bc3970 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:38.515904 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-513ead1f-008a-4ef4-b7d8-3670a13c1f97 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:38.517122 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-513ead1f-008a-4ef4-b7d8-3670a13c1f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:38.520810 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b6811-e085-462a-8215-275cab8ec059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:38.521856 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b6811-e085-462a-8215-275cab8ec059 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:38.522316 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b6811-e085-462a-8215-275cab8ec059 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:38.522891 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b6811-e085-462a-8215-275cab8ec059 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:38.525030 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 377/754] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:38 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:38.533276 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ead1f-008a-4ef4-b7d8-3670a13c1f97 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:38.534719 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b6811-e085-462a-8215-275cab8ec059 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:38.542355 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ead1f-008a-4ef4-b7d8-3670a13c1f97 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:38.542793 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-779b6811-e085-462a-8215-275cab8ec059 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:55:38.549624 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 378/755] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:55:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:38.550781 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b6811-e085-462a-8215-275cab8ec059 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:38.557524 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21815799-86f5-4d26-86f9-8164830b3388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:38.558190 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21815799-86f5-4d26-86f9-8164830b3388 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:38.558480 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21815799-86f5-4d26-86f9-8164830b3388 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:38.558759 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21815799-86f5-4d26-86f9-8164830b3388 admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:38.559486 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21815799-86f5-4d26-86f9-8164830b3388 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:38.561151 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21815799-86f5-4d26-86f9-8164830b3388 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:38.561252 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b6811-e085-462a-8215-275cab8ec059 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:38.565771 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633953aa-d2b3-4886-aaf2-0b4bf8e61869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:38.566435 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633953aa-d2b3-4886-aaf2-0b4bf8e61869 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:38.566719 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633953aa-d2b3-4886-aaf2-0b4bf8e61869 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:38.566994 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633953aa-d2b3-4886-aaf2-0b4bf8e61869 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:38.567730 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633953aa-d2b3-4886-aaf2-0b4bf8e61869 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:38.568037 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633953aa-d2b3-4886-aaf2-0b4bf8e61869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:38.569663 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633953aa-d2b3-4886-aaf2-0b4bf8e61869 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:38.578882 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 379/756] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:55:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:38.579634 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633953aa-d2b3-4886-aaf2-0b4bf8e61869 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:38.593315 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633953aa-d2b3-4886-aaf2-0b4bf8e61869 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:38.597807 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe090a-b055-4e94-896f-d62aa40a3022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:38.598549 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe090a-b055-4e94-896f-d62aa40a3022 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:38.598832 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe090a-b055-4e94-896f-d62aa40a3022 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:38.599111 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe090a-b055-4e94-896f-d62aa40a3022 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:38.599743 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe090a-b055-4e94-896f-d62aa40a3022 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:38.601422 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe090a-b055-4e94-896f-d62aa40a3022 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:38.612079 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-aafe090a-b055-4e94-896f-d62aa40a3022 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 02:55:38.613199 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 380/757] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Sep 23 02:55:38 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:38.613933 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe090a-b055-4e94-896f-d62aa40a3022 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:38.625415 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe090a-b055-4e94-896f-d62aa40a3022 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:38.630080 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3e248-3727-48e4-9faf-235f52718998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:38.630832 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3e248-3727-48e4-9faf-235f52718998 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:38.631119 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3e248-3727-48e4-9faf-235f52718998 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:38.631401 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3e248-3727-48e4-9faf-235f52718998 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:38.643017 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3e248-3727-48e4-9faf-235f52718998 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:38.644877 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3e248-3727-48e4-9faf-235f52718998 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:38.646110 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 378/758] 10.222.0.23 () {60 vars in 1163 bytes} [Thu Sep 23 02:55:38 2021] POST /identity/v3/services => generated 269 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 02:55:38.647613 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21815799-86f5-4d26-86f9-8164830b3388 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:38.662675 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-bad3e248-3727-48e4-9faf-235f52718998 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:38.669273 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 381/759] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:38.670511 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3e248-3727-48e4-9faf-235f52718998 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:38.681484 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3e248-3727-48e4-9faf-235f52718998 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:38.684172 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21815799-86f5-4d26-86f9-8164830b3388 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:38.686794 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb627a-4caf-422e-a44a-6e109c788481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:38.687540 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb627a-4caf-422e-a44a-6e109c788481 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:38.687830 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb627a-4caf-422e-a44a-6e109c788481 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:38.688160 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb627a-4caf-422e-a44a-6e109c788481 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:38.688956 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb627a-4caf-422e-a44a-6e109c788481 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:38.689373 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb627a-4caf-422e-a44a-6e109c788481 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:38.690763 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721f992-f677-498e-aaeb-b67845fe955d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:38.691116 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb627a-4caf-422e-a44a-6e109c788481 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:38.691866 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721f992-f677-498e-aaeb-b67845fe955d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:38.692323 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721f992-f677-498e-aaeb-b67845fe955d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:38.693082 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721f992-f677-498e-aaeb-b67845fe955d admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:38.694619 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721f992-f677-498e-aaeb-b67845fe955d admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:38.695131 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721f992-f677-498e-aaeb-b67845fe955d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:38.697149 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721f992-f677-498e-aaeb-b67845fe955d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:38.704536 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 379/760] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Sep 23 02:55:38 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:38.710884 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 382/761] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:38.712255 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721f992-f677-498e-aaeb-b67845fe955d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:38.715180 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb627a-4caf-422e-a44a-6e109c788481 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:38.725992 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721f992-f677-498e-aaeb-b67845fe955d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:38.729394 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb627a-4caf-422e-a44a-6e109c788481 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:38.736592 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bb9f0-9650-45f5-98af-9bbdb8cad1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:38.737414 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bb9f0-9650-45f5-98af-9bbdb8cad1bb admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:38.737698 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bb9f0-9650-45f5-98af-9bbdb8cad1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:38.738033 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bb9f0-9650-45f5-98af-9bbdb8cad1bb admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:38.739037 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842d697-ff87-40b2-ae00-e7bfd3b45fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:38.739955 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842d697-ff87-40b2-ae00-e7bfd3b45fab admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:38.740479 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842d697-ff87-40b2-ae00-e7bfd3b45fab admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:38.740965 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842d697-ff87-40b2-ae00-e7bfd3b45fab admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:38.741921 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842d697-ff87-40b2-ae00-e7bfd3b45fab admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:38.742414 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842d697-ff87-40b2-ae00-e7bfd3b45fab admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:38.744312 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842d697-ff87-40b2-ae00-e7bfd3b45fab admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:38.748601 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bb9f0-9650-45f5-98af-9bbdb8cad1bb admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:38.750807 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bb9f0-9650-45f5-98af-9bbdb8cad1bb admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:38.751715 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 383/762] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Sep 23 02:55:38 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:38.774763 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-425bb9f0-9650-45f5-98af-9bbdb8cad1bb admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 23 02:55:38.776886 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 380/763] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:55:38 2021] GET /identity/v3/users/swift => generated 83 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:38.784538 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842d697-ff87-40b2-ae00-e7bfd3b45fab admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:38.796035 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842d697-ff87-40b2-ae00-e7bfd3b45fab admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:38.801436 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffe7c9-87d1-4ff2-b73a-3c2bcf89df76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:38.802544 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffe7c9-87d1-4ff2-b73a-3c2bcf89df76 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:38.803083 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffe7c9-87d1-4ff2-b73a-3c2bcf89df76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:38.803560 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffe7c9-87d1-4ff2-b73a-3c2bcf89df76 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:38.804707 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffe7c9-87d1-4ff2-b73a-3c2bcf89df76 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:38.805303 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffe7c9-87d1-4ff2-b73a-3c2bcf89df76 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:38.813883 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffe7c9-87d1-4ff2-b73a-3c2bcf89df76 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:38.837216 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 384/764] 10.222.0.23 () {56 vars in 1157 bytes} [Thu Sep 23 02:55:38 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:38.844460 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bb9f0-9650-45f5-98af-9bbdb8cad1bb admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:38.855323 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bb9f0-9650-45f5-98af-9bbdb8cad1bb admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:38.860445 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ca6ad-809e-4877-a1c2-b46dbc0e41ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:38.861479 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ca6ad-809e-4877-a1c2-b46dbc0e41ff admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:38.861973 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ca6ad-809e-4877-a1c2-b46dbc0e41ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:38.862518 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ca6ad-809e-4877-a1c2-b46dbc0e41ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:38.871751 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ca6ad-809e-4877-a1c2-b46dbc0e41ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:38.874494 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ca6ad-809e-4877-a1c2-b46dbc0e41ff admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:38.885737 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 381/765] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:55:38 2021] GET /identity/v3/auth/tokens => generated 1715 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:55:38.894472 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffe7c9-87d1-4ff2-b73a-3c2bcf89df76 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:38.905001 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffe7c9-87d1-4ff2-b73a-3c2bcf89df76 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:38.909982 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed153ceb-3968-42b8-820a-255f7d026b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:38.910857 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed153ceb-3968-42b8-820a-255f7d026b56 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:38.911143 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed153ceb-3968-42b8-820a-255f7d026b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:38.911423 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed153ceb-3968-42b8-820a-255f7d026b56 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:38.925607 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed153ceb-3968-42b8-820a-255f7d026b56 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:38.927387 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed153ceb-3968-42b8-820a-255f7d026b56 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:38.949091 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-ed153ceb-3968-42b8-820a-255f7d026b56 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:38.951511 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 385/766] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:38.957388 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ca6ad-809e-4877-a1c2-b46dbc0e41ff admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:38.975886 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ca6ad-809e-4877-a1c2-b46dbc0e41ff admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:38.984725 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817fdb2-2501-4e0c-8047-61a0a872b55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:38.985613 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817fdb2-2501-4e0c-8047-61a0a872b55f admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:38.986077 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817fdb2-2501-4e0c-8047-61a0a872b55f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:38.986556 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817fdb2-2501-4e0c-8047-61a0a872b55f admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:38.987473 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817fdb2-2501-4e0c-8047-61a0a872b55f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:38.988011 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817fdb2-2501-4e0c-8047-61a0a872b55f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:38.989857 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817fdb2-2501-4e0c-8047-61a0a872b55f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:39.003483 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 382/767] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:39.009969 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed153ceb-3968-42b8-820a-255f7d026b56 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:39.021020 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed153ceb-3968-42b8-820a-255f7d026b56 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:39.026103 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c510f3-795b-4481-9707-c2810df3ed2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:39.027161 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c510f3-795b-4481-9707-c2810df3ed2b admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:39.027635 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c510f3-795b-4481-9707-c2810df3ed2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:39.028123 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c510f3-795b-4481-9707-c2810df3ed2b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:39.036660 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c510f3-795b-4481-9707-c2810df3ed2b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:39.038918 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c510f3-795b-4481-9707-c2810df3ed2b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:39.052670 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-31c510f3-795b-4481-9707-c2810df3ed2b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:39.054448 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 386/768] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:39.061532 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817fdb2-2501-4e0c-8047-61a0a872b55f admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:39.072181 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817fdb2-2501-4e0c-8047-61a0a872b55f admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:39.077491 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c77d4-74da-4097-8189-cc6c8cfd11ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:39.078446 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c77d4-74da-4097-8189-cc6c8cfd11ea admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:39.078893 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c77d4-74da-4097-8189-cc6c8cfd11ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:39.079654 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c77d4-74da-4097-8189-cc6c8cfd11ea admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:39.080345 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c77d4-74da-4097-8189-cc6c8cfd11ea admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:39.080798 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c77d4-74da-4097-8189-cc6c8cfd11ea admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:39.082739 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c77d4-74da-4097-8189-cc6c8cfd11ea admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:39.096950 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 383/769] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:39.103547 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c510f3-795b-4481-9707-c2810df3ed2b admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:39.114651 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c510f3-795b-4481-9707-c2810df3ed2b admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:39.119601 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4549fc9-8cab-43fc-8ce0-239f4f8927ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:39.120262 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4549fc9-8cab-43fc-8ce0-239f4f8927ef admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:39.120568 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4549fc9-8cab-43fc-8ce0-239f4f8927ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:39.120899 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4549fc9-8cab-43fc-8ce0-239f4f8927ef admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:39.121726 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4549fc9-8cab-43fc-8ce0-239f4f8927ef admin admin] RBAC: Adding query filter params (role.id=3e7d7427203a4a4097e2c9a642b9bf69, scope.project.id=73dcb70ac3714a428a717707e6be8201, user.id=df051fd059b34fe0993f501546d1610f) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:39.122101 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4549fc9-8cab-43fc-8ce0-239f4f8927ef admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:39.124210 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4549fc9-8cab-43fc-8ce0-239f4f8927ef admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:39.130809 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 387/770] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:55:39 2021] GET /identity/v3/role_assignments?user.id=df051fd059b34fe0993f501546d1610f&scope.project.id=73dcb70ac3714a428a717707e6be8201&role.id=3e7d7427203a4a4097e2c9a642b9bf69 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:39.260385 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac03176-18c1-4175-b6b9-0dbed68a03ea None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:39.260605 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac03176-18c1-4175-b6b9-0dbed68a03ea None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:39.260874 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac03176-18c1-4175-b6b9-0dbed68a03ea None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:39.263856 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 384/771] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:39.271533 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062ca2f-4e35-4e1a-8632-ee38134c09d7 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:39.271836 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062ca2f-4e35-4e1a-8632-ee38134c09d7 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:39.272095 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062ca2f-4e35-4e1a-8632-ee38134c09d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:39.291143 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-d062ca2f-4e35-4e1a-8632-ee38134c09d7 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:39.292378 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-d062ca2f-4e35-4e1a-8632-ee38134c09d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:39.301173 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 388/772] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:39 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:39.325503 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac03176-18c1-4175-b6b9-0dbed68a03ea None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:39.341073 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac03176-18c1-4175-b6b9-0dbed68a03ea None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:39.345767 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fcacf-dc32-4247-9dbb-123fbca3e942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:39.346755 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fcacf-dc32-4247-9dbb-123fbca3e942 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:39.347042 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fcacf-dc32-4247-9dbb-123fbca3e942 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:39.347318 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fcacf-dc32-4247-9dbb-123fbca3e942 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:39.358400 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04fcacf-dc32-4247-9dbb-123fbca3e942 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:39.366080 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-c04fcacf-dc32-4247-9dbb-123fbca3e942 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 02:55:39.367603 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 385/773] 10.222.0.23 () {56 vars in 1142 bytes} [Thu Sep 23 02:55:39 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:39.374129 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062ca2f-4e35-4e1a-8632-ee38134c09d7 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:39.386065 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062ca2f-4e35-4e1a-8632-ee38134c09d7 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:39.391794 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d1db4-e3f9-42ad-8be3-cd82702d610a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:39.392460 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d1db4-e3f9-42ad-8be3-cd82702d610a admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:39.392830 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d1db4-e3f9-42ad-8be3-cd82702d610a admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:39.393102 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d1db4-e3f9-42ad-8be3-cd82702d610a admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:39.393846 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d1db4-e3f9-42ad-8be3-cd82702d610a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:39.394152 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d1db4-e3f9-42ad-8be3-cd82702d610a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:39.395731 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d1db4-e3f9-42ad-8be3-cd82702d610a admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:39.405529 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 389/774] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Sep 23 02:55:39 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:39.411473 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fcacf-dc32-4247-9dbb-123fbca3e942 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:39.422467 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fcacf-dc32-4247-9dbb-123fbca3e942 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:39.428305 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c8a3c-982f-4140-b12f-0ce7772ef14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:39.429128 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c8a3c-982f-4140-b12f-0ce7772ef14d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:39.429420 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c8a3c-982f-4140-b12f-0ce7772ef14d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:39.429680 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c8a3c-982f-4140-b12f-0ce7772ef14d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:39.440408 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c8a3c-982f-4140-b12f-0ce7772ef14d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:39.442253 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c8a3c-982f-4140-b12f-0ce7772ef14d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:39.470996 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-817c8a3c-982f-4140-b12f-0ce7772ef14d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:39.472514 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 386/775] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:39.478695 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d1db4-e3f9-42ad-8be3-cd82702d610a admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:39.489196 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d1db4-e3f9-42ad-8be3-cd82702d610a admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:39.493762 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415113b-6de2-4cf6-bd81-15af7e5d4ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:39.494578 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415113b-6de2-4cf6-bd81-15af7e5d4ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:39.494929 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415113b-6de2-4cf6-bd81-15af7e5d4ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:39.495316 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415113b-6de2-4cf6-bd81-15af7e5d4ea6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:39.496113 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415113b-6de2-4cf6-bd81-15af7e5d4ea6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:39.496515 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415113b-6de2-4cf6-bd81-15af7e5d4ea6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:39.498680 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415113b-6de2-4cf6-bd81-15af7e5d4ea6 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:39.511403 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 390/776] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:39.518134 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c8a3c-982f-4140-b12f-0ce7772ef14d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:39.528336 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c8a3c-982f-4140-b12f-0ce7772ef14d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:39.533620 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0faa39-f993-40fd-a0c7-ad7311ad397e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:39.534689 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0faa39-f993-40fd-a0c7-ad7311ad397e admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:39.535181 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0faa39-f993-40fd-a0c7-ad7311ad397e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:39.535645 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0faa39-f993-40fd-a0c7-ad7311ad397e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:39.544162 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0faa39-f993-40fd-a0c7-ad7311ad397e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:39.546483 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0faa39-f993-40fd-a0c7-ad7311ad397e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:39.561589 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-7e0faa39-f993-40fd-a0c7-ad7311ad397e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 02:55:39.563067 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 387/777] 10.222.0.23 () {56 vars in 1139 bytes} [Thu Sep 23 02:55:39 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:39.569436 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415113b-6de2-4cf6-bd81-15af7e5d4ea6 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:39.580031 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415113b-6de2-4cf6-bd81-15af7e5d4ea6 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:39.584721 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b47e05-b062-43e9-8007-c6ce94be3d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:39.585403 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b47e05-b062-43e9-8007-c6ce94be3d79 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:39.585688 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b47e05-b062-43e9-8007-c6ce94be3d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:39.585968 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b47e05-b062-43e9-8007-c6ce94be3d79 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:39.586807 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b47e05-b062-43e9-8007-c6ce94be3d79 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:39.587115 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b47e05-b062-43e9-8007-c6ce94be3d79 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:39.589026 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b47e05-b062-43e9-8007-c6ce94be3d79 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:39.607623 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 391/778] 10.222.0.23 () {56 vars in 1171 bytes} [Thu Sep 23 02:55:39 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:39.613385 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0faa39-f993-40fd-a0c7-ad7311ad397e admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:39.623757 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0faa39-f993-40fd-a0c7-ad7311ad397e admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:39.628286 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bab8a-45a1-4ebc-a901-b0188117783d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:39.628960 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bab8a-45a1-4ebc-a901-b0188117783d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:39.629241 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bab8a-45a1-4ebc-a901-b0188117783d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:39.629514 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bab8a-45a1-4ebc-a901-b0188117783d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:39.638825 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0bab8a-45a1-4ebc-a901-b0188117783d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:39.640853 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0bab8a-45a1-4ebc-a901-b0188117783d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:39.650896 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 388/779] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:55:39 2021] GET /identity/v3/auth/tokens => generated 1715 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:55:39.657681 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b47e05-b062-43e9-8007-c6ce94be3d79 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:39.669531 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b47e05-b062-43e9-8007-c6ce94be3d79 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:39.674472 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482ee7f-f375-4fe1-ae31-b2c5646c711e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:39.675557 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482ee7f-f375-4fe1-ae31-b2c5646c711e admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:39.676052 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482ee7f-f375-4fe1-ae31-b2c5646c711e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:39.676542 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482ee7f-f375-4fe1-ae31-b2c5646c711e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:39.688190 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0482ee7f-f375-4fe1-ae31-b2c5646c711e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:39.690329 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0482ee7f-f375-4fe1-ae31-b2c5646c711e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:39.708152 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-0482ee7f-f375-4fe1-ae31-b2c5646c711e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:39.709918 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 392/780] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:39.716084 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bab8a-45a1-4ebc-a901-b0188117783d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:39.726170 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bab8a-45a1-4ebc-a901-b0188117783d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:39.731089 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7cff8-3bd8-4b05-8c73-54de85ab9040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:39.731997 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7cff8-3bd8-4b05-8c73-54de85ab9040 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:39.732515 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7cff8-3bd8-4b05-8c73-54de85ab9040 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:39.732960 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7cff8-3bd8-4b05-8c73-54de85ab9040 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:39.733909 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7cff8-3bd8-4b05-8c73-54de85ab9040 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:39.734386 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7cff8-3bd8-4b05-8c73-54de85ab9040 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:39.736120 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7cff8-3bd8-4b05-8c73-54de85ab9040 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:39.750042 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 389/781] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:39.756225 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482ee7f-f375-4fe1-ae31-b2c5646c711e admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:39.766638 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482ee7f-f375-4fe1-ae31-b2c5646c711e admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:39.771913 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ac45e-ca44-434d-904e-5ca666b44911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:39.772992 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ac45e-ca44-434d-904e-5ca666b44911 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:39.773448 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ac45e-ca44-434d-904e-5ca666b44911 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:39.773929 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ac45e-ca44-434d-904e-5ca666b44911 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:39.781797 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ac45e-ca44-434d-904e-5ca666b44911 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:39.783972 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ac45e-ca44-434d-904e-5ca666b44911 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:39.797140 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-803ac45e-ca44-434d-904e-5ca666b44911 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:39.798804 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 393/782] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:39.805235 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7cff8-3bd8-4b05-8c73-54de85ab9040 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:39.816392 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7cff8-3bd8-4b05-8c73-54de85ab9040 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:39.825819 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80309a0-8b47-4007-a051-2279c836909d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:39.826879 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80309a0-8b47-4007-a051-2279c836909d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:39.827400 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80309a0-8b47-4007-a051-2279c836909d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:39.827855 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80309a0-8b47-4007-a051-2279c836909d admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:39.828887 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80309a0-8b47-4007-a051-2279c836909d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:39.829381 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80309a0-8b47-4007-a051-2279c836909d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:39.831687 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80309a0-8b47-4007-a051-2279c836909d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:39.845003 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 390/783] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:39.851868 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ac45e-ca44-434d-904e-5ca666b44911 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:39.862797 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ac45e-ca44-434d-904e-5ca666b44911 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:39.867713 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ff08e-5e52-4b0e-9a21-7c6892380d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:39.868610 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ff08e-5e52-4b0e-9a21-7c6892380d95 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:39.869060 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ff08e-5e52-4b0e-9a21-7c6892380d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:39.869529 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ff08e-5e52-4b0e-9a21-7c6892380d95 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:39.870551 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ff08e-5e52-4b0e-9a21-7c6892380d95 admin admin] RBAC: Adding query filter params (role.id=315578ac69fb46e3abcddcd340bbd0a7, scope.project.id=73dcb70ac3714a428a717707e6be8201, user.id=96c9b76133d74b79a0d2da9a884651e1) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:39.871062 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ff08e-5e52-4b0e-9a21-7c6892380d95 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:39.873147 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ff08e-5e52-4b0e-9a21-7c6892380d95 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:39.879239 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 394/784] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:55:39 2021] GET /identity/v3/role_assignments?user.id=96c9b76133d74b79a0d2da9a884651e1&scope.project.id=73dcb70ac3714a428a717707e6be8201&role.id=315578ac69fb46e3abcddcd340bbd0a7 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:40.943512 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c967cf8-07cb-47ae-a23d-eaa7d410a842 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:40.944032 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c967cf8-07cb-47ae-a23d-eaa7d410a842 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:40.944032 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c967cf8-07cb-47ae-a23d-eaa7d410a842 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:40.946280 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 391/785] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:40.955166 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab99fe5-b6ab-4051-919f-c3858e03186a None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:40.955744 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab99fe5-b6ab-4051-919f-c3858e03186a None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:40.955744 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab99fe5-b6ab-4051-919f-c3858e03186a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:40.975342 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-5ab99fe5-b6ab-4051-919f-c3858e03186a None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:40.976583 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-5ab99fe5-b6ab-4051-919f-c3858e03186a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:40.992607 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 395/786] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:40 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:41.009566 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c967cf8-07cb-47ae-a23d-eaa7d410a842 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:41.023446 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be857432-1d79-46d3-b611-513cdf6858d8 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:41.023741 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be857432-1d79-46d3-b611-513cdf6858d8 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:41.024015 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be857432-1d79-46d3-b611-513cdf6858d8 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:41.024811 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c967cf8-07cb-47ae-a23d-eaa7d410a842 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:41.026227 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 396/787] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:41.032429 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591154cb-d9d7-4745-86b0-e3295219a7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:41.033265 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591154cb-d9d7-4745-86b0-e3295219a7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:41.033553 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591154cb-d9d7-4745-86b0-e3295219a7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:41.034146 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591154cb-d9d7-4745-86b0-e3295219a7a7 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:41.035384 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913c2b0-54b4-4ed5-8dbf-3c624c142397 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:41.035667 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913c2b0-54b4-4ed5-8dbf-3c624c142397 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:41.035950 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913c2b0-54b4-4ed5-8dbf-3c624c142397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:41.036599 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591154cb-d9d7-4745-86b0-e3295219a7a7 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:41.038500 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591154cb-d9d7-4745-86b0-e3295219a7a7 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:41.050986 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-591154cb-d9d7-4745-86b0-e3295219a7a7 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 02:55:41.052847 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 392/788] 10.222.0.23 () {56 vars in 1154 bytes} [Thu Sep 23 02:55:41 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:41.058227 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-8913c2b0-54b4-4ed5-8dbf-3c624c142397 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:41.059817 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-8913c2b0-54b4-4ed5-8dbf-3c624c142397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:41.061668 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591154cb-d9d7-4745-86b0-e3295219a7a7 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:41.068272 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 397/789] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:41 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:41.073042 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591154cb-d9d7-4745-86b0-e3295219a7a7 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:41.078033 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e5b93-d104-4f90-a85e-b1252a02e24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:41.078937 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e5b93-d104-4f90-a85e-b1252a02e24a admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:41.079452 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e5b93-d104-4f90-a85e-b1252a02e24a admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:41.079949 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e5b93-d104-4f90-a85e-b1252a02e24a admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:41.080888 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e5b93-d104-4f90-a85e-b1252a02e24a admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:41.081400 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e5b93-d104-4f90-a85e-b1252a02e24a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:41.083194 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e5b93-d104-4f90-a85e-b1252a02e24a admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:41.092584 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 393/790] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 23 02:55:41 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:41.094067 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913c2b0-54b4-4ed5-8dbf-3c624c142397 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:41.099227 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e5b93-d104-4f90-a85e-b1252a02e24a admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:41.103451 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913c2b0-54b4-4ed5-8dbf-3c624c142397 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:41.108860 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16416b-cbcb-457f-a6ea-34dc16729241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:41.109634 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16416b-cbcb-457f-a6ea-34dc16729241 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:41.109986 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16416b-cbcb-457f-a6ea-34dc16729241 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:41.110341 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16416b-cbcb-457f-a6ea-34dc16729241 admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:41.111155 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16416b-cbcb-457f-a6ea-34dc16729241 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:41.112250 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING py.warnings [None req-0b16416b-cbcb-457f-a6ea-34dc16729241 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:55:41.112250 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: warnings.warn(msg) Sep 23 02:55:41.112250 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: Sep 23 02:55:41.112664 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e5b93-d104-4f90-a85e-b1252a02e24a admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:41.113346 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16416b-cbcb-457f-a6ea-34dc16729241 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:41.117569 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f3145-31c7-4e0c-bb2b-2ccad29c5058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:41.118426 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f3145-31c7-4e0c-bb2b-2ccad29c5058 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:41.118928 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f3145-31c7-4e0c-bb2b-2ccad29c5058 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:41.119385 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f3145-31c7-4e0c-bb2b-2ccad29c5058 admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:41.120251 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f3145-31c7-4e0c-bb2b-2ccad29c5058 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:41.120762 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f3145-31c7-4e0c-bb2b-2ccad29c5058 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:41.122538 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f3145-31c7-4e0c-bb2b-2ccad29c5058 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:41.133111 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 394/791] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 23 02:55:41 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:41.134452 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f3145-31c7-4e0c-bb2b-2ccad29c5058 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:41.144395 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f3145-31c7-4e0c-bb2b-2ccad29c5058 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:41.149070 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdd248-297c-4552-b3a6-701ecc88ff45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:41.149718 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdd248-297c-4552-b3a6-701ecc88ff45 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:41.150005 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdd248-297c-4552-b3a6-701ecc88ff45 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:41.150281 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdd248-297c-4552-b3a6-701ecc88ff45 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:41.151067 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdd248-297c-4552-b3a6-701ecc88ff45 admin admin] RBAC: Adding query filter params (interface=public, service_id=d1ad0267c1c74974846464d2d8428c91, region_id=RegionOne) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:41.151382 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdd248-297c-4552-b3a6-701ecc88ff45 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:41.152994 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdd248-297c-4552-b3a6-701ecc88ff45 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:41.159272 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 395/792] 10.222.0.23 () {56 vars in 1273 bytes} [Thu Sep 23 02:55:41 2021] GET /identity/v3/endpoints?service_id=d1ad0267c1c74974846464d2d8428c91&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:41.165654 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdd248-297c-4552-b3a6-701ecc88ff45 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:41.176640 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdd248-297c-4552-b3a6-701ecc88ff45 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:41.181336 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2b178-5bef-4fa7-9db9-0092a87e2e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:41.182045 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2b178-5bef-4fa7-9db9-0092a87e2e1c admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:41.182322 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2b178-5bef-4fa7-9db9-0092a87e2e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:41.182597 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2b178-5bef-4fa7-9db9-0092a87e2e1c admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:41.183326 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2b178-5bef-4fa7-9db9-0092a87e2e1c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:41.185077 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2b178-5bef-4fa7-9db9-0092a87e2e1c admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:41.191118 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 396/793] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 23 02:55:41 2021] GET /identity/v3/services => generated 1029 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 02:55:41.218509 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 398/794] 10.222.0.23 () {60 vars in 1163 bytes} [Thu Sep 23 02:55:41 2021] POST /identity/v3/services => generated 251 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 02:55:41.524462 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476e288-03bc-478b-aeb8-3a739e917063 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:41.524819 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476e288-03bc-478b-aeb8-3a739e917063 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:41.524993 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476e288-03bc-478b-aeb8-3a739e917063 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:41.527016 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 397/795] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:41.535259 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd878d9a-3483-464f-8e18-bc56ff33a6d7 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:41.535552 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd878d9a-3483-464f-8e18-bc56ff33a6d7 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:41.535839 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd878d9a-3483-464f-8e18-bc56ff33a6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:41.553346 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-dd878d9a-3483-464f-8e18-bc56ff33a6d7 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:41.554532 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-dd878d9a-3483-464f-8e18-bc56ff33a6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:41.571064 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 399/796] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:41 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:41.594773 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476e288-03bc-478b-aeb8-3a739e917063 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:41.607644 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476e288-03bc-478b-aeb8-3a739e917063 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:41.612078 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7a316-3b94-44f9-9614-2e5f4fa9b5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:41.612915 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7a316-3b94-44f9-9614-2e5f4fa9b5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:41.613196 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7a316-3b94-44f9-9614-2e5f4fa9b5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:41.613471 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7a316-3b94-44f9-9614-2e5f4fa9b5e9 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:41.614122 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7a316-3b94-44f9-9614-2e5f4fa9b5e9 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:41.615700 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7a316-3b94-44f9-9614-2e5f4fa9b5e9 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:41.626833 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-9cc7a316-3b94-44f9-9614-2e5f4fa9b5e9 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 02:55:41.628287 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 398/797] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 23 02:55:41 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:41.634932 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd878d9a-3483-464f-8e18-bc56ff33a6d7 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:41.644720 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd878d9a-3483-464f-8e18-bc56ff33a6d7 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:41.649305 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053dedf3-19ad-44af-af4a-4a8e811d2dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:41.649969 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dedf3-19ad-44af-af4a-4a8e811d2dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:41.650253 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dedf3-19ad-44af-af4a-4a8e811d2dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:41.650528 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dedf3-19ad-44af-af4a-4a8e811d2dc0 admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:41.651228 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053dedf3-19ad-44af-af4a-4a8e811d2dc0 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:41.651535 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053dedf3-19ad-44af-af4a-4a8e811d2dc0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:41.653169 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053dedf3-19ad-44af-af4a-4a8e811d2dc0 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:41.658743 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 400/798] 10.222.0.23 () {56 vars in 1144 bytes} [Thu Sep 23 02:55:41 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:41.665010 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7a316-3b94-44f9-9614-2e5f4fa9b5e9 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:41.675509 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7a316-3b94-44f9-9614-2e5f4fa9b5e9 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:41.680364 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa2921-ada7-469b-a6ee-1982e4a877ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:41.681057 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa2921-ada7-469b-a6ee-1982e4a877ea admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:41.681341 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa2921-ada7-469b-a6ee-1982e4a877ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:41.681664 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa2921-ada7-469b-a6ee-1982e4a877ea admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:41.682372 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa2921-ada7-469b-a6ee-1982e4a877ea admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:41.682740 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa2921-ada7-469b-a6ee-1982e4a877ea admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:41.684390 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa2921-ada7-469b-a6ee-1982e4a877ea admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:41.689532 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 399/799] 10.222.0.23 () {56 vars in 1144 bytes} [Thu Sep 23 02:55:41 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:42.085228 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ca058-04bd-4b41-986a-dfe662d54043 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:42.085882 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ca058-04bd-4b41-986a-dfe662d54043 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:42.085882 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ca058-04bd-4b41-986a-dfe662d54043 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:42.087705 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 401/800] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:42.095783 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e91a9d-eb1e-45ab-a30e-62d20930c700 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:42.096330 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e91a9d-eb1e-45ab-a30e-62d20930c700 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:42.096516 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e91a9d-eb1e-45ab-a30e-62d20930c700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:42.114530 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-23e91a9d-eb1e-45ab-a30e-62d20930c700 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:42.115707 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-23e91a9d-eb1e-45ab-a30e-62d20930c700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:42.123919 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 400/801] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:42 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:42.147846 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ca058-04bd-4b41-986a-dfe662d54043 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:42.160201 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ca058-04bd-4b41-986a-dfe662d54043 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:42.164694 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b953b-2519-45b7-987b-526682475104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:42.165490 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b953b-2519-45b7-987b-526682475104 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:42.165770 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b953b-2519-45b7-987b-526682475104 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:42.166045 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b953b-2519-45b7-987b-526682475104 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:42.181113 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b953b-2519-45b7-987b-526682475104 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:42.188568 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-668b953b-2519-45b7-987b-526682475104 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 02:55:42.190060 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 402/802] 10.222.0.23 () {56 vars in 1142 bytes} [Thu Sep 23 02:55:42 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:42.196409 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e91a9d-eb1e-45ab-a30e-62d20930c700 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:42.205983 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e91a9d-eb1e-45ab-a30e-62d20930c700 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:42.210565 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c745f-da12-413d-8685-9a7f031e4196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:42.211220 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c745f-da12-413d-8685-9a7f031e4196 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:42.211497 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c745f-da12-413d-8685-9a7f031e4196 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:42.211775 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c745f-da12-413d-8685-9a7f031e4196 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:42.212539 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c745f-da12-413d-8685-9a7f031e4196 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:42.212847 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c745f-da12-413d-8685-9a7f031e4196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:42.214414 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c745f-da12-413d-8685-9a7f031e4196 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:42.222700 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 401/803] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Sep 23 02:55:42 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:42.228762 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b953b-2519-45b7-987b-526682475104 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:42.238816 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b953b-2519-45b7-987b-526682475104 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:42.243374 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc67c8-ac96-4cbe-b39b-1852a7f11625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:42.244201 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc67c8-ac96-4cbe-b39b-1852a7f11625 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:42.244498 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc67c8-ac96-4cbe-b39b-1852a7f11625 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:42.244779 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc67c8-ac96-4cbe-b39b-1852a7f11625 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:42.255917 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc67c8-ac96-4cbe-b39b-1852a7f11625 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:42.257848 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc67c8-ac96-4cbe-b39b-1852a7f11625 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:42.274612 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-d2bc67c8-ac96-4cbe-b39b-1852a7f11625 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:42.276104 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 403/804] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:42.282401 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c745f-da12-413d-8685-9a7f031e4196 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:42.292249 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c745f-da12-413d-8685-9a7f031e4196 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:42.297595 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a83f62-40d2-4899-b55d-b62757cd8bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:42.298263 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a83f62-40d2-4899-b55d-b62757cd8bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:42.298540 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a83f62-40d2-4899-b55d-b62757cd8bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:42.298868 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a83f62-40d2-4899-b55d-b62757cd8bf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:42.299582 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a83f62-40d2-4899-b55d-b62757cd8bf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:42.299932 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a83f62-40d2-4899-b55d-b62757cd8bf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:42.301619 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a83f62-40d2-4899-b55d-b62757cd8bf7 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:42.314996 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 402/805] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:42.321264 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc67c8-ac96-4cbe-b39b-1852a7f11625 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:42.331957 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc67c8-ac96-4cbe-b39b-1852a7f11625 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:42.336811 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcdc9a-1c1a-49fc-919d-b5a50c045ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:42.337618 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcdc9a-1c1a-49fc-919d-b5a50c045ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:42.337895 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcdc9a-1c1a-49fc-919d-b5a50c045ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:42.338219 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcdc9a-1c1a-49fc-919d-b5a50c045ce9 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:42.346811 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fcdc9a-1c1a-49fc-919d-b5a50c045ce9 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:42.348915 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fcdc9a-1c1a-49fc-919d-b5a50c045ce9 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:42.363513 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-c3fcdc9a-1c1a-49fc-919d-b5a50c045ce9 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 02:55:42.364999 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 404/806] 10.222.0.23 () {56 vars in 1139 bytes} [Thu Sep 23 02:55:42 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:42.371280 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a83f62-40d2-4899-b55d-b62757cd8bf7 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:42.385265 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a83f62-40d2-4899-b55d-b62757cd8bf7 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:42.390862 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206da29-c38f-4737-ae06-90fb954720fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:42.391790 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206da29-c38f-4737-ae06-90fb954720fd admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:42.392266 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206da29-c38f-4737-ae06-90fb954720fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:42.392735 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206da29-c38f-4737-ae06-90fb954720fd admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:42.393787 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206da29-c38f-4737-ae06-90fb954720fd admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:42.394277 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206da29-c38f-4737-ae06-90fb954720fd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:42.396334 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206da29-c38f-4737-ae06-90fb954720fd admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:42.414768 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 403/807] 10.222.0.23 () {56 vars in 1171 bytes} [Thu Sep 23 02:55:42 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:42.421732 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcdc9a-1c1a-49fc-919d-b5a50c045ce9 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:42.436173 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcdc9a-1c1a-49fc-919d-b5a50c045ce9 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:42.441106 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934df5dd-aff0-4660-8099-1adb012dc0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:42.442028 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934df5dd-aff0-4660-8099-1adb012dc0ac admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:42.442311 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934df5dd-aff0-4660-8099-1adb012dc0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:42.442584 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934df5dd-aff0-4660-8099-1adb012dc0ac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:42.456739 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934df5dd-aff0-4660-8099-1adb012dc0ac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:42.458676 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934df5dd-aff0-4660-8099-1adb012dc0ac admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:42.477541 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-934df5dd-aff0-4660-8099-1adb012dc0ac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:42.479123 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 405/808] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:42.485896 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206da29-c38f-4737-ae06-90fb954720fd admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:42.495894 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206da29-c38f-4737-ae06-90fb954720fd admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:42.501339 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde0d32-dc1e-4e8a-b7e5-c77c7538e43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:42.502338 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde0d32-dc1e-4e8a-b7e5-c77c7538e43c admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:42.502841 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde0d32-dc1e-4e8a-b7e5-c77c7538e43c admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:42.503358 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde0d32-dc1e-4e8a-b7e5-c77c7538e43c admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:42.504273 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde0d32-dc1e-4e8a-b7e5-c77c7538e43c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:42.504834 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde0d32-dc1e-4e8a-b7e5-c77c7538e43c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:42.506673 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde0d32-dc1e-4e8a-b7e5-c77c7538e43c admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:42.520010 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 404/809] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:42.526624 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934df5dd-aff0-4660-8099-1adb012dc0ac admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:42.537547 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934df5dd-aff0-4660-8099-1adb012dc0ac admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:42.542628 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefa591-e1c3-4035-8fbd-6334392a6dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:42.543709 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefa591-e1c3-4035-8fbd-6334392a6dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:42.544296 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefa591-e1c3-4035-8fbd-6334392a6dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:42.544832 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefa591-e1c3-4035-8fbd-6334392a6dd0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:42.552534 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefa591-e1c3-4035-8fbd-6334392a6dd0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:42.554848 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefa591-e1c3-4035-8fbd-6334392a6dd0 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:42.569807 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-dfefa591-e1c3-4035-8fbd-6334392a6dd0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:42.571700 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 406/810] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:42.578329 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde0d32-dc1e-4e8a-b7e5-c77c7538e43c admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:42.588875 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde0d32-dc1e-4e8a-b7e5-c77c7538e43c admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:42.596524 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cca777-7234-4129-ba66-beecde6bcaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:42.596524 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cca777-7234-4129-ba66-beecde6bcaa6 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:42.596524 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cca777-7234-4129-ba66-beecde6bcaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:42.596524 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cca777-7234-4129-ba66-beecde6bcaa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:42.597731 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cca777-7234-4129-ba66-beecde6bcaa6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:42.598229 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cca777-7234-4129-ba66-beecde6bcaa6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:42.600249 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cca777-7234-4129-ba66-beecde6bcaa6 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:42.613489 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 405/811] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:42.619623 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefa591-e1c3-4035-8fbd-6334392a6dd0 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:42.629967 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefa591-e1c3-4035-8fbd-6334392a6dd0 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:42.634623 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade85e9-2533-4a27-9159-58fa97080d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:42.635625 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade85e9-2533-4a27-9159-58fa97080d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:42.635978 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade85e9-2533-4a27-9159-58fa97080d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:42.636344 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade85e9-2533-4a27-9159-58fa97080d8c admin admin] PATH_INFO: `/v3/projects/73dcb70ac3714a428a717707e6be8201/users/96c9b76133d74b79a0d2da9a884651e1/roles/315578ac69fb46e3abcddcd340bbd0a7` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:42.639018 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade85e9-2533-4a27-9159-58fa97080d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=73dcb70ac3714a428a717707e6be8201, user_id=96c9b76133d74b79a0d2da9a884651e1, role_id=315578ac69fb46e3abcddcd340bbd0a7)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:42.641725 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade85e9-2533-4a27-9159-58fa97080d8c admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:42.748626 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 407/812] 10.222.0.23 () {58 vars in 1461 bytes} [Thu Sep 23 02:55:42 2021] PUT /identity/v3/projects/73dcb70ac3714a428a717707e6be8201/users/96c9b76133d74b79a0d2da9a884651e1/roles/315578ac69fb46e3abcddcd340bbd0a7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 02:55:43.483494 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579939d9-d28e-47ed-8a74-442c69be8daf None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:43.484018 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579939d9-d28e-47ed-8a74-442c69be8daf None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:43.484018 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579939d9-d28e-47ed-8a74-442c69be8daf None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:43.486113 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 406/813] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:43.493999 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892b6ea-f897-4fd1-aea9-dcf61ca4eb71 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:43.494604 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892b6ea-f897-4fd1-aea9-dcf61ca4eb71 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:43.494604 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892b6ea-f897-4fd1-aea9-dcf61ca4eb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:43.511896 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2d85c-d204-4004-8dbd-801699800995 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:43.511896 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2d85c-d204-4004-8dbd-801699800995 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:43.511896 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2d85c-d204-4004-8dbd-801699800995 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:43.513015 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-4892b6ea-f897-4fd1-aea9-dcf61ca4eb71 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:43.513235 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 407/814] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 02:55:43.514222 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-4892b6ea-f897-4fd1-aea9-dcf61ca4eb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:43.521046 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd589e-434d-4a84-99ab-0643e443c31b None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:43.523036 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd589e-434d-4a84-99ab-0643e443c31b None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:43.523036 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd589e-434d-4a84-99ab-0643e443c31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:43.539405 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-48dd589e-434d-4a84-99ab-0643e443c31b None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:43.540621 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-48dd589e-434d-4a84-99ab-0643e443c31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:43.579997 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 408/815] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:43 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:43.597984 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892b6ea-f897-4fd1-aea9-dcf61ca4eb71 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:43.598510 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 408/816] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:43 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:43.607665 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892b6ea-f897-4fd1-aea9-dcf61ca4eb71 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:43.612440 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59943f-4a83-433f-9773-380e0535e713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:43.613450 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59943f-4a83-433f-9773-380e0535e713 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:43.613901 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59943f-4a83-433f-9773-380e0535e713 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:43.614326 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59943f-4a83-433f-9773-380e0535e713 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:43.615122 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59943f-4a83-433f-9773-380e0535e713 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:43.616894 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59943f-4a83-433f-9773-380e0535e713 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:43.625615 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd589e-434d-4a84-99ab-0643e443c31b None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:43.629224 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-bb59943f-4a83-433f-9773-380e0535e713 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 02:55:43.634875 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd589e-434d-4a84-99ab-0643e443c31b None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:43.635096 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 409/817] 10.222.0.23 () {56 vars in 1154 bytes} [Thu Sep 23 02:55:43 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:43.637885 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59943f-4a83-433f-9773-380e0535e713 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:43.640739 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1da84-3e7e-476c-8811-885b0910749a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:43.641657 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1da84-3e7e-476c-8811-885b0910749a admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:43.642029 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1da84-3e7e-476c-8811-885b0910749a admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:43.642401 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1da84-3e7e-476c-8811-885b0910749a admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:43.643149 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1da84-3e7e-476c-8811-885b0910749a admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:43.644870 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1da84-3e7e-476c-8811-885b0910749a admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:43.649085 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59943f-4a83-433f-9773-380e0535e713 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:43.656515 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-b7c1da84-3e7e-476c-8811-885b0910749a admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 02:55:43.656642 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055ee13-1698-48bb-88ee-d462c604403e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:43.658251 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055ee13-1698-48bb-88ee-d462c604403e admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:43.658251 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055ee13-1698-48bb-88ee-d462c604403e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:43.658251 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055ee13-1698-48bb-88ee-d462c604403e admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:43.658495 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 409/818] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Sep 23 02:55:43 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:43.658581 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055ee13-1698-48bb-88ee-d462c604403e admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:43.658651 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055ee13-1698-48bb-88ee-d462c604403e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:43.660447 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055ee13-1698-48bb-88ee-d462c604403e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:43.664346 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1da84-3e7e-476c-8811-885b0910749a admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:43.666082 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 410/819] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 23 02:55:43 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:43.672660 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055ee13-1698-48bb-88ee-d462c604403e admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:43.674701 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1da84-3e7e-476c-8811-885b0910749a admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:43.679272 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269df969-1208-4cb4-a587-8b4d9ec2518e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:43.679958 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269df969-1208-4cb4-a587-8b4d9ec2518e admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:43.680200 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269df969-1208-4cb4-a587-8b4d9ec2518e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:43.680474 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269df969-1208-4cb4-a587-8b4d9ec2518e admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:43.681208 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269df969-1208-4cb4-a587-8b4d9ec2518e admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:43.681515 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269df969-1208-4cb4-a587-8b4d9ec2518e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:43.682889 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055ee13-1698-48bb-88ee-d462c604403e admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:43.683098 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269df969-1208-4cb4-a587-8b4d9ec2518e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:43.691661 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a33ec-9592-4d03-a0e9-f239436674f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:43.692629 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a33ec-9592-4d03-a0e9-f239436674f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:43.693073 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a33ec-9592-4d03-a0e9-f239436674f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:43.693685 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 410/820] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Sep 23 02:55:43 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:43.694065 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a33ec-9592-4d03-a0e9-f239436674f3 admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:43.694550 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269df969-1208-4cb4-a587-8b4d9ec2518e admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:43.695116 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a33ec-9592-4d03-a0e9-f239436674f3 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:43.695609 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a33ec-9592-4d03-a0e9-f239436674f3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:43.697822 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a33ec-9592-4d03-a0e9-f239436674f3 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:43.704574 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 411/821] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 23 02:55:43 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:43.704824 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269df969-1208-4cb4-a587-8b4d9ec2518e admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:43.710288 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a33ec-9592-4d03-a0e9-f239436674f3 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:43.712534 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae6df0-df90-429a-a178-d9582fe24f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:43.713207 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae6df0-df90-429a-a178-d9582fe24f7d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:43.713518 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae6df0-df90-429a-a178-d9582fe24f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:43.713793 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae6df0-df90-429a-a178-d9582fe24f7d admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:43.714554 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae6df0-df90-429a-a178-d9582fe24f7d admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:43.714899 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae6df0-df90-429a-a178-d9582fe24f7d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:43.716575 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae6df0-df90-429a-a178-d9582fe24f7d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:43.721527 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a33ec-9592-4d03-a0e9-f239436674f3 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:43.721956 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 411/822] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Sep 23 02:55:43 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:43.728137 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae6df0-df90-429a-a178-d9582fe24f7d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:43.730157 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb52592-1bee-4156-b2e1-950e4e38c4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:43.731057 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb52592-1bee-4156-b2e1-950e4e38c4e1 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:43.731570 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb52592-1bee-4156-b2e1-950e4e38c4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:43.732619 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb52592-1bee-4156-b2e1-950e4e38c4e1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:43.733623 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb52592-1bee-4156-b2e1-950e4e38c4e1 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:43.735420 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb52592-1bee-4156-b2e1-950e4e38c4e1 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:43.738688 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae6df0-df90-429a-a178-d9582fe24f7d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:43.743479 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82768b-d89f-417f-8115-0c1a8b41ebd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:43.744176 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82768b-d89f-417f-8115-0c1a8b41ebd1 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:43.744458 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82768b-d89f-417f-8115-0c1a8b41ebd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:43.744810 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82768b-d89f-417f-8115-0c1a8b41ebd1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:43.745643 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82768b-d89f-417f-8115-0c1a8b41ebd1 admin admin] RBAC: Adding query filter params (interface=public, service_id=84588aeb27b747a1ac2d765925216903, region_id=RegionOne) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:43.745952 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82768b-d89f-417f-8115-0c1a8b41ebd1 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:43.747630 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82768b-d89f-417f-8115-0c1a8b41ebd1 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:43.753881 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 412/823] 10.222.0.23 () {56 vars in 1273 bytes} [Thu Sep 23 02:55:43 2021] GET /identity/v3/endpoints?service_id=84588aeb27b747a1ac2d765925216903&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:43.759867 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82768b-d89f-417f-8115-0c1a8b41ebd1 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:43.770989 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82768b-d89f-417f-8115-0c1a8b41ebd1 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:43.775566 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86991027-5bda-4373-99e0-5bd859e7b842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:43.776244 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86991027-5bda-4373-99e0-5bd859e7b842 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:43.776553 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86991027-5bda-4373-99e0-5bd859e7b842 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:43.776836 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86991027-5bda-4373-99e0-5bd859e7b842 admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:43.777519 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86991027-5bda-4373-99e0-5bd859e7b842 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:43.779679 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86991027-5bda-4373-99e0-5bd859e7b842 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:43.786221 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 413/824] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 23 02:55:43 2021] GET /identity/v3/services => generated 1268 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 02:55:43.839238 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 412/825] 10.222.0.23 () {60 vars in 1166 bytes} [Thu Sep 23 02:55:43 2021] POST /identity/v3/endpoints => generated 347 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 02:55:43.963994 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d9142-bdda-4dac-99ea-adc00b09c58e None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:43.964329 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d9142-bdda-4dac-99ea-adc00b09c58e None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:43.964590 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d9142-bdda-4dac-99ea-adc00b09c58e None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:43.966867 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 414/826] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:43.975030 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a62ec-7229-4276-9a52-4e66de87dd48 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:43.975366 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a62ec-7229-4276-9a52-4e66de87dd48 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:43.975597 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a62ec-7229-4276-9a52-4e66de87dd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:43.995953 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-3f4a62ec-7229-4276-9a52-4e66de87dd48 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:43.998202 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-3f4a62ec-7229-4276-9a52-4e66de87dd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:44.019418 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 413/827] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:43 2021] POST /identity/v3/auth/tokens => generated 2003 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:44.045122 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d9142-bdda-4dac-99ea-adc00b09c58e None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:44.060121 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d9142-bdda-4dac-99ea-adc00b09c58e None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:44.065701 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5d1e3-73fa-428a-8acc-b72ec58ae15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:44.066701 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5d1e3-73fa-428a-8acc-b72ec58ae15b admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:44.067296 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5d1e3-73fa-428a-8acc-b72ec58ae15b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:44.067853 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5d1e3-73fa-428a-8acc-b72ec58ae15b admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:44.068873 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5d1e3-73fa-428a-8acc-b72ec58ae15b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:44.070708 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5d1e3-73fa-428a-8acc-b72ec58ae15b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:44.159503 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 415/828] 10.222.0.23 () {60 vars in 1163 bytes} [Thu Sep 23 02:55:44 2021] POST /identity/v3/services => generated 241 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 02:55:45.052958 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067aac9-c581-46d2-b118-42e5752e2abe None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:45.053491 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067aac9-c581-46d2-b118-42e5752e2abe None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:45.053491 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067aac9-c581-46d2-b118-42e5752e2abe None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:45.055502 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 414/829] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:45.063940 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ca0c3-8439-4f38-9047-76dfb3b32b77 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:45.064408 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ca0c3-8439-4f38-9047-76dfb3b32b77 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:45.064503 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ca0c3-8439-4f38-9047-76dfb3b32b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:45.082932 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-dd2ca0c3-8439-4f38-9047-76dfb3b32b77 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:45.084033 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-dd2ca0c3-8439-4f38-9047-76dfb3b32b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:45.101592 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 416/830] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:45 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:45.126898 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067aac9-c581-46d2-b118-42e5752e2abe None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:45.140672 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067aac9-c581-46d2-b118-42e5752e2abe None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:45.145390 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958cbb91-ca1f-4762-a84a-cb33d61d8003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:45.146188 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cbb91-ca1f-4762-a84a-cb33d61d8003 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:45.146463 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cbb91-ca1f-4762-a84a-cb33d61d8003 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:45.146736 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cbb91-ca1f-4762-a84a-cb33d61d8003 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:45.157136 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958cbb91-ca1f-4762-a84a-cb33d61d8003 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:45.164106 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-958cbb91-ca1f-4762-a84a-cb33d61d8003 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 02:55:45.165595 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 415/831] 10.222.0.23 () {56 vars in 1142 bytes} [Thu Sep 23 02:55:45 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:45.172593 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ca0c3-8439-4f38-9047-76dfb3b32b77 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:45.181604 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ca0c3-8439-4f38-9047-76dfb3b32b77 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:45.186272 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9d684-18ea-4919-a412-465eaaf0cfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:45.186941 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9d684-18ea-4919-a412-465eaaf0cfd1 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:45.187221 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9d684-18ea-4919-a412-465eaaf0cfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:45.187492 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9d684-18ea-4919-a412-465eaaf0cfd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:45.188232 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9d684-18ea-4919-a412-465eaaf0cfd1 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:45.188558 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9d684-18ea-4919-a412-465eaaf0cfd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:45.190135 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9d684-18ea-4919-a412-465eaaf0cfd1 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:45.198627 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 417/832] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Sep 23 02:55:45 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:45.205254 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958cbb91-ca1f-4762-a84a-cb33d61d8003 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:45.215658 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958cbb91-ca1f-4762-a84a-cb33d61d8003 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:45.220419 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ede8c9-173d-435c-a097-8dda8bf28574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:45.221238 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ede8c9-173d-435c-a097-8dda8bf28574 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:45.221516 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ede8c9-173d-435c-a097-8dda8bf28574 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:45.221790 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ede8c9-173d-435c-a097-8dda8bf28574 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:45.232763 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ede8c9-173d-435c-a097-8dda8bf28574 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:45.234584 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ede8c9-173d-435c-a097-8dda8bf28574 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:45.251494 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-f9ede8c9-173d-435c-a097-8dda8bf28574 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:45.253061 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 416/833] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:45.259067 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9d684-18ea-4919-a412-465eaaf0cfd1 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:45.269367 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9d684-18ea-4919-a412-465eaaf0cfd1 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:45.274152 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9387d30-bc6f-4179-b4d8-fc99b8d48da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:45.275023 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9387d30-bc6f-4179-b4d8-fc99b8d48da0 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:45.275512 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9387d30-bc6f-4179-b4d8-fc99b8d48da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:45.275996 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9387d30-bc6f-4179-b4d8-fc99b8d48da0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:45.276942 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9387d30-bc6f-4179-b4d8-fc99b8d48da0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:45.277443 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9387d30-bc6f-4179-b4d8-fc99b8d48da0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:45.279283 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9387d30-bc6f-4179-b4d8-fc99b8d48da0 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:45.291452 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 418/834] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:45.298443 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ede8c9-173d-435c-a097-8dda8bf28574 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:45.308264 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ede8c9-173d-435c-a097-8dda8bf28574 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:45.313611 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9201a28-6a67-4ebe-9c4c-e0610c8f5ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:45.314629 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9201a28-6a67-4ebe-9c4c-e0610c8f5ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:45.315118 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9201a28-6a67-4ebe-9c4c-e0610c8f5ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:45.315599 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9201a28-6a67-4ebe-9c4c-e0610c8f5ed3 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:45.323116 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9201a28-6a67-4ebe-9c4c-e0610c8f5ed3 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:45.325488 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9201a28-6a67-4ebe-9c4c-e0610c8f5ed3 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:45.340223 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-b9201a28-6a67-4ebe-9c4c-e0610c8f5ed3 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 02:55:45.341932 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 417/835] 10.222.0.23 () {56 vars in 1139 bytes} [Thu Sep 23 02:55:45 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:45.348747 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9387d30-bc6f-4179-b4d8-fc99b8d48da0 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:45.359622 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9387d30-bc6f-4179-b4d8-fc99b8d48da0 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:45.364449 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5eb6c0-65c0-43ed-9505-9a8a8e3bfaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:45.365427 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5eb6c0-65c0-43ed-9505-9a8a8e3bfaad admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:45.365904 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5eb6c0-65c0-43ed-9505-9a8a8e3bfaad admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:45.366417 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5eb6c0-65c0-43ed-9505-9a8a8e3bfaad admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:45.367469 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5eb6c0-65c0-43ed-9505-9a8a8e3bfaad admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:45.367993 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5eb6c0-65c0-43ed-9505-9a8a8e3bfaad admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:45.370121 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5eb6c0-65c0-43ed-9505-9a8a8e3bfaad admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:45.390950 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 419/836] 10.222.0.23 () {56 vars in 1171 bytes} [Thu Sep 23 02:55:45 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:45.397088 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9201a28-6a67-4ebe-9c4c-e0610c8f5ed3 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:45.407051 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9201a28-6a67-4ebe-9c4c-e0610c8f5ed3 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:45.412582 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0c8b7-d396-41df-9eae-897dafef3906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:45.413713 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0c8b7-d396-41df-9eae-897dafef3906 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:45.414240 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0c8b7-d396-41df-9eae-897dafef3906 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:45.414783 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0c8b7-d396-41df-9eae-897dafef3906 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:45.424063 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0c8b7-d396-41df-9eae-897dafef3906 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:45.426198 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0c8b7-d396-41df-9eae-897dafef3906 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:45.436131 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 418/837] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:55:45 2021] GET /identity/v3/auth/tokens => generated 2105 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:55:45.442145 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5eb6c0-65c0-43ed-9505-9a8a8e3bfaad admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:45.452644 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5eb6c0-65c0-43ed-9505-9a8a8e3bfaad admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:45.457353 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a1277-56ef-4510-a1f5-98247bf29569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:45.458149 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a1277-56ef-4510-a1f5-98247bf29569 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:45.458427 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a1277-56ef-4510-a1f5-98247bf29569 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:45.458703 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a1277-56ef-4510-a1f5-98247bf29569 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:45.473214 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a1277-56ef-4510-a1f5-98247bf29569 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:45.475047 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a1277-56ef-4510-a1f5-98247bf29569 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:45.492479 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-058a1277-56ef-4510-a1f5-98247bf29569 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:45.493898 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 420/838] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:45.499929 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0c8b7-d396-41df-9eae-897dafef3906 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:45.508870 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0c8b7-d396-41df-9eae-897dafef3906 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:45.513911 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54569f91-0c74-46de-9ea3-7e7417c16cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:45.514571 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54569f91-0c74-46de-9ea3-7e7417c16cab admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:45.514853 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54569f91-0c74-46de-9ea3-7e7417c16cab admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:45.515128 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54569f91-0c74-46de-9ea3-7e7417c16cab admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:45.515843 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54569f91-0c74-46de-9ea3-7e7417c16cab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:45.516147 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54569f91-0c74-46de-9ea3-7e7417c16cab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:45.517780 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54569f91-0c74-46de-9ea3-7e7417c16cab admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:45.530126 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 419/839] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:45.536363 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a1277-56ef-4510-a1f5-98247bf29569 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:45.546773 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a1277-56ef-4510-a1f5-98247bf29569 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:45.555701 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4f6b0-d98c-4237-a437-02d62f990f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:45.556516 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4f6b0-d98c-4237-a437-02d62f990f17 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:45.556868 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4f6b0-d98c-4237-a437-02d62f990f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:45.557139 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4f6b0-d98c-4237-a437-02d62f990f17 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:45.564921 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4f6b0-d98c-4237-a437-02d62f990f17 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:45.566950 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4f6b0-d98c-4237-a437-02d62f990f17 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:45.580400 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-c7c4f6b0-d98c-4237-a437-02d62f990f17 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:45.581956 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 421/840] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:45.589826 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54569f91-0c74-46de-9ea3-7e7417c16cab admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:45.600384 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54569f91-0c74-46de-9ea3-7e7417c16cab admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:45.605185 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d808a45-3fa7-4e01-b7e3-8512654f6e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:45.605903 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d808a45-3fa7-4e01-b7e3-8512654f6e35 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:45.606186 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d808a45-3fa7-4e01-b7e3-8512654f6e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:45.606461 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d808a45-3fa7-4e01-b7e3-8512654f6e35 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:45.607362 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d808a45-3fa7-4e01-b7e3-8512654f6e35 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:45.607666 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d808a45-3fa7-4e01-b7e3-8512654f6e35 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:45.609631 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d808a45-3fa7-4e01-b7e3-8512654f6e35 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:45.622884 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 420/841] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:45.629360 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4f6b0-d98c-4237-a437-02d62f990f17 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:45.640620 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4f6b0-d98c-4237-a437-02d62f990f17 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:45.645382 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f027717-ce7e-4673-9c92-2d21ff22b5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:45.646083 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f027717-ce7e-4673-9c92-2d21ff22b5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:45.646366 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f027717-ce7e-4673-9c92-2d21ff22b5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:45.646644 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f027717-ce7e-4673-9c92-2d21ff22b5f3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:45.647529 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f027717-ce7e-4673-9c92-2d21ff22b5f3 admin admin] RBAC: Adding query filter params (role.id=315578ac69fb46e3abcddcd340bbd0a7, scope.project.id=73dcb70ac3714a428a717707e6be8201, user.id=96c9b76133d74b79a0d2da9a884651e1) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:45.647847 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f027717-ce7e-4673-9c92-2d21ff22b5f3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:45.649744 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f027717-ce7e-4673-9c92-2d21ff22b5f3 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:45.656896 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 422/842] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:55:45 2021] GET /identity/v3/role_assignments?user.id=96c9b76133d74b79a0d2da9a884651e1&scope.project.id=73dcb70ac3714a428a717707e6be8201&role.id=315578ac69fb46e3abcddcd340bbd0a7 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:46.060358 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edeff21-3be9-4099-a897-7c3afc62585c None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:46.061111 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edeff21-3be9-4099-a897-7c3afc62585c None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:46.061111 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edeff21-3be9-4099-a897-7c3afc62585c None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:46.063664 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 421/843] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:46.072053 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690f882-ea36-4e99-874a-c0bab34fa534 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:46.072762 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690f882-ea36-4e99-874a-c0bab34fa534 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:46.072762 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690f882-ea36-4e99-874a-c0bab34fa534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:46.092924 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-1690f882-ea36-4e99-874a-c0bab34fa534 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:46.094480 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-1690f882-ea36-4e99-874a-c0bab34fa534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:46.102965 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 423/844] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:46 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:46.127216 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edeff21-3be9-4099-a897-7c3afc62585c None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:46.140436 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edeff21-3be9-4099-a897-7c3afc62585c None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:46.144856 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cf110-65f0-4200-b8df-e27599be70d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:46.145638 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cf110-65f0-4200-b8df-e27599be70d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:46.145917 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cf110-65f0-4200-b8df-e27599be70d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:46.146193 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cf110-65f0-4200-b8df-e27599be70d8 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:46.146839 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964cf110-65f0-4200-b8df-e27599be70d8 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:46.148413 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964cf110-65f0-4200-b8df-e27599be70d8 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:46.159166 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-964cf110-65f0-4200-b8df-e27599be70d8 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 02:55:46.160724 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 422/845] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Sep 23 02:55:46 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:46.166943 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4582fa5-2bed-484c-aaea-784678ad633b None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:46.167232 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4582fa5-2bed-484c-aaea-784678ad633b None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:46.167507 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4582fa5-2bed-484c-aaea-784678ad633b None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:46.171393 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 424/846] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:46.171508 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cf110-65f0-4200-b8df-e27599be70d8 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:46.183232 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b9ba4-7f31-4d3e-8ea0-63db1e985eea None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:46.183794 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b9ba4-7f31-4d3e-8ea0-63db1e985eea None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:46.183899 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cf110-65f0-4200-b8df-e27599be70d8 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:46.184365 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b9ba4-7f31-4d3e-8ea0-63db1e985eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:46.189071 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676179b7-03ee-408d-ace2-0e6e15c328dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:46.189838 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676179b7-03ee-408d-ace2-0e6e15c328dc admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:46.190130 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676179b7-03ee-408d-ace2-0e6e15c328dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:46.190412 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676179b7-03ee-408d-ace2-0e6e15c328dc admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:46.191120 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676179b7-03ee-408d-ace2-0e6e15c328dc admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:46.191432 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676179b7-03ee-408d-ace2-0e6e15c328dc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:46.193051 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676179b7-03ee-408d-ace2-0e6e15c328dc admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:46.211771 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-4e4b9ba4-7f31-4d3e-8ea0-63db1e985eea None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:46.211771 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-4e4b9ba4-7f31-4d3e-8ea0-63db1e985eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:46.211991 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 423/847] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Sep 23 02:55:46 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:46.213702 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676179b7-03ee-408d-ace2-0e6e15c328dc admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:46.217755 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 425/848] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:46 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:46.225749 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676179b7-03ee-408d-ace2-0e6e15c328dc admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:46.230438 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1445ad9-aa27-4609-b8a1-1e1d5b8eccb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:46.231143 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1445ad9-aa27-4609-b8a1-1e1d5b8eccb7 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:46.231428 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1445ad9-aa27-4609-b8a1-1e1d5b8eccb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:46.231732 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1445ad9-aa27-4609-b8a1-1e1d5b8eccb7 admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:46.232575 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1445ad9-aa27-4609-b8a1-1e1d5b8eccb7 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:46.232888 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1445ad9-aa27-4609-b8a1-1e1d5b8eccb7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:46.234524 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1445ad9-aa27-4609-b8a1-1e1d5b8eccb7 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:46.239846 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 424/849] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Sep 23 02:55:46 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:46.245907 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b9ba4-7f31-4d3e-8ea0-63db1e985eea None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:46.252860 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1445ad9-aa27-4609-b8a1-1e1d5b8eccb7 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:46.256716 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b9ba4-7f31-4d3e-8ea0-63db1e985eea None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:46.262220 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e43ea9-6bd4-4788-b679-8a7170c56378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:46.262950 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e43ea9-6bd4-4788-b679-8a7170c56378 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:46.263236 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e43ea9-6bd4-4788-b679-8a7170c56378 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:46.263668 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e43ea9-6bd4-4788-b679-8a7170c56378 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:46.264566 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e43ea9-6bd4-4788-b679-8a7170c56378 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:46.266167 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e43ea9-6bd4-4788-b679-8a7170c56378 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:46.266632 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1445ad9-aa27-4609-b8a1-1e1d5b8eccb7 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:46.272741 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94c3c2-1037-4fca-bc53-a8353cec8ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:46.273941 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94c3c2-1037-4fca-bc53-a8353cec8ffe admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:46.274841 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94c3c2-1037-4fca-bc53-a8353cec8ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:46.275538 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94c3c2-1037-4fca-bc53-a8353cec8ffe admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:46.276444 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94c3c2-1037-4fca-bc53-a8353cec8ffe admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:46.278246 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94c3c2-1037-4fca-bc53-a8353cec8ffe admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:46.289954 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-6b94c3c2-1037-4fca-bc53-a8353cec8ffe admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 02:55:46.291315 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 425/850] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:46 2021] GET /identity/v3/services/compute => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:46.298748 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94c3c2-1037-4fca-bc53-a8353cec8ffe admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:46.309899 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94c3c2-1037-4fca-bc53-a8353cec8ffe admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:46.315119 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41491af1-7fb0-47f7-9e9c-815e6bc50067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:46.316042 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41491af1-7fb0-47f7-9e9c-815e6bc50067 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:46.316473 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41491af1-7fb0-47f7-9e9c-815e6bc50067 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:46.316925 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41491af1-7fb0-47f7-9e9c-815e6bc50067 admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:46.317805 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41491af1-7fb0-47f7-9e9c-815e6bc50067 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:46.318288 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41491af1-7fb0-47f7-9e9c-815e6bc50067 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:46.320086 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41491af1-7fb0-47f7-9e9c-815e6bc50067 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:46.325730 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 426/851] 10.222.0.23 () {56 vars in 1134 bytes} [Thu Sep 23 02:55:46 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:46.332434 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41491af1-7fb0-47f7-9e9c-815e6bc50067 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:46.343192 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41491af1-7fb0-47f7-9e9c-815e6bc50067 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:46.346441 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 426/852] 10.222.0.23 () {60 vars in 1166 bytes} [Thu Sep 23 02:55:46 2021] POST /identity/v3/endpoints => generated 346 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 02:55:46.361502 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752681e-0045-4bae-8923-a3203ca68002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:46.362451 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752681e-0045-4bae-8923-a3203ca68002 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:46.363024 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752681e-0045-4bae-8923-a3203ca68002 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:46.363470 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752681e-0045-4bae-8923-a3203ca68002 admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:46.364449 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752681e-0045-4bae-8923-a3203ca68002 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:46.364976 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752681e-0045-4bae-8923-a3203ca68002 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:46.366995 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752681e-0045-4bae-8923-a3203ca68002 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:46.373764 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 427/853] 10.222.0.23 () {56 vars in 1134 bytes} [Thu Sep 23 02:55:46 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:46.401114 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfeb2f4-a62c-4121-930f-5667cab79f43 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:46.401763 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfeb2f4-a62c-4121-930f-5667cab79f43 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:46.402205 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfeb2f4-a62c-4121-930f-5667cab79f43 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:46.405268 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 427/854] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:46 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:46.413524 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ccaa1-a8c2-4f32-ae6b-d3deb30de567 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:46.413806 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ccaa1-a8c2-4f32-ae6b-d3deb30de567 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:46.414086 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ccaa1-a8c2-4f32-ae6b-d3deb30de567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:46.433332 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-ad4ccaa1-a8c2-4f32-ae6b-d3deb30de567 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:46.434584 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-ad4ccaa1-a8c2-4f32-ae6b-d3deb30de567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:46.448700 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 428/855] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:46 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:46.469305 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfeb2f4-a62c-4121-930f-5667cab79f43 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:46.482972 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfeb2f4-a62c-4121-930f-5667cab79f43 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:46.488028 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44546e91-98d2-4faf-9323-7d36568f8beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:46.489046 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44546e91-98d2-4faf-9323-7d36568f8beb admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:46.489327 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44546e91-98d2-4faf-9323-7d36568f8beb admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:46.489602 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44546e91-98d2-4faf-9323-7d36568f8beb admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:46.490334 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44546e91-98d2-4faf-9323-7d36568f8beb admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:46.492106 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44546e91-98d2-4faf-9323-7d36568f8beb admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:46.505133 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-44546e91-98d2-4faf-9323-7d36568f8beb admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 02:55:46.512838 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 428/856] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 23 02:55:46 2021] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:46.514322 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ccaa1-a8c2-4f32-ae6b-d3deb30de567 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:46.526847 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ccaa1-a8c2-4f32-ae6b-d3deb30de567 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:46.532579 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6db0e3-d9c1-48ad-b2d9-7213636ad365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:46.533437 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6db0e3-d9c1-48ad-b2d9-7213636ad365 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:46.533833 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6db0e3-d9c1-48ad-b2d9-7213636ad365 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:46.534266 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6db0e3-d9c1-48ad-b2d9-7213636ad365 admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:46.535261 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6db0e3-d9c1-48ad-b2d9-7213636ad365 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:46.535678 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6db0e3-d9c1-48ad-b2d9-7213636ad365 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:46.537569 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6db0e3-d9c1-48ad-b2d9-7213636ad365 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:46.545245 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 429/857] 10.222.0.23 () {56 vars in 1144 bytes} [Thu Sep 23 02:55:46 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:46.552657 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44546e91-98d2-4faf-9323-7d36568f8beb admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:46.563302 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44546e91-98d2-4faf-9323-7d36568f8beb admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:46.569235 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e2de6-a541-4174-b401-e6a2e4cbf70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:46.569848 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e2de6-a541-4174-b401-e6a2e4cbf70b admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:46.570126 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e2de6-a541-4174-b401-e6a2e4cbf70b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:46.570395 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e2de6-a541-4174-b401-e6a2e4cbf70b admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:46.571107 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e2de6-a541-4174-b401-e6a2e4cbf70b admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:46.571409 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e2de6-a541-4174-b401-e6a2e4cbf70b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:46.573027 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e2de6-a541-4174-b401-e6a2e4cbf70b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:46.579637 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 429/858] 10.222.0.23 () {56 vars in 1144 bytes} [Thu Sep 23 02:55:46 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:46.586136 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6db0e3-d9c1-48ad-b2d9-7213636ad365 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:46.601600 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6db0e3-d9c1-48ad-b2d9-7213636ad365 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:46.607259 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018721a-56e7-48bb-a8b1-869b4388b761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:46.608057 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018721a-56e7-48bb-a8b1-869b4388b761 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:46.608422 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018721a-56e7-48bb-a8b1-869b4388b761 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:46.608791 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018721a-56e7-48bb-a8b1-869b4388b761 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:46.609660 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018721a-56e7-48bb-a8b1-869b4388b761 admin admin] RBAC: Adding query filter params (interface=public, service_id=04a35ecd24c7475894ca55a1f61f846a, region_id=RegionOne) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:46.610043 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018721a-56e7-48bb-a8b1-869b4388b761 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:46.611123 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING py.warnings [None req-e018721a-56e7-48bb-a8b1-869b4388b761 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:55:46.611123 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: warnings.warn(msg) Sep 23 02:55:46.611123 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: Sep 23 02:55:46.612185 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018721a-56e7-48bb-a8b1-869b4388b761 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:46.623797 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 430/859] 10.222.0.23 () {56 vars in 1273 bytes} [Thu Sep 23 02:55:46 2021] GET /identity/v3/endpoints?service_id=04a35ecd24c7475894ca55a1f61f846a&interface=public®ion_id=RegionOne => generated 194 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:46.629734 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e2de6-a541-4174-b401-e6a2e4cbf70b admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:46.640269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e2de6-a541-4174-b401-e6a2e4cbf70b admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:46.644894 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feae299-44f3-49f1-b922-aa3593c5975e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:46.645553 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feae299-44f3-49f1-b922-aa3593c5975e admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:46.645837 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feae299-44f3-49f1-b922-aa3593c5975e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:46.646101 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feae299-44f3-49f1-b922-aa3593c5975e admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:46.646787 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feae299-44f3-49f1-b922-aa3593c5975e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:46.648356 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feae299-44f3-49f1-b922-aa3593c5975e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:46.660628 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 430/860] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 23 02:55:46 2021] GET /identity/v3/services => generated 1497 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 02:55:47.927170 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f54fc-215e-460f-bb8d-b3e865550dd9 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:47.927866 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f54fc-215e-460f-bb8d-b3e865550dd9 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:47.927866 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f54fc-215e-460f-bb8d-b3e865550dd9 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:47.929853 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 431/861] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:47.937950 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f9131-052f-4014-9457-80dae4ca4788 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:47.938476 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f9131-052f-4014-9457-80dae4ca4788 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:47.938476 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f9131-052f-4014-9457-80dae4ca4788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:47.957043 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-123f9131-052f-4014-9457-80dae4ca4788 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:47.958244 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-123f9131-052f-4014-9457-80dae4ca4788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:47.972588 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 431/862] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:47 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:47.989643 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f54fc-215e-460f-bb8d-b3e865550dd9 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:48.002444 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f54fc-215e-460f-bb8d-b3e865550dd9 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:48.006862 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa81f8-3c91-4649-ae6f-b71dc622c8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:48.007639 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa81f8-3c91-4649-ae6f-b71dc622c8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:48.007918 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa81f8-3c91-4649-ae6f-b71dc622c8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:48.008192 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa81f8-3c91-4649-ae6f-b71dc622c8d2 admin admin] PATH_INFO: `/v3/services/image` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:48.008880 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa81f8-3c91-4649-ae6f-b71dc622c8d2 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:48.010506 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa81f8-3c91-4649-ae6f-b71dc622c8d2 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:48.021446 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-5ffa81f8-3c91-4649-ae6f-b71dc622c8d2 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 02:55:48.028153 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 432/863] 10.222.0.23 () {56 vars in 1127 bytes} [Thu Sep 23 02:55:47 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:48.030197 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f9131-052f-4014-9457-80dae4ca4788 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:48.039347 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f9131-052f-4014-9457-80dae4ca4788 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:48.044053 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd60578-6f28-4cc1-adca-abc42e682c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:48.054451 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd60578-6f28-4cc1-adca-abc42e682c99 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:48.054451 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd60578-6f28-4cc1-adca-abc42e682c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:48.054451 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd60578-6f28-4cc1-adca-abc42e682c99 admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:48.054451 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd60578-6f28-4cc1-adca-abc42e682c99 admin admin] RBAC: Adding query filter params (name=image) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:48.054451 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd60578-6f28-4cc1-adca-abc42e682c99 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:48.054451 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd60578-6f28-4cc1-adca-abc42e682c99 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:48.055334 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 432/864] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:48 2021] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:48.059309 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa81f8-3c91-4649-ae6f-b71dc622c8d2 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:48.070143 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa81f8-3c91-4649-ae6f-b71dc622c8d2 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:48.074899 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18b28f-9dfd-44bc-981b-66ccd0e6b628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:48.075609 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18b28f-9dfd-44bc-981b-66ccd0e6b628 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:48.075888 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18b28f-9dfd-44bc-981b-66ccd0e6b628 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:48.076163 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18b28f-9dfd-44bc-981b-66ccd0e6b628 admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:48.076888 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18b28f-9dfd-44bc-981b-66ccd0e6b628 admin admin] RBAC: Adding query filter params (type=image) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:48.077192 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18b28f-9dfd-44bc-981b-66ccd0e6b628 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:48.078771 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18b28f-9dfd-44bc-981b-66ccd0e6b628 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:48.088635 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 433/865] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:48 2021] GET /identity/v3/services?type=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:48.655219 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131895d-f874-4b65-85a8-2ebbdb278359 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:48.655618 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131895d-f874-4b65-85a8-2ebbdb278359 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:48.655797 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131895d-f874-4b65-85a8-2ebbdb278359 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:48.657836 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 433/866] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:48.667932 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84d1e9-9ec5-48d4-aec9-a0c409ec832f None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:48.668197 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ca5c6-5648-40a6-814b-66475799dcb9 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:48.668450 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84d1e9-9ec5-48d4-aec9-a0c409ec832f None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:48.668651 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ca5c6-5648-40a6-814b-66475799dcb9 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:48.668928 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84d1e9-9ec5-48d4-aec9-a0c409ec832f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:48.669205 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ca5c6-5648-40a6-814b-66475799dcb9 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:48.669205 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 434/867] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 02:55:48.678663 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92dd13-592e-40ac-9edd-af8ca78f6351 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:48.678663 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92dd13-592e-40ac-9edd-af8ca78f6351 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:48.678663 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92dd13-592e-40ac-9edd-af8ca78f6351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:48.686103 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-9d84d1e9-9ec5-48d4-aec9-a0c409ec832f None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:48.687423 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-9d84d1e9-9ec5-48d4-aec9-a0c409ec832f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:48.696043 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 434/868] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:48 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:48.698207 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-9e92dd13-592e-40ac-9edd-af8ca78f6351 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:48.699598 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-9e92dd13-592e-40ac-9edd-af8ca78f6351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:48.707907 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 435/869] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:48 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:48.720295 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84d1e9-9ec5-48d4-aec9-a0c409ec832f None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:48.729692 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84d1e9-9ec5-48d4-aec9-a0c409ec832f None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:48.734110 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92dd13-592e-40ac-9edd-af8ca78f6351 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:48.734898 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f551490-ad70-4872-a669-c1f0ea7a22d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:48.735576 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f551490-ad70-4872-a669-c1f0ea7a22d1 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:48.735864 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f551490-ad70-4872-a669-c1f0ea7a22d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:48.736149 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f551490-ad70-4872-a669-c1f0ea7a22d1 admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:48.736920 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f551490-ad70-4872-a669-c1f0ea7a22d1 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:48.738517 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f551490-ad70-4872-a669-c1f0ea7a22d1 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:48.745626 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92dd13-592e-40ac-9edd-af8ca78f6351 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:48.753203 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab6c91-0cd4-4b3e-829a-e79fa4a7aa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:48.753944 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab6c91-0cd4-4b3e-829a-e79fa4a7aa96 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:48.754233 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab6c91-0cd4-4b3e-829a-e79fa4a7aa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:48.761295 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab6c91-0cd4-4b3e-829a-e79fa4a7aa96 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:48.761295 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab6c91-0cd4-4b3e-829a-e79fa4a7aa96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:48.761295 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab6c91-0cd4-4b3e-829a-e79fa4a7aa96 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:48.761295 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.common [None req-0cab6c91-0cd4-4b3e-829a-e79fa4a7aa96 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 23 02:55:48.815090 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.sql.core [None req-0cab6c91-0cd4-4b3e-829a-e79fa4a7aa96 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 23 02:55:48.815090 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 23 02:55:48.815090 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [parameters: {'id': '3c28fd4e21974b23bc63b3c5abf298a5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 23 02:55:48.815090 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73780) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 23 02:55:48.828257 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 435/870] 10.222.0.23 () {60 vars in 1163 bytes} [Thu Sep 23 02:55:48 2021] POST /identity/v3/services => generated 242 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 02:55:48.833647 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-0cab6c91-0cd4-4b3e-829a-e79fa4a7aa96 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3c28fd4e21974b23bc63b3c5abf298a5.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3c28fd4e21974b23bc63b3c5abf298a5. Sep 23 02:55:48.833647 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 436/871] 10.222.0.23 () {60 vars in 1162 bytes} [Thu Sep 23 02:55:48 2021] POST /identity/v3/projects => generated 262 bytes in 99 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:48.839474 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab6c91-0cd4-4b3e-829a-e79fa4a7aa96 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:48.853231 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab6c91-0cd4-4b3e-829a-e79fa4a7aa96 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:48.863053 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358eb60f-9075-4af4-bd05-4bff4eb01b02 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:48.863347 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358eb60f-9075-4af4-bd05-4bff4eb01b02 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:48.865510 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358eb60f-9075-4af4-bd05-4bff4eb01b02 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:48.865937 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 436/872] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 02:55:48.873805 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee660586-e4ce-459e-b9b4-ec215ef4576e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:48.874009 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da9c4b-561a-4ce1-9b2a-f55390bcdde6 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:48.874243 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da9c4b-561a-4ce1-9b2a-f55390bcdde6 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:48.874495 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da9c4b-561a-4ce1-9b2a-f55390bcdde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:48.874655 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee660586-e4ce-459e-b9b4-ec215ef4576e admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:48.874941 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee660586-e4ce-459e-b9b4-ec215ef4576e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:48.875234 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee660586-e4ce-459e-b9b4-ec215ef4576e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:48.883087 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee660586-e4ce-459e-b9b4-ec215ef4576e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:48.885257 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee660586-e4ce-459e-b9b4-ec215ef4576e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:48.894329 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-a3da9c4b-561a-4ce1-9b2a-f55390bcdde6 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:48.895629 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-a3da9c4b-561a-4ce1-9b2a-f55390bcdde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:48.900145 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-ee660586-e4ce-459e-b9b4-ec215ef4576e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:48.901801 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 437/873] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:48.906195 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 437/874] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:48 2021] POST /identity/v3/auth/tokens => generated 2387 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:48.908279 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee660586-e4ce-459e-b9b4-ec215ef4576e admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:48.923654 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee660586-e4ce-459e-b9b4-ec215ef4576e admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:48.928890 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da9c4b-561a-4ce1-9b2a-f55390bcdde6 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:48.929382 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b6eaf-fb88-49f8-b7ed-7601b8eb0ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:48.929907 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b6eaf-fb88-49f8-b7ed-7601b8eb0ecd admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:48.930196 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b6eaf-fb88-49f8-b7ed-7601b8eb0ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:48.930475 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b6eaf-fb88-49f8-b7ed-7601b8eb0ecd admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:48.931250 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b6eaf-fb88-49f8-b7ed-7601b8eb0ecd admin admin] RBAC: Adding query filter params (name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:48.931610 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b6eaf-fb88-49f8-b7ed-7601b8eb0ecd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:48.933847 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b6eaf-fb88-49f8-b7ed-7601b8eb0ecd admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:48.940850 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da9c4b-561a-4ce1-9b2a-f55390bcdde6 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:48.945758 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0b9da-1294-4fa1-ae58-64a6085b3f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:48.946596 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0b9da-1294-4fa1-ae58-64a6085b3f39 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:48.946875 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0b9da-1294-4fa1-ae58-64a6085b3f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:48.947149 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0b9da-1294-4fa1-ae58-64a6085b3f39 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:48.947818 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0b9da-1294-4fa1-ae58-64a6085b3f39 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:48.949493 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0b9da-1294-4fa1-ae58-64a6085b3f39 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:48.954542 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 438/875] 10.222.0.23 () {56 vars in 1134 bytes} [Thu Sep 23 02:55:48 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:48.962059 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-44e0b9da-1294-4fa1-ae58-64a6085b3f39 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 02:55:48.963348 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 438/876] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 23 02:55:48 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:48.970910 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b6eaf-fb88-49f8-b7ed-7601b8eb0ecd admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:48.983397 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b6eaf-fb88-49f8-b7ed-7601b8eb0ecd admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:48.988881 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b855d1-5cfb-43c9-9047-c656a223c9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:48.989916 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b855d1-5cfb-43c9-9047-c656a223c9fb admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:48.990408 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b855d1-5cfb-43c9-9047-c656a223c9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:48.990878 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b855d1-5cfb-43c9-9047-c656a223c9fb admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:48.991886 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b855d1-5cfb-43c9-9047-c656a223c9fb admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:48.992387 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b855d1-5cfb-43c9-9047-c656a223c9fb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:48.994261 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b855d1-5cfb-43c9-9047-c656a223c9fb admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:49.000629 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 439/877] 10.222.0.23 () {56 vars in 1144 bytes} [Thu Sep 23 02:55:48 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:49.007580 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0b9da-1294-4fa1-ae58-64a6085b3f39 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:49.019417 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0b9da-1294-4fa1-ae58-64a6085b3f39 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:49.025944 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780cc798-e6f0-4b1c-94e9-f08f716d6e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:49.026966 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cc798-e6f0-4b1c-94e9-f08f716d6e0b admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:49.027456 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cc798-e6f0-4b1c-94e9-f08f716d6e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:49.027908 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cc798-e6f0-4b1c-94e9-f08f716d6e0b admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:49.028915 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780cc798-e6f0-4b1c-94e9-f08f716d6e0b admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:49.029412 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780cc798-e6f0-4b1c-94e9-f08f716d6e0b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:49.031212 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780cc798-e6f0-4b1c-94e9-f08f716d6e0b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:49.037666 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 439/878] 10.222.0.23 () {56 vars in 1144 bytes} [Thu Sep 23 02:55:49 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:49.045172 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b855d1-5cfb-43c9-9047-c656a223c9fb admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:49.055610 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b855d1-5cfb-43c9-9047-c656a223c9fb admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:49.062206 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46642e16-1633-44c3-acf1-fab5a4fe6acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:49.062891 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46642e16-1633-44c3-acf1-fab5a4fe6acc admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:49.063174 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46642e16-1633-44c3-acf1-fab5a4fe6acc admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:49.063448 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46642e16-1633-44c3-acf1-fab5a4fe6acc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:49.064223 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46642e16-1633-44c3-acf1-fab5a4fe6acc admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:49.066185 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46642e16-1633-44c3-acf1-fab5a4fe6acc admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:49.157612 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 440/879] 10.222.0.23 () {60 vars in 1166 bytes} [Thu Sep 23 02:55:49 2021] POST /identity/v3/endpoints => generated 349 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 02:55:50.259186 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddedeb6-68ae-40c4-8f3e-a829bd38fde3 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:50.259679 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddedeb6-68ae-40c4-8f3e-a829bd38fde3 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:50.259679 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddedeb6-68ae-40c4-8f3e-a829bd38fde3 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:50.261678 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 440/880] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:50.269620 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38129d53-8069-4660-b095-de371a5973fa None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:50.270035 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38129d53-8069-4660-b095-de371a5973fa None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:50.270204 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38129d53-8069-4660-b095-de371a5973fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:50.288349 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-38129d53-8069-4660-b095-de371a5973fa None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:50.289870 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-38129d53-8069-4660-b095-de371a5973fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:50.312597 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 441/881] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:50 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:50.330867 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddedeb6-68ae-40c4-8f3e-a829bd38fde3 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:50.345107 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddedeb6-68ae-40c4-8f3e-a829bd38fde3 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:50.349606 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e426f6-20fd-4c6b-bd7e-3211dfff3e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:50.350278 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e426f6-20fd-4c6b-bd7e-3211dfff3e21 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:50.350566 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e426f6-20fd-4c6b-bd7e-3211dfff3e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:50.350843 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e426f6-20fd-4c6b-bd7e-3211dfff3e21 admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:50.351573 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e426f6-20fd-4c6b-bd7e-3211dfff3e21 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:50.353188 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e426f6-20fd-4c6b-bd7e-3211dfff3e21 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:50.433377 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 441/882] 10.222.0.23 () {60 vars in 1163 bytes} [Thu Sep 23 02:55:50 2021] POST /identity/v3/services => generated 242 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 02:55:51.141108 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c7477-ab61-4e2c-82f7-0eab78474657 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:51.141450 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c7477-ab61-4e2c-82f7-0eab78474657 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:51.141622 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c7477-ab61-4e2c-82f7-0eab78474657 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:51.143645 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 442/883] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:51.151327 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f132d-c1ed-4f01-a4c1-4571bf99e8b6 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:51.151605 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f132d-c1ed-4f01-a4c1-4571bf99e8b6 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:51.151887 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f132d-c1ed-4f01-a4c1-4571bf99e8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:51.169996 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-166f132d-c1ed-4f01-a4c1-4571bf99e8b6 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:51.171179 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-166f132d-c1ed-4f01-a4c1-4571bf99e8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:51.192596 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 442/884] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:51 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:51.212414 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c7477-ab61-4e2c-82f7-0eab78474657 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:51.224920 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c7477-ab61-4e2c-82f7-0eab78474657 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:51.229411 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059f396-d94d-4497-afd4-bf779daca503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:51.230198 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059f396-d94d-4497-afd4-bf779daca503 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:51.230477 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059f396-d94d-4497-afd4-bf779daca503 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:51.230753 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059f396-d94d-4497-afd4-bf779daca503 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:51.231974 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059f396-d94d-4497-afd4-bf779daca503 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:51.233591 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059f396-d94d-4497-afd4-bf779daca503 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:51.244466 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-b059f396-d94d-4497-afd4-bf779daca503 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 02:55:51.251411 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 443/885] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:51 2021] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:51.252846 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f132d-c1ed-4f01-a4c1-4571bf99e8b6 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:51.264092 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f132d-c1ed-4f01-a4c1-4571bf99e8b6 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:51.269075 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efabe0-2acf-4a5a-a075-aa75003fc58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:51.269776 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efabe0-2acf-4a5a-a075-aa75003fc58e admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:51.270056 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efabe0-2acf-4a5a-a075-aa75003fc58e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:51.270329 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efabe0-2acf-4a5a-a075-aa75003fc58e admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:51.271055 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efabe0-2acf-4a5a-a075-aa75003fc58e admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:51.271362 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efabe0-2acf-4a5a-a075-aa75003fc58e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:51.273055 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efabe0-2acf-4a5a-a075-aa75003fc58e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:51.284633 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 443/886] 10.222.0.23 () {56 vars in 1134 bytes} [Thu Sep 23 02:55:51 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:51.287635 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059f396-d94d-4497-afd4-bf779daca503 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:51.298196 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059f396-d94d-4497-afd4-bf779daca503 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:51.302901 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2448638-8863-4935-9431-55f31efddacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:51.303558 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2448638-8863-4935-9431-55f31efddacb admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:51.303843 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2448638-8863-4935-9431-55f31efddacb admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:51.304094 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2448638-8863-4935-9431-55f31efddacb admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:51.304826 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2448638-8863-4935-9431-55f31efddacb admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:51.305128 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2448638-8863-4935-9431-55f31efddacb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:51.306706 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2448638-8863-4935-9431-55f31efddacb admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:51.316600 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 444/887] 10.222.0.23 () {56 vars in 1134 bytes} [Thu Sep 23 02:55:51 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:51.318754 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efabe0-2acf-4a5a-a075-aa75003fc58e admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:51.329049 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efabe0-2acf-4a5a-a075-aa75003fc58e admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:51.333690 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02f63a-3282-438f-a02f-893f3d7090ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:51.334347 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02f63a-3282-438f-a02f-893f3d7090ff admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:51.334626 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02f63a-3282-438f-a02f-893f3d7090ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:51.334897 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02f63a-3282-438f-a02f-893f3d7090ff admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:51.335679 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02f63a-3282-438f-a02f-893f3d7090ff admin admin] RBAC: Adding query filter params (interface=public, service_id=27f2a3e7fa504f1d9e0b3b05a33560ea, region_id=RegionOne) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:51.335986 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02f63a-3282-438f-a02f-893f3d7090ff admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:51.337602 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02f63a-3282-438f-a02f-893f3d7090ff admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:51.348615 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 444/888] 10.222.0.23 () {56 vars in 1273 bytes} [Thu Sep 23 02:55:51 2021] GET /identity/v3/endpoints?service_id=27f2a3e7fa504f1d9e0b3b05a33560ea&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:51.350098 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2448638-8863-4935-9431-55f31efddacb admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:51.360979 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2448638-8863-4935-9431-55f31efddacb admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:51.370287 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4baa7-6ba1-4f12-a9e0-66fc92b45dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:51.370642 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfca48-4bd0-4cd9-a5de-82acebd0b2e9 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:51.370817 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4baa7-6ba1-4f12-a9e0-66fc92b45dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:51.370817 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4baa7-6ba1-4f12-a9e0-66fc92b45dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:51.371108 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfca48-4bd0-4cd9-a5de-82acebd0b2e9 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:51.371253 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4baa7-6ba1-4f12-a9e0-66fc92b45dd8 admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:51.371253 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a4baa7-6ba1-4f12-a9e0-66fc92b45dd8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:51.371481 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfca48-4bd0-4cd9-a5de-82acebd0b2e9 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:51.371564 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a4baa7-6ba1-4f12-a9e0-66fc92b45dd8 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:51.371948 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 445/889] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:51 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:51.377654 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 445/890] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 23 02:55:51 2021] GET /identity/v3/services => generated 1957 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 02:55:51.381880 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5a93f-25f9-4e21-bfb8-690e37c04691 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:51.382552 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5a93f-25f9-4e21-bfb8-690e37c04691 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:51.383045 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5a93f-25f9-4e21-bfb8-690e37c04691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:51.407846 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-63f5a93f-25f9-4e21-bfb8-690e37c04691 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:51.409088 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-63f5a93f-25f9-4e21-bfb8-690e37c04691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:51.418062 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 446/891] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:51 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:51.444227 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4baa7-6ba1-4f12-a9e0-66fc92b45dd8 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:51.455570 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4baa7-6ba1-4f12-a9e0-66fc92b45dd8 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:51.460371 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017569b6-32ed-4828-a02c-a6f0a8fc307e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:51.461106 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017569b6-32ed-4828-a02c-a6f0a8fc307e admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:51.461391 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017569b6-32ed-4828-a02c-a6f0a8fc307e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:51.461672 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017569b6-32ed-4828-a02c-a6f0a8fc307e admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:51.462400 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017569b6-32ed-4828-a02c-a6f0a8fc307e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:51.464400 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017569b6-32ed-4828-a02c-a6f0a8fc307e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:51.465772 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3513e5f-6f03-4719-b4b0-a1746245ca00 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:51.466073 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3513e5f-6f03-4719-b4b0-a1746245ca00 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:51.466362 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3513e5f-6f03-4719-b4b0-a1746245ca00 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:51.468605 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 447/892] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:51.476995 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5db71-af55-4000-ac31-8aa1a5442ed4 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:51.477331 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5db71-af55-4000-ac31-8aa1a5442ed4 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:51.477615 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5db71-af55-4000-ac31-8aa1a5442ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:51.497113 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-c9f5db71-af55-4000-ac31-8aa1a5442ed4 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:51.498332 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-c9f5db71-af55-4000-ac31-8aa1a5442ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:51.506451 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 448/893] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:51 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:51.513017 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.sql.core [None req-017569b6-32ed-4828-a02c-a6f0a8fc307e admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 23 02:55:51.513017 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 23 02:55:51.513017 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [parameters: {'user_id': '2b94984bc4d64c6b8e764b7547167642', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 23 02:55:51.513017 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73780) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 23 02:55:51.519293 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-017569b6-32ed-4828-a02c-a6f0a8fc307e admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 23 02:55:51.521091 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 446/894] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 02:55:51 2021] POST /identity/v3/users => generated 160 bytes in 77 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:51.527818 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5db71-af55-4000-ac31-8aa1a5442ed4 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:51.533820 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017569b6-32ed-4828-a02c-a6f0a8fc307e admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:51.539362 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5db71-af55-4000-ac31-8aa1a5442ed4 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:51.545096 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8122610-a669-4997-a27b-ef9f2fa75bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:51.546073 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8122610-a669-4997-a27b-ef9f2fa75bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:51.546362 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8122610-a669-4997-a27b-ef9f2fa75bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:51.546578 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017569b6-32ed-4828-a02c-a6f0a8fc307e admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:51.546693 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8122610-a669-4997-a27b-ef9f2fa75bf8 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:51.551782 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401d778-4efc-4357-af0e-7c73c29d889e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:51.552604 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401d778-4efc-4357-af0e-7c73c29d889e admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:51.552785 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401d778-4efc-4357-af0e-7c73c29d889e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:51.553180 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401d778-4efc-4357-af0e-7c73c29d889e admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:51.554742 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401d778-4efc-4357-af0e-7c73c29d889e admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:51.554929 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8122610-a669-4997-a27b-ef9f2fa75bf8 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:51.555697 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401d778-4efc-4357-af0e-7c73c29d889e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:51.558182 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8122610-a669-4997-a27b-ef9f2fa75bf8 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:51.568044 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-6401d778-4efc-4357-af0e-7c73c29d889e admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 02:55:51.569580 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 447/895] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 23 02:55:51 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:51.574040 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-c8122610-a669-4997-a27b-ef9f2fa75bf8 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 02:55:51.575457 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 449/896] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:55:51 2021] GET /identity/v3/users/cinder => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:51.576208 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401d778-4efc-4357-af0e-7c73c29d889e admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:51.581773 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8122610-a669-4997-a27b-ef9f2fa75bf8 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:51.589810 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401d778-4efc-4357-af0e-7c73c29d889e admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:51.593300 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8122610-a669-4997-a27b-ef9f2fa75bf8 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:51.598251 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e8331-da89-4b97-8bc4-0a58a77d7cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:51.598932 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e8331-da89-4b97-8bc4-0a58a77d7cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:51.599216 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e8331-da89-4b97-8bc4-0a58a77d7cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:51.599492 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e8331-da89-4b97-8bc4-0a58a77d7cd6 admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:51.600198 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e8331-da89-4b97-8bc4-0a58a77d7cd6 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:51.600521 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e8331-da89-4b97-8bc4-0a58a77d7cd6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:51.602123 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e8331-da89-4b97-8bc4-0a58a77d7cd6 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:51.603171 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe816ec7-e7de-4339-9b3d-1708f8799713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:51.604696 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe816ec7-e7de-4339-9b3d-1708f8799713 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:51.605242 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe816ec7-e7de-4339-9b3d-1708f8799713 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:51.605747 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe816ec7-e7de-4339-9b3d-1708f8799713 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:51.607553 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe816ec7-e7de-4339-9b3d-1708f8799713 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:51.608046 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe816ec7-e7de-4339-9b3d-1708f8799713 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:51.610195 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe816ec7-e7de-4339-9b3d-1708f8799713 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:51.612146 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 448/897] 10.222.0.23 () {56 vars in 1144 bytes} [Thu Sep 23 02:55:51 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:51.618868 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e8331-da89-4b97-8bc4-0a58a77d7cd6 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:51.629541 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e8331-da89-4b97-8bc4-0a58a77d7cd6 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:51.634877 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3697bf-4f4a-41df-b73b-9ba222865daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:51.635703 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3697bf-4f4a-41df-b73b-9ba222865daf admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:51.636085 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3697bf-4f4a-41df-b73b-9ba222865daf admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:51.636524 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3697bf-4f4a-41df-b73b-9ba222865daf admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:51.637710 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3697bf-4f4a-41df-b73b-9ba222865daf admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:51.638127 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3697bf-4f4a-41df-b73b-9ba222865daf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:51.639845 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3697bf-4f4a-41df-b73b-9ba222865daf admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:51.645976 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 449/898] 10.222.0.23 () {56 vars in 1144 bytes} [Thu Sep 23 02:55:51 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:51.655851 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3697bf-4f4a-41df-b73b-9ba222865daf admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:51.660132 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 450/899] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Sep 23 02:55:51 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:51.670890 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3697bf-4f4a-41df-b73b-9ba222865daf admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:51.676483 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33426b-f2e9-4ab4-bb86-f17dc766d0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:51.677299 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33426b-f2e9-4ab4-bb86-f17dc766d0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:51.677750 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33426b-f2e9-4ab4-bb86-f17dc766d0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:51.678151 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33426b-f2e9-4ab4-bb86-f17dc766d0a4 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:51.679112 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33426b-f2e9-4ab4-bb86-f17dc766d0a4 admin admin] RBAC: Adding query filter params (interface=admin, service_id=04a35ecd24c7475894ca55a1f61f846a, region_id=RegionOne) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:51.679504 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33426b-f2e9-4ab4-bb86-f17dc766d0a4 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:51.681663 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33426b-f2e9-4ab4-bb86-f17dc766d0a4 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:51.688908 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 450/900] 10.222.0.23 () {56 vars in 1271 bytes} [Thu Sep 23 02:55:51 2021] GET /identity/v3/endpoints?service_id=04a35ecd24c7475894ca55a1f61f846a&interface=admin®ion_id=RegionOne => generated 193 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:51.695595 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe816ec7-e7de-4339-9b3d-1708f8799713 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:51.706806 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe816ec7-e7de-4339-9b3d-1708f8799713 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:51.712276 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55b432-e963-447b-ad36-21e80913effa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:51.713373 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55b432-e963-447b-ad36-21e80913effa admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:51.713862 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55b432-e963-447b-ad36-21e80913effa admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:51.714374 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55b432-e963-447b-ad36-21e80913effa admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:51.715271 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55b432-e963-447b-ad36-21e80913effa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:51.717887 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55b432-e963-447b-ad36-21e80913effa admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:51.726160 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 451/901] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 23 02:55:51 2021] GET /identity/v3/services => generated 1957 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 02:55:52.741066 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85096b9-7725-4b61-be41-70b7ec5368b4 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:52.741607 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85096b9-7725-4b61-be41-70b7ec5368b4 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:52.741607 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85096b9-7725-4b61-be41-70b7ec5368b4 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:52.743400 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 451/902] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:52.750493 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a9ea7-f697-4976-8bb1-2ceb195da6d3 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:52.750900 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a9ea7-f697-4976-8bb1-2ceb195da6d3 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:52.751070 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a9ea7-f697-4976-8bb1-2ceb195da6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:52.771956 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-b12a9ea7-f697-4976-8bb1-2ceb195da6d3 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:52.773163 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-b12a9ea7-f697-4976-8bb1-2ceb195da6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:52.788634 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 452/903] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:52 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:52.810961 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85096b9-7725-4b61-be41-70b7ec5368b4 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:52.823076 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85096b9-7725-4b61-be41-70b7ec5368b4 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:52.827559 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8cbb8-bbe3-4b64-8d44-fcf95176edb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:52.828354 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8cbb8-bbe3-4b64-8d44-fcf95176edb2 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:52.828668 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8cbb8-bbe3-4b64-8d44-fcf95176edb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:52.828945 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8cbb8-bbe3-4b64-8d44-fcf95176edb2 admin admin] PATH_INFO: `/v3/services/image` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:52.829602 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8cbb8-bbe3-4b64-8d44-fcf95176edb2 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:52.831185 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8cbb8-bbe3-4b64-8d44-fcf95176edb2 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:52.842240 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-69e8cbb8-bbe3-4b64-8d44-fcf95176edb2 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 02:55:52.843728 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 452/904] 10.222.0.23 () {56 vars in 1127 bytes} [Thu Sep 23 02:55:52 2021] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:52.850056 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a9ea7-f697-4976-8bb1-2ceb195da6d3 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:52.859725 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a9ea7-f697-4976-8bb1-2ceb195da6d3 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:52.864231 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de0f7a-5d08-45c5-9959-c5d9ecb7704d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:52.864932 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de0f7a-5d08-45c5-9959-c5d9ecb7704d admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:52.865216 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de0f7a-5d08-45c5-9959-c5d9ecb7704d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:52.865492 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de0f7a-5d08-45c5-9959-c5d9ecb7704d admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:52.866197 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de0f7a-5d08-45c5-9959-c5d9ecb7704d admin admin] RBAC: Adding query filter params (name=image) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:52.866508 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de0f7a-5d08-45c5-9959-c5d9ecb7704d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:52.868091 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de0f7a-5d08-45c5-9959-c5d9ecb7704d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:52.873785 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 453/905] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:52 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:52.879746 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8cbb8-bbe3-4b64-8d44-fcf95176edb2 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:52.889877 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8cbb8-bbe3-4b64-8d44-fcf95176edb2 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:52.894516 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfa431-b00c-4e10-8047-d17ba38503d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:52.895184 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfa431-b00c-4e10-8047-d17ba38503d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:52.895512 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfa431-b00c-4e10-8047-d17ba38503d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:52.895787 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfa431-b00c-4e10-8047-d17ba38503d2 admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:52.896514 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfa431-b00c-4e10-8047-d17ba38503d2 admin admin] RBAC: Adding query filter params (type=image) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:52.896812 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfa431-b00c-4e10-8047-d17ba38503d2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:52.898381 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfa431-b00c-4e10-8047-d17ba38503d2 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:52.903820 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 453/906] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:52 2021] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:52.909940 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de0f7a-5d08-45c5-9959-c5d9ecb7704d admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:52.920139 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de0f7a-5d08-45c5-9959-c5d9ecb7704d admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:52.924843 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe797a-3c76-41b7-90a4-9e003854726d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:52.925507 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe797a-3c76-41b7-90a4-9e003854726d admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:52.925845 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe797a-3c76-41b7-90a4-9e003854726d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:52.926131 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe797a-3c76-41b7-90a4-9e003854726d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:52.926917 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe797a-3c76-41b7-90a4-9e003854726d admin admin] RBAC: Adding query filter params (interface=public, service_id=f18d2ba3011041eda6e9e2822dc930dc, region_id=RegionOne) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:52.927234 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe797a-3c76-41b7-90a4-9e003854726d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:52.928972 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe797a-3c76-41b7-90a4-9e003854726d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:52.936520 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 454/907] 10.222.0.23 () {56 vars in 1273 bytes} [Thu Sep 23 02:55:52 2021] GET /identity/v3/endpoints?service_id=f18d2ba3011041eda6e9e2822dc930dc&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:52.941544 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfa431-b00c-4e10-8047-d17ba38503d2 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:52.951887 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfa431-b00c-4e10-8047-d17ba38503d2 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:52.956626 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570707e-95d1-491c-b655-778b6cc6af4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:52.957372 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570707e-95d1-491c-b655-778b6cc6af4e admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:52.957806 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570707e-95d1-491c-b655-778b6cc6af4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:52.958269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570707e-95d1-491c-b655-778b6cc6af4e admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:52.958692 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570707e-95d1-491c-b655-778b6cc6af4e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:52.960280 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570707e-95d1-491c-b655-778b6cc6af4e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:52.967342 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 454/908] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 23 02:55:52 2021] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 02:55:53.581029 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d07c5b-d3aa-4d0f-ac4d-ac5caffbcb8b None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:53.581321 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d07c5b-d3aa-4d0f-ac4d-ac5caffbcb8b None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:53.581601 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d07c5b-d3aa-4d0f-ac4d-ac5caffbcb8b None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:53.583367 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 455/909] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:53.590631 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ede165-498b-4337-8419-04ea2fe5dd0e None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:53.591431 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ede165-498b-4337-8419-04ea2fe5dd0e None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:53.591711 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ede165-498b-4337-8419-04ea2fe5dd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:53.609326 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-46ede165-498b-4337-8419-04ea2fe5dd0e None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:53.610824 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-46ede165-498b-4337-8419-04ea2fe5dd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:53.618676 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 455/910] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:53 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:53.643360 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d07c5b-d3aa-4d0f-ac4d-ac5caffbcb8b None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:53.655490 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d07c5b-d3aa-4d0f-ac4d-ac5caffbcb8b None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:53.659932 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87e1bf-b321-407c-af1e-ba48d4712fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:53.660739 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87e1bf-b321-407c-af1e-ba48d4712fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:53.661018 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87e1bf-b321-407c-af1e-ba48d4712fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:53.661291 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87e1bf-b321-407c-af1e-ba48d4712fc6 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:53.661934 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87e1bf-b321-407c-af1e-ba48d4712fc6 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:53.663518 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87e1bf-b321-407c-af1e-ba48d4712fc6 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:53.674635 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-df87e1bf-b321-407c-af1e-ba48d4712fc6 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 02:55:53.675799 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 456/911] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:53 2021] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:53.682525 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ede165-498b-4337-8419-04ea2fe5dd0e None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:53.691603 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ede165-498b-4337-8419-04ea2fe5dd0e None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:53.696223 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd906bfd-c3ca-43ac-a578-1e72fa77f8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:53.696924 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd906bfd-c3ca-43ac-a578-1e72fa77f8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:53.697201 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd906bfd-c3ca-43ac-a578-1e72fa77f8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:53.697473 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd906bfd-c3ca-43ac-a578-1e72fa77f8d1 admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:53.698180 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd906bfd-c3ca-43ac-a578-1e72fa77f8d1 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:53.698481 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd906bfd-c3ca-43ac-a578-1e72fa77f8d1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:53.700609 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd906bfd-c3ca-43ac-a578-1e72fa77f8d1 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:53.705569 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 456/912] 10.222.0.23 () {56 vars in 1134 bytes} [Thu Sep 23 02:55:53 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:53.711942 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87e1bf-b321-407c-af1e-ba48d4712fc6 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:53.722015 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87e1bf-b321-407c-af1e-ba48d4712fc6 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:53.726600 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273d630-995f-464a-a2e4-94f21ce2887c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:53.727250 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273d630-995f-464a-a2e4-94f21ce2887c admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:53.727530 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273d630-995f-464a-a2e4-94f21ce2887c admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:53.727804 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273d630-995f-464a-a2e4-94f21ce2887c admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:53.728517 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273d630-995f-464a-a2e4-94f21ce2887c admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:53.728823 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273d630-995f-464a-a2e4-94f21ce2887c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:53.730392 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273d630-995f-464a-a2e4-94f21ce2887c admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:53.735243 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 457/913] 10.222.0.23 () {56 vars in 1134 bytes} [Thu Sep 23 02:55:53 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:53.741715 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd906bfd-c3ca-43ac-a578-1e72fa77f8d1 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:53.753771 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd906bfd-c3ca-43ac-a578-1e72fa77f8d1 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:53.758966 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378766b1-f269-48f8-a697-09566ad8d292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:53.759634 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378766b1-f269-48f8-a697-09566ad8d292 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:53.759915 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378766b1-f269-48f8-a697-09566ad8d292 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:53.760188 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378766b1-f269-48f8-a697-09566ad8d292 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:53.761092 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378766b1-f269-48f8-a697-09566ad8d292 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:53.763505 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378766b1-f269-48f8-a697-09566ad8d292 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:53.904835 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 457/914] 10.222.0.23 () {60 vars in 1166 bytes} [Thu Sep 23 02:55:53 2021] POST /identity/v3/endpoints => generated 334 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 02:55:53.967876 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4604d1a-dd86-4c3f-be84-beac41e37bd1 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:53.968478 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4604d1a-dd86-4c3f-be84-beac41e37bd1 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:53.968676 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4604d1a-dd86-4c3f-be84-beac41e37bd1 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:53.970551 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 458/915] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:53.978684 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2869dbc-49d2-439c-bd8b-0c7fedbaf72f None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:53.978979 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2869dbc-49d2-439c-bd8b-0c7fedbaf72f None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:53.979244 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2869dbc-49d2-439c-bd8b-0c7fedbaf72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:53.998400 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-a2869dbc-49d2-439c-bd8b-0c7fedbaf72f None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:53.999615 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-a2869dbc-49d2-439c-bd8b-0c7fedbaf72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:54.017983 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 458/916] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:53 2021] POST /identity/v3/auth/tokens => generated 2828 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:54.042424 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4604d1a-dd86-4c3f-be84-beac41e37bd1 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:54.055489 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4604d1a-dd86-4c3f-be84-beac41e37bd1 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:54.060551 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e63083-08ee-4493-b2c9-68a6088e0b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:54.061357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e63083-08ee-4493-b2c9-68a6088e0b6d admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:54.061633 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e63083-08ee-4493-b2c9-68a6088e0b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:54.061907 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e63083-08ee-4493-b2c9-68a6088e0b6d admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:54.062554 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e63083-08ee-4493-b2c9-68a6088e0b6d admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:54.064142 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e63083-08ee-4493-b2c9-68a6088e0b6d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:54.076089 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-f4e63083-08ee-4493-b2c9-68a6088e0b6d admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 02:55:54.077291 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 459/917] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 23 02:55:54 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:54.084020 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2869dbc-49d2-439c-bd8b-0c7fedbaf72f None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:54.093517 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2869dbc-49d2-439c-bd8b-0c7fedbaf72f None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:54.098194 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e704be8-a675-4ed3-aa39-dd27f0d56094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:54.098865 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e704be8-a675-4ed3-aa39-dd27f0d56094 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:54.099148 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e704be8-a675-4ed3-aa39-dd27f0d56094 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:54.099428 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e704be8-a675-4ed3-aa39-dd27f0d56094 admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:54.100142 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e704be8-a675-4ed3-aa39-dd27f0d56094 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:54.100447 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e704be8-a675-4ed3-aa39-dd27f0d56094 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:54.102062 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e704be8-a675-4ed3-aa39-dd27f0d56094 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:54.107740 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 459/918] 10.222.0.23 () {56 vars in 1144 bytes} [Thu Sep 23 02:55:54 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:54.114430 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e63083-08ee-4493-b2c9-68a6088e0b6d admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:54.124719 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e63083-08ee-4493-b2c9-68a6088e0b6d admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:54.129407 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823d104-4fdd-4aea-a8fc-292d8fc6a054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:54.130069 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823d104-4fdd-4aea-a8fc-292d8fc6a054 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:54.130353 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823d104-4fdd-4aea-a8fc-292d8fc6a054 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:54.130629 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823d104-4fdd-4aea-a8fc-292d8fc6a054 admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:54.131343 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823d104-4fdd-4aea-a8fc-292d8fc6a054 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:54.131656 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823d104-4fdd-4aea-a8fc-292d8fc6a054 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:54.133297 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823d104-4fdd-4aea-a8fc-292d8fc6a054 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:54.139409 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 460/919] 10.222.0.23 () {56 vars in 1144 bytes} [Thu Sep 23 02:55:54 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:54.145970 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e704be8-a675-4ed3-aa39-dd27f0d56094 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:54.156693 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e704be8-a675-4ed3-aa39-dd27f0d56094 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:54.161757 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08593505-be4a-41d5-bbe4-846af73183b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:54.162456 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08593505-be4a-41d5-bbe4-846af73183b6 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:54.162740 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08593505-be4a-41d5-bbe4-846af73183b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:54.163012 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08593505-be4a-41d5-bbe4-846af73183b6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:54.163790 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08593505-be4a-41d5-bbe4-846af73183b6 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:54.165513 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08593505-be4a-41d5-bbe4-846af73183b6 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:54.238788 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 460/920] 10.222.0.23 () {60 vars in 1166 bytes} [Thu Sep 23 02:55:54 2021] POST /identity/v3/endpoints => generated 325 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 02:55:55.183207 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ff790-2360-4d00-a3a2-855fefb20964 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:55.183768 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ff790-2360-4d00-a3a2-855fefb20964 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:55.183768 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ff790-2360-4d00-a3a2-855fefb20964 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:55.185828 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 461/921] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:55.193677 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bae9e-1c65-48df-a845-6f634e26ff63 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:55.194198 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bae9e-1c65-48df-a845-6f634e26ff63 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:55.194276 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bae9e-1c65-48df-a845-6f634e26ff63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:55.212098 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-773bae9e-1c65-48df-a845-6f634e26ff63 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:55.213325 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-773bae9e-1c65-48df-a845-6f634e26ff63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:55.230953 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 461/922] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:55 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:55.255021 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ff790-2360-4d00-a3a2-855fefb20964 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:55.267440 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ff790-2360-4d00-a3a2-855fefb20964 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:55.271802 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d786018-a235-46b2-a0ed-530bc0e220bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:55.272614 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d786018-a235-46b2-a0ed-530bc0e220bc admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:55.272904 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d786018-a235-46b2-a0ed-530bc0e220bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:55.273184 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d786018-a235-46b2-a0ed-530bc0e220bc admin admin] PATH_INFO: `/v3/services/image` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:55.273834 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d786018-a235-46b2-a0ed-530bc0e220bc admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:55.275444 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d786018-a235-46b2-a0ed-530bc0e220bc admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:55.286817 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-8d786018-a235-46b2-a0ed-530bc0e220bc admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 02:55:55.288173 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 462/923] 10.222.0.23 () {56 vars in 1127 bytes} [Thu Sep 23 02:55:55 2021] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:55.294987 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bae9e-1c65-48df-a845-6f634e26ff63 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:55.304243 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bae9e-1c65-48df-a845-6f634e26ff63 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:55.308882 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519b31b-247c-4d43-9ee0-14bfdbe3c9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:55.310116 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519b31b-247c-4d43-9ee0-14bfdbe3c9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:55.310465 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519b31b-247c-4d43-9ee0-14bfdbe3c9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:55.310747 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519b31b-247c-4d43-9ee0-14bfdbe3c9c1 admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:55.311455 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4519b31b-247c-4d43-9ee0-14bfdbe3c9c1 admin admin] RBAC: Adding query filter params (name=image) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:55.311761 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4519b31b-247c-4d43-9ee0-14bfdbe3c9c1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:55.313393 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4519b31b-247c-4d43-9ee0-14bfdbe3c9c1 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:55.318431 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 462/924] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:55 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:55.324578 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d786018-a235-46b2-a0ed-530bc0e220bc admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:55.334919 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d786018-a235-46b2-a0ed-530bc0e220bc admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:55.339442 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45842233-03d4-45d4-8c7a-351879048390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:55.340105 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45842233-03d4-45d4-8c7a-351879048390 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:55.340411 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45842233-03d4-45d4-8c7a-351879048390 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:55.340740 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45842233-03d4-45d4-8c7a-351879048390 admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:55.341443 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45842233-03d4-45d4-8c7a-351879048390 admin admin] RBAC: Adding query filter params (type=image) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:55.341750 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45842233-03d4-45d4-8c7a-351879048390 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:55.343333 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45842233-03d4-45d4-8c7a-351879048390 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:55.348173 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 463/925] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:55 2021] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:55.354243 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519b31b-247c-4d43-9ee0-14bfdbe3c9c1 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:55.364013 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519b31b-247c-4d43-9ee0-14bfdbe3c9c1 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:55.368776 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5acb5-0450-4852-a384-a3c56db9f318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:55.369505 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5acb5-0450-4852-a384-a3c56db9f318 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:55.369794 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5acb5-0450-4852-a384-a3c56db9f318 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:55.370070 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5acb5-0450-4852-a384-a3c56db9f318 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:55.370817 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5acb5-0450-4852-a384-a3c56db9f318 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:55.372918 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5acb5-0450-4852-a384-a3c56db9f318 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:55.456595 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 463/926] 10.222.0.23 () {60 vars in 1166 bytes} [Thu Sep 23 02:55:55 2021] POST /identity/v3/endpoints => generated 327 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 02:55:56.224965 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73e102-6ea0-4c67-98fa-212798e8df43 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:56.225454 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73e102-6ea0-4c67-98fa-212798e8df43 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:56.225454 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73e102-6ea0-4c67-98fa-212798e8df43 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:56.227335 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 464/927] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:56.234625 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964924eb-8877-496e-9c6a-6dae82888fe1 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:56.235030 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964924eb-8877-496e-9c6a-6dae82888fe1 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:56.235205 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964924eb-8877-496e-9c6a-6dae82888fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:56.255090 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-964924eb-8877-496e-9c6a-6dae82888fe1 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:56.256266 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-964924eb-8877-496e-9c6a-6dae82888fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:56.275323 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 464/928] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:56 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:56.301724 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73e102-6ea0-4c67-98fa-212798e8df43 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:56.314203 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73e102-6ea0-4c67-98fa-212798e8df43 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:56.318519 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63221bdc-ec32-436c-a0d2-977f211dfdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:56.319316 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63221bdc-ec32-436c-a0d2-977f211dfdff admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:56.319596 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63221bdc-ec32-436c-a0d2-977f211dfdff admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:56.319871 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63221bdc-ec32-436c-a0d2-977f211dfdff admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:56.332449 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63221bdc-ec32-436c-a0d2-977f211dfdff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:56.340034 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-63221bdc-ec32-436c-a0d2-977f211dfdff admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 02:55:56.344660 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 465/929] 10.222.0.23 () {56 vars in 1142 bytes} [Thu Sep 23 02:55:56 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:56.348328 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964924eb-8877-496e-9c6a-6dae82888fe1 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:56.358670 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964924eb-8877-496e-9c6a-6dae82888fe1 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:56.363719 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51928b-c796-4776-8751-d8b8850ecf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:56.364541 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51928b-c796-4776-8751-d8b8850ecf56 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:56.364904 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51928b-c796-4776-8751-d8b8850ecf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:56.365271 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51928b-c796-4776-8751-d8b8850ecf56 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:56.366118 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51928b-c796-4776-8751-d8b8850ecf56 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:56.366499 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51928b-c796-4776-8751-d8b8850ecf56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:56.368244 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51928b-c796-4776-8751-d8b8850ecf56 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:56.379502 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 465/930] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Sep 23 02:55:56 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:56.385446 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63221bdc-ec32-436c-a0d2-977f211dfdff admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:56.395658 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63221bdc-ec32-436c-a0d2-977f211dfdff admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:56.400260 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42740583-43b0-48dd-adfc-bb872a8cb082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:56.401089 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42740583-43b0-48dd-adfc-bb872a8cb082 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:56.401376 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42740583-43b0-48dd-adfc-bb872a8cb082 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:56.401656 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42740583-43b0-48dd-adfc-bb872a8cb082 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:56.411971 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42740583-43b0-48dd-adfc-bb872a8cb082 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:56.413835 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42740583-43b0-48dd-adfc-bb872a8cb082 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:56.430618 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-42740583-43b0-48dd-adfc-bb872a8cb082 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:56.431935 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 466/931] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:56.442505 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51928b-c796-4776-8751-d8b8850ecf56 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:56.452506 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51928b-c796-4776-8751-d8b8850ecf56 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:56.457203 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a797b1-9350-4119-8543-1b1799d045b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:56.457884 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a797b1-9350-4119-8543-1b1799d045b9 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:56.458165 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a797b1-9350-4119-8543-1b1799d045b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:56.458443 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a797b1-9350-4119-8543-1b1799d045b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:56.458535 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2a7dc-40c9-4e71-99c8-8bb8c7efb66a None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:56.458818 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2a7dc-40c9-4e71-99c8-8bb8c7efb66a None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:56.459096 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2a7dc-40c9-4e71-99c8-8bb8c7efb66a None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:56.459188 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a797b1-9350-4119-8543-1b1799d045b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:56.459467 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a797b1-9350-4119-8543-1b1799d045b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:56.461075 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 467/932] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:56 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 02:55:56.461175 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a797b1-9350-4119-8543-1b1799d045b9 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:56.468879 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae45c0-4745-4046-8439-b5c57ad10614 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:56.468879 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae45c0-4745-4046-8439-b5c57ad10614 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:56.469135 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae45c0-4745-4046-8439-b5c57ad10614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:56.480558 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 466/933] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:56.482574 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a797b1-9350-4119-8543-1b1799d045b9 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:56.487310 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-6dae45c0-4745-4046-8439-b5c57ad10614 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:56.488505 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-6dae45c0-4745-4046-8439-b5c57ad10614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:56.492708 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a797b1-9350-4119-8543-1b1799d045b9 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:56.496618 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 468/934] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:56 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:55:56.500419 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8096a-e98b-4939-a59b-adf23510455d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:56.501306 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8096a-e98b-4939-a59b-adf23510455d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:56.501591 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8096a-e98b-4939-a59b-adf23510455d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:56.501918 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8096a-e98b-4939-a59b-adf23510455d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:56.509754 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8096a-e98b-4939-a59b-adf23510455d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:56.512056 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8096a-e98b-4939-a59b-adf23510455d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:56.522215 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae45c0-4745-4046-8439-b5c57ad10614 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:56.526364 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-bbe8096a-e98b-4939-a59b-adf23510455d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 02:55:56.533228 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 467/935] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Sep 23 02:55:56 2021] GET /identity/v3/users/nova => generated 82 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:56.534367 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8096a-e98b-4939-a59b-adf23510455d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:56.535270 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae45c0-4745-4046-8439-b5c57ad10614 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:56.539942 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631a973-1e8e-4e09-b87a-5ab3a5653899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:56.540797 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631a973-1e8e-4e09-b87a-5ab3a5653899 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:56.541079 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631a973-1e8e-4e09-b87a-5ab3a5653899 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:56.541354 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631a973-1e8e-4e09-b87a-5ab3a5653899 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:56.542527 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631a973-1e8e-4e09-b87a-5ab3a5653899 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:56.543953 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8096a-e98b-4939-a59b-adf23510455d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:56.544237 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631a973-1e8e-4e09-b87a-5ab3a5653899 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:56.546054 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 469/936] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:56 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:56.548478 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8a5cd-d4d3-4089-be37-e14b3052f5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:56.549181 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8a5cd-d4d3-4089-be37-e14b3052f5ff admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:56.549462 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8a5cd-d4d3-4089-be37-e14b3052f5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:56.549736 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8a5cd-d4d3-4089-be37-e14b3052f5ff admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:56.550632 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8a5cd-d4d3-4089-be37-e14b3052f5ff admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:56.550942 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8a5cd-d4d3-4089-be37-e14b3052f5ff admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:56.552408 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631a973-1e8e-4e09-b87a-5ab3a5653899 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:56.553148 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8a5cd-d4d3-4089-be37-e14b3052f5ff admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:56.562465 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631a973-1e8e-4e09-b87a-5ab3a5653899 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:56.566459 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4117f-0a6b-42ef-bf98-bf7d62aa1f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:56.567140 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4117f-0a6b-42ef-bf98-bf7d62aa1f70 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:56.567401 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4117f-0a6b-42ef-bf98-bf7d62aa1f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:56.567678 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4117f-0a6b-42ef-bf98-bf7d62aa1f70 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:56.568375 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4117f-0a6b-42ef-bf98-bf7d62aa1f70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:56.570284 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4117f-0a6b-42ef-bf98-bf7d62aa1f70 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:56.572770 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 468/937] 10.222.0.23 () {56 vars in 1155 bytes} [Thu Sep 23 02:55:56 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:56.579631 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8a5cd-d4d3-4089-be37-e14b3052f5ff admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:56.598171 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8a5cd-d4d3-4089-be37-e14b3052f5ff admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:56.602876 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ccf25-f817-4409-9aba-d617da11269f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:56.603519 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ccf25-f817-4409-9aba-d617da11269f admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:56.610685 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ccf25-f817-4409-9aba-d617da11269f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:56.610685 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ccf25-f817-4409-9aba-d617da11269f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:56.613077 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ccf25-f817-4409-9aba-d617da11269f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:56.614890 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ccf25-f817-4409-9aba-d617da11269f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:56.624036 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 469/938] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:55:56 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:55:56.632013 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ccf25-f817-4409-9aba-d617da11269f admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:56.641296 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ccf25-f817-4409-9aba-d617da11269f admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:56.646270 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b1290-259c-481f-b9f9-3b521a989bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:56.647088 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b1290-259c-481f-b9f9-3b521a989bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:56.647370 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b1290-259c-481f-b9f9-3b521a989bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:56.647646 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b1290-259c-481f-b9f9-3b521a989bc9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:56.658664 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b1290-259c-481f-b9f9-3b521a989bc9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:56.660515 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b1290-259c-481f-b9f9-3b521a989bc9 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:56.677425 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-5d7b1290-259c-481f-b9f9-3b521a989bc9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:56.678605 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 470/939] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:56.684847 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b1290-259c-481f-b9f9-3b521a989bc9 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:56.695075 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b1290-259c-481f-b9f9-3b521a989bc9 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:56.707360 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 470/940] 10.222.0.23 () {60 vars in 1163 bytes} [Thu Sep 23 02:55:56 2021] POST /identity/v3/projects => generated 311 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 02:55:56.757398 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9690e6-d946-4f56-b3a9-5fa9eecd4033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:56.757987 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9690e6-d946-4f56-b3a9-5fa9eecd4033 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:56.758264 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9690e6-d946-4f56-b3a9-5fa9eecd4033 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:56.758548 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9690e6-d946-4f56-b3a9-5fa9eecd4033 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:56.759285 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9690e6-d946-4f56-b3a9-5fa9eecd4033 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:56.759590 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9690e6-d946-4f56-b3a9-5fa9eecd4033 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:56.761263 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9690e6-d946-4f56-b3a9-5fa9eecd4033 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:56.774265 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 471/941] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:56.781452 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4117f-0a6b-42ef-bf98-bf7d62aa1f70 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:56.791702 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4117f-0a6b-42ef-bf98-bf7d62aa1f70 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:56.796966 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae99d6-89ba-4250-bfbe-b4088d9e8d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:56.797781 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae99d6-89ba-4250-bfbe-b4088d9e8d30 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:56.798061 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae99d6-89ba-4250-bfbe-b4088d9e8d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:56.798332 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae99d6-89ba-4250-bfbe-b4088d9e8d30 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:56.810343 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae99d6-89ba-4250-bfbe-b4088d9e8d30 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:56.813401 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae99d6-89ba-4250-bfbe-b4088d9e8d30 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:56.834343 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-5aae99d6-89ba-4250-bfbe-b4088d9e8d30 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:56.835620 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 471/942] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:56.842701 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9690e6-d946-4f56-b3a9-5fa9eecd4033 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:56.852881 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9690e6-d946-4f56-b3a9-5fa9eecd4033 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:56.858390 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468df254-8784-42db-a5ec-e3eb1190f420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:56.859077 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468df254-8784-42db-a5ec-e3eb1190f420 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:56.859358 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468df254-8784-42db-a5ec-e3eb1190f420 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:56.859631 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468df254-8784-42db-a5ec-e3eb1190f420 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:56.860431 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468df254-8784-42db-a5ec-e3eb1190f420 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:56.860789 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468df254-8784-42db-a5ec-e3eb1190f420 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:56.862673 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468df254-8784-42db-a5ec-e3eb1190f420 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:56.876736 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 472/943] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:56.883533 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae99d6-89ba-4250-bfbe-b4088d9e8d30 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:56.894769 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae99d6-89ba-4250-bfbe-b4088d9e8d30 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:56.899671 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db7e8e-03e4-470f-8a95-65b719ab90c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:56.900557 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db7e8e-03e4-470f-8a95-65b719ab90c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:56.901022 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db7e8e-03e4-470f-8a95-65b719ab90c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:56.901459 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db7e8e-03e4-470f-8a95-65b719ab90c9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:56.902570 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db7e8e-03e4-470f-8a95-65b719ab90c9 admin admin] RBAC: Adding query filter params (role.id=315578ac69fb46e3abcddcd340bbd0a7, scope.project.id=73dcb70ac3714a428a717707e6be8201, user.id=83aa47f723434143b22aac1b96b6a610) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:56.903412 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db7e8e-03e4-470f-8a95-65b719ab90c9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:56.905392 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db7e8e-03e4-470f-8a95-65b719ab90c9 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:56.912573 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 472/944] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:55:56 2021] GET /identity/v3/role_assignments?user.id=83aa47f723434143b22aac1b96b6a610&scope.project.id=73dcb70ac3714a428a717707e6be8201&role.id=315578ac69fb46e3abcddcd340bbd0a7 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:57.648855 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4812ab2-239a-4c66-a141-65733d742528 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:57.649374 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4812ab2-239a-4c66-a141-65733d742528 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:57.649450 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4812ab2-239a-4c66-a141-65733d742528 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:57.651377 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 473/945] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:57.658960 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece60faf-b87f-43d9-804d-6caa4fa82e33 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:57.659422 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece60faf-b87f-43d9-804d-6caa4fa82e33 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:57.659600 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece60faf-b87f-43d9-804d-6caa4fa82e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:57.676982 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-ece60faf-b87f-43d9-804d-6caa4fa82e33 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:57.678154 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-ece60faf-b87f-43d9-804d-6caa4fa82e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:57.685999 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 473/946] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:57 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:57.709499 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4812ab2-239a-4c66-a141-65733d742528 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:57.722304 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4812ab2-239a-4c66-a141-65733d742528 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:57.728570 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34cf77-04a6-49eb-9ca4-a79a14f8b437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:57.729225 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34cf77-04a6-49eb-9ca4-a79a14f8b437 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:57.729512 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34cf77-04a6-49eb-9ca4-a79a14f8b437 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:57.729794 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34cf77-04a6-49eb-9ca4-a79a14f8b437 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:57.738386 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34cf77-04a6-49eb-9ca4-a79a14f8b437 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:57.740160 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34cf77-04a6-49eb-9ca4-a79a14f8b437 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:57.749556 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 474/947] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:55:57 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:55:57.756161 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece60faf-b87f-43d9-804d-6caa4fa82e33 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:57.766443 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece60faf-b87f-43d9-804d-6caa4fa82e33 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:57.771778 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3709a9-6261-43ff-bd8e-a429d217464f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:57.772710 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3709a9-6261-43ff-bd8e-a429d217464f admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:57.773064 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3709a9-6261-43ff-bd8e-a429d217464f admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:57.773411 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3709a9-6261-43ff-bd8e-a429d217464f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:57.774769 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3709a9-6261-43ff-bd8e-a429d217464f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:57.776553 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3709a9-6261-43ff-bd8e-a429d217464f admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:57.778966 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 474/948] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:57 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:59.055212 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa3e38-9d61-406f-8f3d-1c34f60e01c7 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:59.055727 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa3e38-9d61-406f-8f3d-1c34f60e01c7 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:59.055836 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa3e38-9d61-406f-8f3d-1c34f60e01c7 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:59.057780 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 475/949] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:59.065902 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4da1f-0886-43bc-a5f4-eedde6c85541 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:59.066344 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4da1f-0886-43bc-a5f4-eedde6c85541 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:59.066569 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4da1f-0886-43bc-a5f4-eedde6c85541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:59.085189 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-25e4da1f-0886-43bc-a5f4-eedde6c85541 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:59.086310 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-25e4da1f-0886-43bc-a5f4-eedde6c85541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:59.094236 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 475/950] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:59 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:59.096732 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fa88e-a975-4b3d-80d6-002d52bb845e None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:59.097023 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fa88e-a975-4b3d-80d6-002d52bb845e None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:59.097297 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fa88e-a975-4b3d-80d6-002d52bb845e None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:59.099040 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 476/951] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:55:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:55:59.105920 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7739b-539d-4912-84e9-cf713d8b5aee None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:59.106263 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7739b-539d-4912-84e9-cf713d8b5aee None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:59.106598 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7739b-539d-4912-84e9-cf713d8b5aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:59.120100 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fa88e-a975-4b3d-80d6-002d52bb845e None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:59.125153 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-86d7739b-539d-4912-84e9-cf713d8b5aee None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:55:59.126361 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-86d7739b-539d-4912-84e9-cf713d8b5aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:55:59.134593 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fa88e-a975-4b3d-80d6-002d52bb845e None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:59.137105 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 476/952] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:55:59 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:55:59.139868 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25effa2a-2274-4cce-bc8c-4b6bcbd3890d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:59.140691 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25effa2a-2274-4cce-bc8c-4b6bcbd3890d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:59.140977 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25effa2a-2274-4cce-bc8c-4b6bcbd3890d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:59.141253 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25effa2a-2274-4cce-bc8c-4b6bcbd3890d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:59.142409 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25effa2a-2274-4cce-bc8c-4b6bcbd3890d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:59.144108 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25effa2a-2274-4cce-bc8c-4b6bcbd3890d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:59.150915 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 477/953] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:59 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:59.151915 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7739b-539d-4912-84e9-cf713d8b5aee None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:59.161425 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7739b-539d-4912-84e9-cf713d8b5aee None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:59.161612 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25effa2a-2274-4cce-bc8c-4b6bcbd3890d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:59.165969 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694708a-ed75-4e86-a04a-21984156986b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:59.166646 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694708a-ed75-4e86-a04a-21984156986b admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:59.167182 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694708a-ed75-4e86-a04a-21984156986b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:59.167182 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694708a-ed75-4e86-a04a-21984156986b admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:59.167879 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694708a-ed75-4e86-a04a-21984156986b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:59.169865 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694708a-ed75-4e86-a04a-21984156986b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:59.171120 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25effa2a-2274-4cce-bc8c-4b6bcbd3890d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:59.175555 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a7702-55c6-4a6b-ab33-f59184302db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:59.176348 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a7702-55c6-4a6b-ab33-f59184302db5 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:59.176662 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a7702-55c6-4a6b-ab33-f59184302db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:59.176942 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a7702-55c6-4a6b-ab33-f59184302db5 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:59.187531 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a7702-55c6-4a6b-ab33-f59184302db5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:55:59.194797 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-135a7702-55c6-4a6b-ab33-f59184302db5 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 02:55:59.196030 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 478/954] 10.222.0.23 () {56 vars in 1142 bytes} [Thu Sep 23 02:55:59 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:55:59.203087 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a7702-55c6-4a6b-ab33-f59184302db5 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:59.215039 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a7702-55c6-4a6b-ab33-f59184302db5 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:59.220140 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86037576-0691-47f9-b531-4e2ce50af278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:59.220887 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86037576-0691-47f9-b531-4e2ce50af278 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:59.221286 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86037576-0691-47f9-b531-4e2ce50af278 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:59.221566 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86037576-0691-47f9-b531-4e2ce50af278 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:59.222299 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86037576-0691-47f9-b531-4e2ce50af278 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:59.222604 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86037576-0691-47f9-b531-4e2ce50af278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:59.224168 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86037576-0691-47f9-b531-4e2ce50af278 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:59.232381 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 477/955] 10.222.0.23 () {60 vars in 1154 bytes} [Thu Sep 23 02:55:59 2021] POST /identity/v3/users => generated 285 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 02:55:59.237417 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 479/956] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Sep 23 02:55:59 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:55:59.240651 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694708a-ed75-4e86-a04a-21984156986b admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:59.251226 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694708a-ed75-4e86-a04a-21984156986b admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:59.256338 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7de08-4636-4fe3-a752-193782f5d880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:59.257214 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7de08-4636-4fe3-a752-193782f5d880 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:59.257498 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7de08-4636-4fe3-a752-193782f5d880 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:59.257775 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7de08-4636-4fe3-a752-193782f5d880 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:59.269958 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b7de08-4636-4fe3-a752-193782f5d880 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:59.272446 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b7de08-4636-4fe3-a752-193782f5d880 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:59.289878 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-09b7de08-4636-4fe3-a752-193782f5d880 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:59.291150 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 478/957] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:59.298440 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86037576-0691-47f9-b531-4e2ce50af278 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:59.308636 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86037576-0691-47f9-b531-4e2ce50af278 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:59.313400 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5a745-2421-4f85-a900-10fd13702b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:59.314107 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5a745-2421-4f85-a900-10fd13702b5b admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:59.314394 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5a745-2421-4f85-a900-10fd13702b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:59.314672 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5a745-2421-4f85-a900-10fd13702b5b admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:59.315416 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5a745-2421-4f85-a900-10fd13702b5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:59.315729 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5a745-2421-4f85-a900-10fd13702b5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:59.317406 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5a745-2421-4f85-a900-10fd13702b5b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:59.329959 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 480/958] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:59.336184 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7de08-4636-4fe3-a752-193782f5d880 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:59.346711 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7de08-4636-4fe3-a752-193782f5d880 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:59.351351 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80046078-4a29-40b6-b56c-b18dc323f443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:59.352240 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80046078-4a29-40b6-b56c-b18dc323f443 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:59.352557 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80046078-4a29-40b6-b56c-b18dc323f443 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:59.352895 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80046078-4a29-40b6-b56c-b18dc323f443 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:59.361611 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80046078-4a29-40b6-b56c-b18dc323f443 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:59.363625 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80046078-4a29-40b6-b56c-b18dc323f443 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:59.377569 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-80046078-4a29-40b6-b56c-b18dc323f443 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 02:55:59.378827 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 479/959] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Sep 23 02:55:59 2021] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:59.385339 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5a745-2421-4f85-a900-10fd13702b5b admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:59.395992 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5a745-2421-4f85-a900-10fd13702b5b admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:59.402041 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22069bd-8d3c-4614-adc0-bb4363b1d77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:59.402739 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22069bd-8d3c-4614-adc0-bb4363b1d77a admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:59.403063 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22069bd-8d3c-4614-adc0-bb4363b1d77a admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:59.403843 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22069bd-8d3c-4614-adc0-bb4363b1d77a admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:59.404709 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22069bd-8d3c-4614-adc0-bb4363b1d77a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:59.405012 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22069bd-8d3c-4614-adc0-bb4363b1d77a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:59.406851 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22069bd-8d3c-4614-adc0-bb4363b1d77a admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:59.424869 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 481/960] 10.222.0.23 () {56 vars in 1155 bytes} [Thu Sep 23 02:55:59 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:59.431434 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80046078-4a29-40b6-b56c-b18dc323f443 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:59.445233 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80046078-4a29-40b6-b56c-b18dc323f443 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:59.450068 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d8d29-cf82-411f-ad69-b6db82abd33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:59.451062 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d8d29-cf82-411f-ad69-b6db82abd33a admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:59.451342 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d8d29-cf82-411f-ad69-b6db82abd33a admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:59.451623 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d8d29-cf82-411f-ad69-b6db82abd33a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:59.468570 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d8d29-cf82-411f-ad69-b6db82abd33a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:59.470421 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d8d29-cf82-411f-ad69-b6db82abd33a admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:59.487090 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-440d8d29-cf82-411f-ad69-b6db82abd33a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:55:59.488288 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 480/961] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:55:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:59.494598 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22069bd-8d3c-4614-adc0-bb4363b1d77a admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:59.505736 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22069bd-8d3c-4614-adc0-bb4363b1d77a admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:59.513173 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2541a-8d9d-4987-a0d7-b45215874016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:59.513843 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2541a-8d9d-4987-a0d7-b45215874016 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:59.514130 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2541a-8d9d-4987-a0d7-b45215874016 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:59.514410 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2541a-8d9d-4987-a0d7-b45215874016 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:59.515138 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2541a-8d9d-4987-a0d7-b45215874016 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:59.515450 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2541a-8d9d-4987-a0d7-b45215874016 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:59.517077 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2541a-8d9d-4987-a0d7-b45215874016 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:59.528899 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 482/962] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:55:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:59.535052 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d8d29-cf82-411f-ad69-b6db82abd33a admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:59.544768 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d8d29-cf82-411f-ad69-b6db82abd33a admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:59.549198 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4fab5-941a-49f4-b279-25b66e6bf3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:59.549972 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4fab5-941a-49f4-b279-25b66e6bf3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:59.550253 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4fab5-941a-49f4-b279-25b66e6bf3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:59.550525 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4fab5-941a-49f4-b279-25b66e6bf3c2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:59.557175 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4fab5-941a-49f4-b279-25b66e6bf3c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:59.559133 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4fab5-941a-49f4-b279-25b66e6bf3c2 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:59.572218 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-c6d4fab5-941a-49f4-b279-25b66e6bf3c2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:55:59.573414 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 481/963] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:55:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:55:59.580420 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2541a-8d9d-4987-a0d7-b45215874016 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:59.590287 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2541a-8d9d-4987-a0d7-b45215874016 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:59.595479 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7da3f-54f0-40e1-920b-71c4c2deed56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:59.596207 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7da3f-54f0-40e1-920b-71c4c2deed56 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:59.596618 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7da3f-54f0-40e1-920b-71c4c2deed56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:59.596967 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7da3f-54f0-40e1-920b-71c4c2deed56 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:59.597823 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f7da3f-54f0-40e1-920b-71c4c2deed56 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:55:59.598140 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f7da3f-54f0-40e1-920b-71c4c2deed56 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:59.599976 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f7da3f-54f0-40e1-920b-71c4c2deed56 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:59.612183 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 483/964] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:55:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:55:59.618388 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4fab5-941a-49f4-b279-25b66e6bf3c2 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:55:59.628408 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4fab5-941a-49f4-b279-25b66e6bf3c2 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:55:59.632930 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b7563-6b33-463f-ad83-9bc46b6c3aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:55:59.633815 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b7563-6b33-463f-ad83-9bc46b6c3aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:55:59.634094 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b7563-6b33-463f-ad83-9bc46b6c3aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:55:59.634369 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b7563-6b33-463f-ad83-9bc46b6c3aa0 admin admin] PATH_INFO: `/v3/projects/73dcb70ac3714a428a717707e6be8201/users/83aa47f723434143b22aac1b96b6a610/roles/315578ac69fb46e3abcddcd340bbd0a7` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:55:59.636844 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b7563-6b33-463f-ad83-9bc46b6c3aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73dcb70ac3714a428a717707e6be8201, user_id=83aa47f723434143b22aac1b96b6a610, role_id=315578ac69fb46e3abcddcd340bbd0a7)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:55:59.639954 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b7563-6b33-463f-ad83-9bc46b6c3aa0 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:55:59.706430 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 482/965] 10.222.0.23 () {58 vars in 1461 bytes} [Thu Sep 23 02:55:59 2021] PUT /identity/v3/projects/73dcb70ac3714a428a717707e6be8201/users/83aa47f723434143b22aac1b96b6a610/roles/315578ac69fb46e3abcddcd340bbd0a7 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 02:56:01.484749 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eebff4-4b90-4f56-9569-6a1687112923 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:01.485283 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eebff4-4b90-4f56-9569-6a1687112923 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:01.485283 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eebff4-4b90-4f56-9569-6a1687112923 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:01.487084 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 484/966] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:56:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:56:01.494361 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230783c-fdfe-463b-8bd3-db3f6bf62e38 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:01.494809 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230783c-fdfe-463b-8bd3-db3f6bf62e38 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:01.495035 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230783c-fdfe-463b-8bd3-db3f6bf62e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:01.513769 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-1230783c-fdfe-463b-8bd3-db3f6bf62e38 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:56:01.515076 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-1230783c-fdfe-463b-8bd3-db3f6bf62e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:56:01.569905 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 483/967] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:56:01 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:56:01.594979 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eebff4-4b90-4f56-9569-6a1687112923 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:01.607577 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eebff4-4b90-4f56-9569-6a1687112923 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:01.611949 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b5e9c-bf1c-454a-8fc5-aa9bc12be872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:01.612757 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b5e9c-bf1c-454a-8fc5-aa9bc12be872 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:01.613034 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b5e9c-bf1c-454a-8fc5-aa9bc12be872 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:01.613302 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b5e9c-bf1c-454a-8fc5-aa9bc12be872 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:01.623342 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b5e9c-bf1c-454a-8fc5-aa9bc12be872 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:56:01.629991 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-199b5e9c-bf1c-454a-8fc5-aa9bc12be872 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:56:01.631150 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 485/968] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:56:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:56:01.638538 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230783c-fdfe-463b-8bd3-db3f6bf62e38 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:01.647258 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230783c-fdfe-463b-8bd3-db3f6bf62e38 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:01.651721 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3aa264-59ea-4ccf-8830-1a0616f3a0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:01.652379 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3aa264-59ea-4ccf-8830-1a0616f3a0dc admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:01.652771 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3aa264-59ea-4ccf-8830-1a0616f3a0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:01.653046 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3aa264-59ea-4ccf-8830-1a0616f3a0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:01.653784 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3aa264-59ea-4ccf-8830-1a0616f3a0dc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:56:01.654086 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3aa264-59ea-4ccf-8830-1a0616f3a0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:01.655644 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3aa264-59ea-4ccf-8830-1a0616f3a0dc admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:01.668691 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 484/969] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:56:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:01.670427 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b5e9c-bf1c-454a-8fc5-aa9bc12be872 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:01.680267 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b5e9c-bf1c-454a-8fc5-aa9bc12be872 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:01.684775 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42a26b-f403-44df-a14a-37a34e3dea05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:01.685616 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42a26b-f403-44df-a14a-37a34e3dea05 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:01.685955 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42a26b-f403-44df-a14a-37a34e3dea05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:01.686232 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42a26b-f403-44df-a14a-37a34e3dea05 admin admin] PATH_INFO: `/v3/users/9d5afac4a209495ead61325db16dbdfe` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:01.698936 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42a26b-f403-44df-a14a-37a34e3dea05 admin admin] RBAC: Authorizing `identity:get_user(user_id=9d5afac4a209495ead61325db16dbdfe)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:01.701591 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42a26b-f403-44df-a14a-37a34e3dea05 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:01.703206 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 486/970] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:56:01 2021] GET /identity/v3/users/9d5afac4a209495ead61325db16dbdfe => generated 285 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:01.709467 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3aa264-59ea-4ccf-8830-1a0616f3a0dc admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:01.719172 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3aa264-59ea-4ccf-8830-1a0616f3a0dc admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:01.723694 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa60eb-4b10-41c8-90fd-31b73c7907cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:01.724330 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa60eb-4b10-41c8-90fd-31b73c7907cd admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:01.724634 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa60eb-4b10-41c8-90fd-31b73c7907cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:01.724910 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa60eb-4b10-41c8-90fd-31b73c7907cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:01.732918 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa60eb-4b10-41c8-90fd-31b73c7907cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:01.734633 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa60eb-4b10-41c8-90fd-31b73c7907cd admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:01.748517 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 485/971] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:56:01 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:56:01.749643 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42a26b-f403-44df-a14a-37a34e3dea05 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:01.759096 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42a26b-f403-44df-a14a-37a34e3dea05 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:01.764536 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb1f98-bbc2-4584-a220-d5a2445da329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:01.765425 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb1f98-bbc2-4584-a220-d5a2445da329 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:01.765701 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb1f98-bbc2-4584-a220-d5a2445da329 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:01.765969 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb1f98-bbc2-4584-a220-d5a2445da329 admin admin] PATH_INFO: `/v3/projects/b14ee5a594124946b89ac1b6a329702f` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:01.767216 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb1f98-bbc2-4584-a220-d5a2445da329 admin admin] RBAC: Authorizing `identity:get_project(project_id=b14ee5a594124946b89ac1b6a329702f)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:01.769333 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb1f98-bbc2-4584-a220-d5a2445da329 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:01.771134 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 487/972] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:56:01 2021] GET /identity/v3/projects/b14ee5a594124946b89ac1b6a329702f => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:01.778857 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa60eb-4b10-41c8-90fd-31b73c7907cd admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:01.789964 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa60eb-4b10-41c8-90fd-31b73c7907cd admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:01.794787 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd7a82-f081-49ae-9222-014c2294c08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:01.795465 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd7a82-f081-49ae-9222-014c2294c08e admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:01.795746 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd7a82-f081-49ae-9222-014c2294c08e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:01.796019 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd7a82-f081-49ae-9222-014c2294c08e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:01.796913 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd7a82-f081-49ae-9222-014c2294c08e admin admin] RBAC: Adding query filter params (role.id=3e7d7427203a4a4097e2c9a642b9bf69, scope.project.id=b14ee5a594124946b89ac1b6a329702f, user.id=9d5afac4a209495ead61325db16dbdfe) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:56:01.797224 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd7a82-f081-49ae-9222-014c2294c08e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:01.799140 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd7a82-f081-49ae-9222-014c2294c08e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:01.816840 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 486/973] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:56:01 2021] GET /identity/v3/role_assignments?user.id=9d5afac4a209495ead61325db16dbdfe&scope.project.id=b14ee5a594124946b89ac1b6a329702f&role.id=3e7d7427203a4a4097e2c9a642b9bf69 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:01.866739 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239ee4f-7c44-40c3-b8be-30b7669bfb92 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:01.867024 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239ee4f-7c44-40c3-b8be-30b7669bfb92 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:01.867310 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239ee4f-7c44-40c3-b8be-30b7669bfb92 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:01.869179 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 488/974] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:56:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:56:01.877446 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c2120-f2f7-4d66-8e1d-ac2333643d38 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:01.877738 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c2120-f2f7-4d66-8e1d-ac2333643d38 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:01.878027 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c2120-f2f7-4d66-8e1d-ac2333643d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:01.897096 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-4f8c2120-f2f7-4d66-8e1d-ac2333643d38 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:56:01.898331 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-4f8c2120-f2f7-4d66-8e1d-ac2333643d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:56:01.906816 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 487/975] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:56:01 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:56:01.932104 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239ee4f-7c44-40c3-b8be-30b7669bfb92 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:01.944706 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239ee4f-7c44-40c3-b8be-30b7669bfb92 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:01.949229 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429b0b7-d04f-4f82-a18a-51e46d7116a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:01.950570 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429b0b7-d04f-4f82-a18a-51e46d7116a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:01.950848 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429b0b7-d04f-4f82-a18a-51e46d7116a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:01.951119 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429b0b7-d04f-4f82-a18a-51e46d7116a3 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:01.962272 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429b0b7-d04f-4f82-a18a-51e46d7116a3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:56:01.970053 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-4429b0b7-d04f-4f82-a18a-51e46d7116a3 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 02:56:01.971267 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 489/976] 10.222.0.23 () {56 vars in 1142 bytes} [Thu Sep 23 02:56:01 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:56:01.978008 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c2120-f2f7-4d66-8e1d-ac2333643d38 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:01.987481 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c2120-f2f7-4d66-8e1d-ac2333643d38 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:01.992181 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2713c-c48b-4d75-ab4b-cc8714f0ecad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:01.992899 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2713c-c48b-4d75-ab4b-cc8714f0ecad admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:01.993181 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2713c-c48b-4d75-ab4b-cc8714f0ecad admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:01.993455 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2713c-c48b-4d75-ab4b-cc8714f0ecad admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:01.994201 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2713c-c48b-4d75-ab4b-cc8714f0ecad admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:56:01.994506 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2713c-c48b-4d75-ab4b-cc8714f0ecad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:01.996090 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2713c-c48b-4d75-ab4b-cc8714f0ecad admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:02.004838 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 488/977] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Sep 23 02:56:01 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:56:02.011004 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429b0b7-d04f-4f82-a18a-51e46d7116a3 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:02.021769 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429b0b7-d04f-4f82-a18a-51e46d7116a3 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:02.026275 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cf8d4-8b27-4dad-85db-f7b185a709eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:02.027050 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cf8d4-8b27-4dad-85db-f7b185a709eb admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:02.027333 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cf8d4-8b27-4dad-85db-f7b185a709eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:02.028220 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cf8d4-8b27-4dad-85db-f7b185a709eb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:02.038206 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283cf8d4-8b27-4dad-85db-f7b185a709eb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:02.040033 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283cf8d4-8b27-4dad-85db-f7b185a709eb admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:02.057001 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-283cf8d4-8b27-4dad-85db-f7b185a709eb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:56:02.058174 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 490/978] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:56:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:56:02.064647 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2713c-c48b-4d75-ab4b-cc8714f0ecad admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:02.074404 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2713c-c48b-4d75-ab4b-cc8714f0ecad admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:02.078941 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376022f1-881d-42ba-af44-d2f7dada9cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:02.079597 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376022f1-881d-42ba-af44-d2f7dada9cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:02.079881 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376022f1-881d-42ba-af44-d2f7dada9cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:02.080142 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376022f1-881d-42ba-af44-d2f7dada9cc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:02.080887 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376022f1-881d-42ba-af44-d2f7dada9cc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:56:02.081191 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376022f1-881d-42ba-af44-d2f7dada9cc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:02.082766 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376022f1-881d-42ba-af44-d2f7dada9cc2 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:02.094758 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 489/979] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:56:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:02.101129 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cf8d4-8b27-4dad-85db-f7b185a709eb admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:02.111409 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cf8d4-8b27-4dad-85db-f7b185a709eb admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:02.116024 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59467dce-0b79-45d3-a4d0-9ba9cd0c53b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:02.116859 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59467dce-0b79-45d3-a4d0-9ba9cd0c53b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:02.117144 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59467dce-0b79-45d3-a4d0-9ba9cd0c53b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:02.117419 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59467dce-0b79-45d3-a4d0-9ba9cd0c53b6 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:02.124938 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59467dce-0b79-45d3-a4d0-9ba9cd0c53b6 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:02.127009 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59467dce-0b79-45d3-a4d0-9ba9cd0c53b6 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:02.141615 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-59467dce-0b79-45d3-a4d0-9ba9cd0c53b6 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 02:56:02.142768 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 491/980] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Sep 23 02:56:02 2021] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:56:02.149410 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376022f1-881d-42ba-af44-d2f7dada9cc2 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:02.159447 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376022f1-881d-42ba-af44-d2f7dada9cc2 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:02.163989 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8e2cf-faa1-4f7d-ab29-95a052c96bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:02.164680 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8e2cf-faa1-4f7d-ab29-95a052c96bce admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:02.164960 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8e2cf-faa1-4f7d-ab29-95a052c96bce admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:02.165236 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8e2cf-faa1-4f7d-ab29-95a052c96bce admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:02.166059 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8e2cf-faa1-4f7d-ab29-95a052c96bce admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:56:02.166364 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8e2cf-faa1-4f7d-ab29-95a052c96bce admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:02.168271 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8e2cf-faa1-4f7d-ab29-95a052c96bce admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:02.185492 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 490/981] 10.222.0.23 () {56 vars in 1155 bytes} [Thu Sep 23 02:56:02 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:02.192078 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59467dce-0b79-45d3-a4d0-9ba9cd0c53b6 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:02.202437 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59467dce-0b79-45d3-a4d0-9ba9cd0c53b6 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:02.206981 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cced9f-8fb4-4d58-8609-7cd02bf7b822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:02.207620 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cced9f-8fb4-4d58-8609-7cd02bf7b822 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:02.207904 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cced9f-8fb4-4d58-8609-7cd02bf7b822 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:02.208182 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cced9f-8fb4-4d58-8609-7cd02bf7b822 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:02.215884 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cced9f-8fb4-4d58-8609-7cd02bf7b822 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:02.217659 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cced9f-8fb4-4d58-8609-7cd02bf7b822 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:02.226309 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 492/982] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:56:02 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 02:56:02.232756 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8e2cf-faa1-4f7d-ab29-95a052c96bce admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:02.242359 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8e2cf-faa1-4f7d-ab29-95a052c96bce admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:02.247307 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5beff7-f6a6-49e1-9044-deae5c617f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:02.248108 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5beff7-f6a6-49e1-9044-deae5c617f95 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:02.248388 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5beff7-f6a6-49e1-9044-deae5c617f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:02.248728 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5beff7-f6a6-49e1-9044-deae5c617f95 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:02.258836 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5beff7-f6a6-49e1-9044-deae5c617f95 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:02.260659 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5beff7-f6a6-49e1-9044-deae5c617f95 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:02.277538 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-3e5beff7-f6a6-49e1-9044-deae5c617f95 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:56:02.278671 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 491/983] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:56:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:56:02.284921 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cced9f-8fb4-4d58-8609-7cd02bf7b822 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:02.293742 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cced9f-8fb4-4d58-8609-7cd02bf7b822 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:02.298316 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d02484-12ba-4421-bbc0-17d77364f7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:02.298963 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d02484-12ba-4421-bbc0-17d77364f7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:02.300006 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d02484-12ba-4421-bbc0-17d77364f7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:02.300006 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d02484-12ba-4421-bbc0-17d77364f7f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:02.300373 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d02484-12ba-4421-bbc0-17d77364f7f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:56:02.300683 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d02484-12ba-4421-bbc0-17d77364f7f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:02.302238 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d02484-12ba-4421-bbc0-17d77364f7f4 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:02.319441 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 493/984] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:56:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:56:02.320556 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5beff7-f6a6-49e1-9044-deae5c617f95 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:02.330709 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5beff7-f6a6-49e1-9044-deae5c617f95 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:02.335412 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb6284-df6c-4fa3-84f5-a985f57dcf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:02.336192 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb6284-df6c-4fa3-84f5-a985f57dcf6e admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:02.336477 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb6284-df6c-4fa3-84f5-a985f57dcf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:02.336787 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb6284-df6c-4fa3-84f5-a985f57dcf6e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:02.343719 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb6284-df6c-4fa3-84f5-a985f57dcf6e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:02.345861 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb6284-df6c-4fa3-84f5-a985f57dcf6e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:02.358880 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-cebb6284-df6c-4fa3-84f5-a985f57dcf6e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:56:02.360026 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 492/985] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:56:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:56:02.366491 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d02484-12ba-4421-bbc0-17d77364f7f4 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:02.376682 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d02484-12ba-4421-bbc0-17d77364f7f4 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:02.381270 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3b627-408a-48b8-ae7b-c0bd5350606f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:02.381915 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3b627-408a-48b8-ae7b-c0bd5350606f admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:02.382194 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3b627-408a-48b8-ae7b-c0bd5350606f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:02.382466 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3b627-408a-48b8-ae7b-c0bd5350606f admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:02.383427 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3b627-408a-48b8-ae7b-c0bd5350606f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:56:02.383739 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3b627-408a-48b8-ae7b-c0bd5350606f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:02.385576 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3b627-408a-48b8-ae7b-c0bd5350606f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:02.397852 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 494/986] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:56:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:02.404463 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb6284-df6c-4fa3-84f5-a985f57dcf6e admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:02.414644 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb6284-df6c-4fa3-84f5-a985f57dcf6e admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:02.419753 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cc94a-48e1-4a06-82a9-85b4bb3ad021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:02.420387 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cc94a-48e1-4a06-82a9-85b4bb3ad021 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:02.420700 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cc94a-48e1-4a06-82a9-85b4bb3ad021 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:02.420978 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cc94a-48e1-4a06-82a9-85b4bb3ad021 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:02.421805 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2cc94a-48e1-4a06-82a9-85b4bb3ad021 admin admin] RBAC: Adding query filter params (role.id=315578ac69fb46e3abcddcd340bbd0a7, scope.project.id=73dcb70ac3714a428a717707e6be8201, user.id=83aa47f723434143b22aac1b96b6a610) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:56:02.422147 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2cc94a-48e1-4a06-82a9-85b4bb3ad021 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:02.423992 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2cc94a-48e1-4a06-82a9-85b4bb3ad021 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:02.429867 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 493/987] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:56:02 2021] GET /identity/v3/role_assignments?user.id=83aa47f723434143b22aac1b96b6a610&scope.project.id=73dcb70ac3714a428a717707e6be8201&role.id=315578ac69fb46e3abcddcd340bbd0a7 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:03.949126 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b3e33-2730-4577-b10c-4a357df67267 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:03.949644 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b3e33-2730-4577-b10c-4a357df67267 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:03.949838 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b3e33-2730-4577-b10c-4a357df67267 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:03.951497 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 495/988] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:56:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:56:03.958554 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609522d9-8741-4204-9cb3-38797cdaa3cc None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:03.958931 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609522d9-8741-4204-9cb3-38797cdaa3cc None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:03.959110 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609522d9-8741-4204-9cb3-38797cdaa3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:03.976179 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-609522d9-8741-4204-9cb3-38797cdaa3cc None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:56:03.977394 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-609522d9-8741-4204-9cb3-38797cdaa3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:56:03.985539 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 494/989] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:56:03 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:56:04.008696 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b3e33-2730-4577-b10c-4a357df67267 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:04.021611 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b3e33-2730-4577-b10c-4a357df67267 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:04.025965 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27849a47-70df-49e0-926e-fa6f73b2240d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:04.026746 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27849a47-70df-49e0-926e-fa6f73b2240d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:04.027029 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27849a47-70df-49e0-926e-fa6f73b2240d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:04.027306 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27849a47-70df-49e0-926e-fa6f73b2240d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:04.037933 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27849a47-70df-49e0-926e-fa6f73b2240d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:56:04.044633 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-27849a47-70df-49e0-926e-fa6f73b2240d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:56:04.045762 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 496/990] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:56:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:56:04.052145 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609522d9-8741-4204-9cb3-38797cdaa3cc None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:04.060941 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609522d9-8741-4204-9cb3-38797cdaa3cc None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:04.065484 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9ac72-c7ff-4beb-9a62-39c7b00051c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:04.066140 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9ac72-c7ff-4beb-9a62-39c7b00051c5 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:04.066662 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9ac72-c7ff-4beb-9a62-39c7b00051c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:04.066662 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9ac72-c7ff-4beb-9a62-39c7b00051c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:04.067419 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9ac72-c7ff-4beb-9a62-39c7b00051c5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:56:04.067726 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9ac72-c7ff-4beb-9a62-39c7b00051c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:04.069343 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9ac72-c7ff-4beb-9a62-39c7b00051c5 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:04.077984 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 495/991] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:56:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:04.084236 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27849a47-70df-49e0-926e-fa6f73b2240d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:04.094910 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27849a47-70df-49e0-926e-fa6f73b2240d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:04.099421 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b2a9c-2197-499a-888d-ce52d221d83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:04.100266 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b2a9c-2197-499a-888d-ce52d221d83e admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:04.100699 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b2a9c-2197-499a-888d-ce52d221d83e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:04.100983 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b2a9c-2197-499a-888d-ce52d221d83e admin admin] PATH_INFO: `/v3/users/9d5afac4a209495ead61325db16dbdfe` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:04.102178 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b2a9c-2197-499a-888d-ce52d221d83e admin admin] RBAC: Authorizing `identity:get_user(user_id=9d5afac4a209495ead61325db16dbdfe)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:04.104280 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b2a9c-2197-499a-888d-ce52d221d83e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:04.105885 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 497/992] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:56:04 2021] GET /identity/v3/users/9d5afac4a209495ead61325db16dbdfe => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:04.111735 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9ac72-c7ff-4beb-9a62-39c7b00051c5 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:04.121096 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9ac72-c7ff-4beb-9a62-39c7b00051c5 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:04.125598 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d5616-3fe1-4bc8-ab66-1d91850abdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:04.126442 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d5616-3fe1-4bc8-ab66-1d91850abdb1 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:04.126726 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d5616-3fe1-4bc8-ab66-1d91850abdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:04.127004 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d5616-3fe1-4bc8-ab66-1d91850abdb1 admin admin] PATH_INFO: `/v3/projects/b14ee5a594124946b89ac1b6a329702f` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:04.128159 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d5616-3fe1-4bc8-ab66-1d91850abdb1 admin admin] RBAC: Authorizing `identity:get_project(project_id=b14ee5a594124946b89ac1b6a329702f)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:04.130218 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d5616-3fe1-4bc8-ab66-1d91850abdb1 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:04.131829 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 496/993] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:56:04 2021] GET /identity/v3/projects/b14ee5a594124946b89ac1b6a329702f => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:04.138669 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b2a9c-2197-499a-888d-ce52d221d83e admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:04.148124 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b2a9c-2197-499a-888d-ce52d221d83e admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:04.153187 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465defd-8187-41ba-818c-811f1ce2e61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:04.154037 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465defd-8187-41ba-818c-811f1ce2e61d admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:04.154323 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465defd-8187-41ba-818c-811f1ce2e61d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:04.154603 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465defd-8187-41ba-818c-811f1ce2e61d admin admin] PATH_INFO: `/v3/projects/b14ee5a594124946b89ac1b6a329702f/users/9d5afac4a209495ead61325db16dbdfe/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:04.156576 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465defd-8187-41ba-818c-811f1ce2e61d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b14ee5a594124946b89ac1b6a329702f, user_id=9d5afac4a209495ead61325db16dbdfe, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:04.159191 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465defd-8187-41ba-818c-811f1ce2e61d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:04.259815 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 498/994] 10.222.0.23 () {58 vars in 1461 bytes} [Thu Sep 23 02:56:04 2021] PUT /identity/v3/projects/b14ee5a594124946b89ac1b6a329702f/users/9d5afac4a209495ead61325db16dbdfe/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 02:56:06.388236 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada08398-2755-4887-8d11-6f9ff13412a6 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:06.388846 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada08398-2755-4887-8d11-6f9ff13412a6 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:06.388846 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada08398-2755-4887-8d11-6f9ff13412a6 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:06.390547 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 497/995] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:56:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:56:06.397926 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe8bcd-2912-469b-ad35-66d70851ccd1 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:06.398377 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe8bcd-2912-469b-ad35-66d70851ccd1 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:06.398470 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe8bcd-2912-469b-ad35-66d70851ccd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:06.416116 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-e4fe8bcd-2912-469b-ad35-66d70851ccd1 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:56:06.417341 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-e4fe8bcd-2912-469b-ad35-66d70851ccd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:56:06.471463 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 499/996] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:56:06 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:56:06.495631 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada08398-2755-4887-8d11-6f9ff13412a6 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:06.508836 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada08398-2755-4887-8d11-6f9ff13412a6 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:06.513972 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9c98a-e715-458e-afa6-801f1df4c597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:06.514756 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9c98a-e715-458e-afa6-801f1df4c597 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:06.515036 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9c98a-e715-458e-afa6-801f1df4c597 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:06.515310 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9c98a-e715-458e-afa6-801f1df4c597 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:06.525118 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9c98a-e715-458e-afa6-801f1df4c597 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:56:06.531711 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-d5a9c98a-e715-458e-afa6-801f1df4c597 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:56:06.532877 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 498/997] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:56:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:56:06.539405 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe8bcd-2912-469b-ad35-66d70851ccd1 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:06.548181 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe8bcd-2912-469b-ad35-66d70851ccd1 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:06.552734 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51ea5c-daea-4a1e-847e-05aab3a3c9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:06.553394 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51ea5c-daea-4a1e-847e-05aab3a3c9be admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:06.553675 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51ea5c-daea-4a1e-847e-05aab3a3c9be admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:06.553949 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51ea5c-daea-4a1e-847e-05aab3a3c9be admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:06.554694 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51ea5c-daea-4a1e-847e-05aab3a3c9be admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:56:06.554999 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51ea5c-daea-4a1e-847e-05aab3a3c9be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:06.556606 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51ea5c-daea-4a1e-847e-05aab3a3c9be admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:06.565150 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 500/998] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:56:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:06.571198 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9c98a-e715-458e-afa6-801f1df4c597 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:06.581728 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9c98a-e715-458e-afa6-801f1df4c597 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:06.588691 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92a183-1a34-44ce-b1e3-4391424b256c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:06.589534 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92a183-1a34-44ce-b1e3-4391424b256c admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:06.589843 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92a183-1a34-44ce-b1e3-4391424b256c admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:06.590092 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92a183-1a34-44ce-b1e3-4391424b256c admin admin] PATH_INFO: `/v3/users/9d5afac4a209495ead61325db16dbdfe` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:06.591279 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92a183-1a34-44ce-b1e3-4391424b256c admin admin] RBAC: Authorizing `identity:get_user(user_id=9d5afac4a209495ead61325db16dbdfe)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:06.593428 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92a183-1a34-44ce-b1e3-4391424b256c admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:06.595135 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 499/999] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:56:06 2021] GET /identity/v3/users/9d5afac4a209495ead61325db16dbdfe => generated 285 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:06.600902 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51ea5c-daea-4a1e-847e-05aab3a3c9be admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:06.610285 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51ea5c-daea-4a1e-847e-05aab3a3c9be admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:06.614816 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bb747-f586-4e97-8b97-343514119efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:06.615441 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bb747-f586-4e97-8b97-343514119efc admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:06.615724 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bb747-f586-4e97-8b97-343514119efc admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:06.616000 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bb747-f586-4e97-8b97-343514119efc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:06.624054 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7bb747-f586-4e97-8b97-343514119efc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:06.625800 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7bb747-f586-4e97-8b97-343514119efc admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:06.634383 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 501/1000] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:56:06 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:56:06.641329 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92a183-1a34-44ce-b1e3-4391424b256c admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:06.650519 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92a183-1a34-44ce-b1e3-4391424b256c admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:06.655071 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac356b5-643d-4664-9f59-94525b5eeda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:06.655886 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac356b5-643d-4664-9f59-94525b5eeda7 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:06.656164 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac356b5-643d-4664-9f59-94525b5eeda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:06.656436 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac356b5-643d-4664-9f59-94525b5eeda7 admin admin] PATH_INFO: `/v3/projects/b14ee5a594124946b89ac1b6a329702f` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:06.657616 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac356b5-643d-4664-9f59-94525b5eeda7 admin admin] RBAC: Authorizing `identity:get_project(project_id=b14ee5a594124946b89ac1b6a329702f)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:06.659611 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac356b5-643d-4664-9f59-94525b5eeda7 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:06.661241 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 500/1001] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:56:06 2021] GET /identity/v3/projects/b14ee5a594124946b89ac1b6a329702f => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:56:06.667281 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bb747-f586-4e97-8b97-343514119efc admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:06.675848 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bb747-f586-4e97-8b97-343514119efc admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:06.680341 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208772f-2a52-4eef-9202-61c1a71a99ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:06.680996 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208772f-2a52-4eef-9202-61c1a71a99ec admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:06.681283 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208772f-2a52-4eef-9202-61c1a71a99ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:06.681562 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208772f-2a52-4eef-9202-61c1a71a99ec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:06.682375 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7208772f-2a52-4eef-9202-61c1a71a99ec admin admin] RBAC: Adding query filter params (role.id=3e7d7427203a4a4097e2c9a642b9bf69, scope.project.id=b14ee5a594124946b89ac1b6a329702f, user.id=9d5afac4a209495ead61325db16dbdfe) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:56:06.682685 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7208772f-2a52-4eef-9202-61c1a71a99ec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:06.685013 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7208772f-2a52-4eef-9202-61c1a71a99ec admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:06.690548 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 502/1002] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:56:06 2021] GET /identity/v3/role_assignments?user.id=9d5afac4a209495ead61325db16dbdfe&scope.project.id=b14ee5a594124946b89ac1b6a329702f&role.id=3e7d7427203a4a4097e2c9a642b9bf69 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:08.890655 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce486746-71c9-40d3-a1fc-325f35a926e5 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:08.891171 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce486746-71c9-40d3-a1fc-325f35a926e5 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:08.891256 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce486746-71c9-40d3-a1fc-325f35a926e5 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:08.893084 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 501/1003] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:56:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:56:08.900185 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f2be5-2a2e-4e70-8c63-553e8abd8291 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:08.900590 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f2be5-2a2e-4e70-8c63-553e8abd8291 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:08.900789 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f2be5-2a2e-4e70-8c63-553e8abd8291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:08.918083 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-cb0f2be5-2a2e-4e70-8c63-553e8abd8291 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:56:08.919275 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-cb0f2be5-2a2e-4e70-8c63-553e8abd8291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:56:08.926939 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 503/1004] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:56:08 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:56:08.952735 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce486746-71c9-40d3-a1fc-325f35a926e5 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:08.965677 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce486746-71c9-40d3-a1fc-325f35a926e5 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:08.970022 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecba26-5527-4fd1-9c59-eb1849df87fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:08.970797 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecba26-5527-4fd1-9c59-eb1849df87fc admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:08.971078 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecba26-5527-4fd1-9c59-eb1849df87fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:08.971353 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecba26-5527-4fd1-9c59-eb1849df87fc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:08.972536 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ecba26-5527-4fd1-9c59-eb1849df87fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:08.974255 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ecba26-5527-4fd1-9c59-eb1849df87fc admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:08.975807 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 502/1005] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:56:08 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:08.982230 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f2be5-2a2e-4e70-8c63-553e8abd8291 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:08.991050 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f2be5-2a2e-4e70-8c63-553e8abd8291 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:08.995538 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c7a4d-a826-4d46-8ae6-2e3ae5f15297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:08.996800 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c7a4d-a826-4d46-8ae6-2e3ae5f15297 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:08.997087 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c7a4d-a826-4d46-8ae6-2e3ae5f15297 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:08.997367 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c7a4d-a826-4d46-8ae6-2e3ae5f15297 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:08.998076 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c7a4d-a826-4d46-8ae6-2e3ae5f15297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:08.999959 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c7a4d-a826-4d46-8ae6-2e3ae5f15297 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:09.104551 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 504/1006] 10.222.0.23 () {60 vars in 1154 bytes} [Thu Sep 23 02:56:08 2021] POST /identity/v3/users => generated 286 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 02:56:11.295787 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab06b31-6468-4412-9b1e-330622cd3f0a None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:11.296302 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab06b31-6468-4412-9b1e-330622cd3f0a None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:11.296409 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab06b31-6468-4412-9b1e-330622cd3f0a None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:11.298110 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 503/1007] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:56:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:56:11.305138 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a106c6-4f7b-44ef-a837-7dcfe772f26e None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:11.305554 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a106c6-4f7b-44ef-a837-7dcfe772f26e None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:11.305692 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a106c6-4f7b-44ef-a837-7dcfe772f26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:11.323291 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-75a106c6-4f7b-44ef-a837-7dcfe772f26e None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:56:11.325057 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-75a106c6-4f7b-44ef-a837-7dcfe772f26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:56:11.332574 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 505/1008] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:56:11 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:56:11.357035 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab06b31-6468-4412-9b1e-330622cd3f0a None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:11.368827 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab06b31-6468-4412-9b1e-330622cd3f0a None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:11.373652 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e649e7f-9662-4c89-bde0-b46ff2b2b3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:11.374480 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e649e7f-9662-4c89-bde0-b46ff2b2b3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:11.374758 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e649e7f-9662-4c89-bde0-b46ff2b2b3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:11.375027 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e649e7f-9662-4c89-bde0-b46ff2b2b3b3 admin admin] PATH_INFO: `/v3/roles/1e311eea15274107873f2490f2cbc7b4` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:11.376454 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e649e7f-9662-4c89-bde0-b46ff2b2b3b3 admin admin] RBAC: Authorizing `identity:get_role(role_id=1e311eea15274107873f2490f2cbc7b4)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:11.377483 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING py.warnings [None req-7e649e7f-9662-4c89-bde0-b46ff2b2b3b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:56:11.377483 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: warnings.warn(msg) Sep 23 02:56:11.377483 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: Sep 23 02:56:11.378345 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e649e7f-9662-4c89-bde0-b46ff2b2b3b3 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:11.379621 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 504/1009] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:56:11 2021] GET /identity/v3/roles/1e311eea15274107873f2490f2cbc7b4 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:11.385513 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a106c6-4f7b-44ef-a837-7dcfe772f26e None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:11.394389 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a106c6-4f7b-44ef-a837-7dcfe772f26e None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:11.398919 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67541fff-4eee-431d-9a96-31b0e04a41d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:11.399759 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67541fff-4eee-431d-9a96-31b0e04a41d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:11.400041 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67541fff-4eee-431d-9a96-31b0e04a41d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:11.400320 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67541fff-4eee-431d-9a96-31b0e04a41d1 admin admin] PATH_INFO: `/v3/users/0d59a62f440f40ce80b3f695faca5e99` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:11.413108 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67541fff-4eee-431d-9a96-31b0e04a41d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d59a62f440f40ce80b3f695faca5e99)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:11.415211 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67541fff-4eee-431d-9a96-31b0e04a41d1 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:11.416799 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 506/1010] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:56:11 2021] GET /identity/v3/users/0d59a62f440f40ce80b3f695faca5e99 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:11.423186 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e649e7f-9662-4c89-bde0-b46ff2b2b3b3 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:11.432428 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e649e7f-9662-4c89-bde0-b46ff2b2b3b3 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:11.437448 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d8275-77ed-4c3b-ab18-44855f921aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:11.438065 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d8275-77ed-4c3b-ab18-44855f921aea admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:11.438347 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d8275-77ed-4c3b-ab18-44855f921aea admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:11.438624 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d8275-77ed-4c3b-ab18-44855f921aea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:11.446155 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d8275-77ed-4c3b-ab18-44855f921aea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:11.447852 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d8275-77ed-4c3b-ab18-44855f921aea admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:11.456447 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 505/1011] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:56:11 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 02:56:11.462381 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67541fff-4eee-431d-9a96-31b0e04a41d1 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:11.471521 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67541fff-4eee-431d-9a96-31b0e04a41d1 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:11.475955 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef644f53-3dbe-4d8e-afe9-6a0dec186cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:11.476814 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef644f53-3dbe-4d8e-afe9-6a0dec186cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:11.477096 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef644f53-3dbe-4d8e-afe9-6a0dec186cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:11.477372 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef644f53-3dbe-4d8e-afe9-6a0dec186cd6 admin admin] PATH_INFO: `/v3/projects/b14ee5a594124946b89ac1b6a329702f` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:11.478515 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef644f53-3dbe-4d8e-afe9-6a0dec186cd6 admin admin] RBAC: Authorizing `identity:get_project(project_id=b14ee5a594124946b89ac1b6a329702f)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:11.481042 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef644f53-3dbe-4d8e-afe9-6a0dec186cd6 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:11.482644 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 507/1012] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:56:11 2021] GET /identity/v3/projects/b14ee5a594124946b89ac1b6a329702f => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:11.489066 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d8275-77ed-4c3b-ab18-44855f921aea admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:11.498697 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d8275-77ed-4c3b-ab18-44855f921aea admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:11.505201 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9ac5f-85c7-48d5-a3df-7d2556b1d948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:11.505858 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9ac5f-85c7-48d5-a3df-7d2556b1d948 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:11.506143 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9ac5f-85c7-48d5-a3df-7d2556b1d948 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:11.506421 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9ac5f-85c7-48d5-a3df-7d2556b1d948 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:11.507241 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9ac5f-85c7-48d5-a3df-7d2556b1d948 admin admin] RBAC: Adding query filter params (role.id=1e311eea15274107873f2490f2cbc7b4, scope.project.id=b14ee5a594124946b89ac1b6a329702f, user.id=0d59a62f440f40ce80b3f695faca5e99) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:56:11.507555 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9ac5f-85c7-48d5-a3df-7d2556b1d948 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:11.509426 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9ac5f-85c7-48d5-a3df-7d2556b1d948 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:11.517026 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 506/1013] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:56:11 2021] GET /identity/v3/role_assignments?user.id=0d59a62f440f40ce80b3f695faca5e99&scope.project.id=b14ee5a594124946b89ac1b6a329702f&role.id=1e311eea15274107873f2490f2cbc7b4 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:13.646985 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6b312-8dcc-4e2d-97c6-c5733438b318 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:13.647515 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6b312-8dcc-4e2d-97c6-c5733438b318 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:13.647515 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6b312-8dcc-4e2d-97c6-c5733438b318 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:13.649325 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 508/1014] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:56:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:56:13.656948 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393fa2f-de7e-49f5-baa3-b230d2cf23ae None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:13.657356 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393fa2f-de7e-49f5-baa3-b230d2cf23ae None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:13.657499 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393fa2f-de7e-49f5-baa3-b230d2cf23ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:13.674514 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-c393fa2f-de7e-49f5-baa3-b230d2cf23ae None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:56:13.675698 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-c393fa2f-de7e-49f5-baa3-b230d2cf23ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:56:13.683247 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 507/1015] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:56:13 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:56:13.710564 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6b312-8dcc-4e2d-97c6-c5733438b318 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:13.723082 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6b312-8dcc-4e2d-97c6-c5733438b318 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:13.727383 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b405ba-95c2-4ee4-813f-81096c469c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:13.728215 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b405ba-95c2-4ee4-813f-81096c469c0f admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:13.728515 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b405ba-95c2-4ee4-813f-81096c469c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:13.728779 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b405ba-95c2-4ee4-813f-81096c469c0f admin admin] PATH_INFO: `/v3/roles/1e311eea15274107873f2490f2cbc7b4` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:13.730263 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b405ba-95c2-4ee4-813f-81096c469c0f admin admin] RBAC: Authorizing `identity:get_role(role_id=1e311eea15274107873f2490f2cbc7b4)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:13.731259 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING py.warnings [None req-05b405ba-95c2-4ee4-813f-81096c469c0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:56:13.731259 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: warnings.warn(msg) Sep 23 02:56:13.731259 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: Sep 23 02:56:13.732122 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b405ba-95c2-4ee4-813f-81096c469c0f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:13.733463 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 509/1016] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:56:13 2021] GET /identity/v3/roles/1e311eea15274107873f2490f2cbc7b4 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:13.739576 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393fa2f-de7e-49f5-baa3-b230d2cf23ae None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:13.748426 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393fa2f-de7e-49f5-baa3-b230d2cf23ae None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:13.753064 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672ab12-682e-4077-b933-6361c56f4a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:13.753950 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672ab12-682e-4077-b933-6361c56f4a94 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:13.754236 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672ab12-682e-4077-b933-6361c56f4a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:13.754515 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672ab12-682e-4077-b933-6361c56f4a94 admin admin] PATH_INFO: `/v3/users/0d59a62f440f40ce80b3f695faca5e99` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:13.755684 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672ab12-682e-4077-b933-6361c56f4a94 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d59a62f440f40ce80b3f695faca5e99)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:13.757822 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672ab12-682e-4077-b933-6361c56f4a94 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:13.759389 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 508/1017] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:56:13 2021] GET /identity/v3/users/0d59a62f440f40ce80b3f695faca5e99 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:13.765834 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b405ba-95c2-4ee4-813f-81096c469c0f admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:13.774911 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b405ba-95c2-4ee4-813f-81096c469c0f admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:13.779871 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ac673-df6f-428d-92c8-871c9ecc159e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:13.780697 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ac673-df6f-428d-92c8-871c9ecc159e admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:13.780978 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ac673-df6f-428d-92c8-871c9ecc159e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:13.781247 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ac673-df6f-428d-92c8-871c9ecc159e admin admin] PATH_INFO: `/v3/projects/b14ee5a594124946b89ac1b6a329702f` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:13.782374 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ac673-df6f-428d-92c8-871c9ecc159e admin admin] RBAC: Authorizing `identity:get_project(project_id=b14ee5a594124946b89ac1b6a329702f)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:13.784339 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ac673-df6f-428d-92c8-871c9ecc159e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:13.785961 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 510/1018] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:56:13 2021] GET /identity/v3/projects/b14ee5a594124946b89ac1b6a329702f => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:13.791827 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672ab12-682e-4077-b933-6361c56f4a94 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:13.801002 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672ab12-682e-4077-b933-6361c56f4a94 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:13.805481 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b31d42-c56b-49c4-aa4d-49f2a92800e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:13.806340 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b31d42-c56b-49c4-aa4d-49f2a92800e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:13.806626 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b31d42-c56b-49c4-aa4d-49f2a92800e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:13.806909 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b31d42-c56b-49c4-aa4d-49f2a92800e2 admin admin] PATH_INFO: `/v3/projects/b14ee5a594124946b89ac1b6a329702f/users/0d59a62f440f40ce80b3f695faca5e99/roles/1e311eea15274107873f2490f2cbc7b4` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:13.809316 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b31d42-c56b-49c4-aa4d-49f2a92800e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b14ee5a594124946b89ac1b6a329702f, user_id=0d59a62f440f40ce80b3f695faca5e99, role_id=1e311eea15274107873f2490f2cbc7b4)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:13.812024 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b31d42-c56b-49c4-aa4d-49f2a92800e2 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:13.889522 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 509/1019] 10.222.0.23 () {58 vars in 1461 bytes} [Thu Sep 23 02:56:13 2021] PUT /identity/v3/projects/b14ee5a594124946b89ac1b6a329702f/users/0d59a62f440f40ce80b3f695faca5e99/roles/1e311eea15274107873f2490f2cbc7b4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 02:56:16.033893 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9b9f0-ebae-43f4-a8d7-f24cb94b0021 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:16.034414 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9b9f0-ebae-43f4-a8d7-f24cb94b0021 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:16.034414 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9b9f0-ebae-43f4-a8d7-f24cb94b0021 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:16.036181 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 511/1020] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:56:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:56:16.043796 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb336e-11b4-4119-8dbc-bfa15a150e89 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:16.044234 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb336e-11b4-4119-8dbc-bfa15a150e89 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:16.044353 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb336e-11b4-4119-8dbc-bfa15a150e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:16.062758 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-2efb336e-11b4-4119-8dbc-bfa15a150e89 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:56:16.063943 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-2efb336e-11b4-4119-8dbc-bfa15a150e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:56:16.117404 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 510/1021] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:56:16 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:56:16.142791 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9b9f0-ebae-43f4-a8d7-f24cb94b0021 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:16.154534 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9b9f0-ebae-43f4-a8d7-f24cb94b0021 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:16.158796 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48aee6-fa40-4bdf-a0f1-09e5f0129313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:16.159629 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48aee6-fa40-4bdf-a0f1-09e5f0129313 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:16.159905 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48aee6-fa40-4bdf-a0f1-09e5f0129313 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:16.160178 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48aee6-fa40-4bdf-a0f1-09e5f0129313 admin admin] PATH_INFO: `/v3/roles/1e311eea15274107873f2490f2cbc7b4` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:16.161651 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48aee6-fa40-4bdf-a0f1-09e5f0129313 admin admin] RBAC: Authorizing `identity:get_role(role_id=1e311eea15274107873f2490f2cbc7b4)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:16.163218 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48aee6-fa40-4bdf-a0f1-09e5f0129313 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:16.164531 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 512/1022] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:56:16 2021] GET /identity/v3/roles/1e311eea15274107873f2490f2cbc7b4 => generated 223 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:16.170973 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb336e-11b4-4119-8dbc-bfa15a150e89 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:16.179571 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb336e-11b4-4119-8dbc-bfa15a150e89 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:16.184684 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24d9ca-b02d-46f5-928f-4b7fa178895e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:16.185535 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24d9ca-b02d-46f5-928f-4b7fa178895e admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:16.185817 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24d9ca-b02d-46f5-928f-4b7fa178895e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:16.186091 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24d9ca-b02d-46f5-928f-4b7fa178895e admin admin] PATH_INFO: `/v3/users/0d59a62f440f40ce80b3f695faca5e99` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:16.187269 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24d9ca-b02d-46f5-928f-4b7fa178895e admin admin] RBAC: Authorizing `identity:get_user(user_id=0d59a62f440f40ce80b3f695faca5e99)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:16.189402 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24d9ca-b02d-46f5-928f-4b7fa178895e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:16.190951 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 511/1023] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:56:16 2021] GET /identity/v3/users/0d59a62f440f40ce80b3f695faca5e99 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:16.196876 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48aee6-fa40-4bdf-a0f1-09e5f0129313 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:16.206013 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48aee6-fa40-4bdf-a0f1-09e5f0129313 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:16.210482 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c716e7-308a-46b0-9f5a-60850a420b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:16.211091 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c716e7-308a-46b0-9f5a-60850a420b24 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:16.211373 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c716e7-308a-46b0-9f5a-60850a420b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:16.211650 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c716e7-308a-46b0-9f5a-60850a420b24 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:16.219134 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c716e7-308a-46b0-9f5a-60850a420b24 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:16.220848 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c716e7-308a-46b0-9f5a-60850a420b24 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:16.229361 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 513/1024] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:56:16 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:56:16.235732 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24d9ca-b02d-46f5-928f-4b7fa178895e admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:16.244781 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24d9ca-b02d-46f5-928f-4b7fa178895e admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:16.249784 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92d005-227c-4538-acf5-43243dcc3a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:16.250574 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92d005-227c-4538-acf5-43243dcc3a8e admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:16.250855 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92d005-227c-4538-acf5-43243dcc3a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:16.251129 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92d005-227c-4538-acf5-43243dcc3a8e admin admin] PATH_INFO: `/v3/projects/b14ee5a594124946b89ac1b6a329702f` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:16.252269 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92d005-227c-4538-acf5-43243dcc3a8e admin admin] RBAC: Authorizing `identity:get_project(project_id=b14ee5a594124946b89ac1b6a329702f)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:16.254279 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92d005-227c-4538-acf5-43243dcc3a8e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:16.256006 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 512/1025] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:56:16 2021] GET /identity/v3/projects/b14ee5a594124946b89ac1b6a329702f => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:16.262094 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c716e7-308a-46b0-9f5a-60850a420b24 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:16.270412 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c716e7-308a-46b0-9f5a-60850a420b24 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:16.274903 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b72c3-810e-44e8-9fa0-6e8a0f0ba7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:16.275508 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b72c3-810e-44e8-9fa0-6e8a0f0ba7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:16.275792 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b72c3-810e-44e8-9fa0-6e8a0f0ba7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:16.276071 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b72c3-810e-44e8-9fa0-6e8a0f0ba7d6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:16.277413 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b72c3-810e-44e8-9fa0-6e8a0f0ba7d6 admin admin] RBAC: Adding query filter params (role.id=1e311eea15274107873f2490f2cbc7b4, scope.project.id=b14ee5a594124946b89ac1b6a329702f, user.id=0d59a62f440f40ce80b3f695faca5e99) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:56:16.277724 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b72c3-810e-44e8-9fa0-6e8a0f0ba7d6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:16.279484 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b72c3-810e-44e8-9fa0-6e8a0f0ba7d6 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:16.285009 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 514/1026] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:56:16 2021] GET /identity/v3/role_assignments?user.id=0d59a62f440f40ce80b3f695faca5e99&scope.project.id=b14ee5a594124946b89ac1b6a329702f&role.id=1e311eea15274107873f2490f2cbc7b4 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:18.434623 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44db015-7e4a-4d7c-8f9a-2f01c7f419f1 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:18.435150 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44db015-7e4a-4d7c-8f9a-2f01c7f419f1 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:18.435242 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44db015-7e4a-4d7c-8f9a-2f01c7f419f1 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:18.436984 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 513/1027] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:56:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:56:18.444279 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a747b56-fcd5-43f2-9076-388c0d16fb1b None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:18.444728 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a747b56-fcd5-43f2-9076-388c0d16fb1b None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:18.444873 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a747b56-fcd5-43f2-9076-388c0d16fb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:18.462394 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-8a747b56-fcd5-43f2-9076-388c0d16fb1b None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:56:18.463572 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-8a747b56-fcd5-43f2-9076-388c0d16fb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:56:18.471668 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 515/1028] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:56:18 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:56:18.496650 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44db015-7e4a-4d7c-8f9a-2f01c7f419f1 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:18.508731 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44db015-7e4a-4d7c-8f9a-2f01c7f419f1 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:18.514028 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf15dc-3211-4d76-a31e-3c2540488368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:18.514808 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf15dc-3211-4d76-a31e-3c2540488368 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:18.515090 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf15dc-3211-4d76-a31e-3c2540488368 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:18.515364 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf15dc-3211-4d76-a31e-3c2540488368 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:18.516536 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf15dc-3211-4d76-a31e-3c2540488368 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:18.518205 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf15dc-3211-4d76-a31e-3c2540488368 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:18.519755 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 514/1029] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:56:18 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:18.525745 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a747b56-fcd5-43f2-9076-388c0d16fb1b None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:18.534433 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a747b56-fcd5-43f2-9076-388c0d16fb1b None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:18.538949 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae760a6-aa1b-4e81-8301-7a2944b838a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:18.539618 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae760a6-aa1b-4e81-8301-7a2944b838a7 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:18.539898 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae760a6-aa1b-4e81-8301-7a2944b838a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:18.540174 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae760a6-aa1b-4e81-8301-7a2944b838a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:18.540915 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae760a6-aa1b-4e81-8301-7a2944b838a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:18.542765 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae760a6-aa1b-4e81-8301-7a2944b838a7 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:18.624920 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 516/1030] 10.222.0.23 () {60 vars in 1163 bytes} [Thu Sep 23 02:56:18 2021] POST /identity/v3/projects => generated 311 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 02:56:20.789521 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530374ab-1222-4d49-bc84-ce16d721d228 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:20.790051 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530374ab-1222-4d49-bc84-ce16d721d228 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:20.790051 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530374ab-1222-4d49-bc84-ce16d721d228 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:20.791816 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 515/1031] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:56:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:56:20.799373 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018d51b-75f2-4fdb-8079-1c0b89345834 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:20.799796 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018d51b-75f2-4fdb-8079-1c0b89345834 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:20.799917 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018d51b-75f2-4fdb-8079-1c0b89345834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:20.817351 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-0018d51b-75f2-4fdb-8079-1c0b89345834 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:56:20.818539 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-0018d51b-75f2-4fdb-8079-1c0b89345834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:56:20.872792 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 517/1032] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:56:20 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:56:20.898212 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530374ab-1222-4d49-bc84-ce16d721d228 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:20.910646 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530374ab-1222-4d49-bc84-ce16d721d228 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:20.915008 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e787230-6c13-4d5d-a1aa-b99ba0d16e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:20.915785 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e787230-6c13-4d5d-a1aa-b99ba0d16e43 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:20.916064 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e787230-6c13-4d5d-a1aa-b99ba0d16e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:20.916337 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e787230-6c13-4d5d-a1aa-b99ba0d16e43 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:20.918082 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e787230-6c13-4d5d-a1aa-b99ba0d16e43 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:20.919750 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e787230-6c13-4d5d-a1aa-b99ba0d16e43 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:20.921330 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 516/1033] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:56:20 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:56:20.927020 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018d51b-75f2-4fdb-8079-1c0b89345834 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:20.935652 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018d51b-75f2-4fdb-8079-1c0b89345834 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:20.940122 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d662f-afbd-4140-b57c-b64774b7c4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:20.940804 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d662f-afbd-4140-b57c-b64774b7c4d7 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:20.941088 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d662f-afbd-4140-b57c-b64774b7c4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:20.941365 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d662f-afbd-4140-b57c-b64774b7c4d7 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:20.942060 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d662f-afbd-4140-b57c-b64774b7c4d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:20.943948 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d662f-afbd-4140-b57c-b64774b7c4d7 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:21.076942 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 518/1034] 10.222.0.23 () {60 vars in 1154 bytes} [Thu Sep 23 02:56:20 2021] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 02:56:23.231137 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3820db-4182-4d66-aad0-d81c67661ee1 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:23.231637 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3820db-4182-4d66-aad0-d81c67661ee1 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:23.231637 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3820db-4182-4d66-aad0-d81c67661ee1 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:23.233390 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 517/1035] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:56:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:56:23.240560 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e8d9b-a3ba-4798-bc24-4809d9e55075 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:23.240936 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e8d9b-a3ba-4798-bc24-4809d9e55075 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:23.241111 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e8d9b-a3ba-4798-bc24-4809d9e55075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:23.258720 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-a60e8d9b-a3ba-4798-bc24-4809d9e55075 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:56:23.259900 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-a60e8d9b-a3ba-4798-bc24-4809d9e55075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:56:23.268276 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 519/1036] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:56:23 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:56:23.291968 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3820db-4182-4d66-aad0-d81c67661ee1 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:23.303793 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3820db-4182-4d66-aad0-d81c67661ee1 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:23.308736 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50702a16-f983-400d-8e20-6f30e3c695b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:23.309507 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50702a16-f983-400d-8e20-6f30e3c695b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:23.309790 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50702a16-f983-400d-8e20-6f30e3c695b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:23.310061 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50702a16-f983-400d-8e20-6f30e3c695b5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:23.319873 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50702a16-f983-400d-8e20-6f30e3c695b5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:56:23.327058 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-50702a16-f983-400d-8e20-6f30e3c695b5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:56:23.328172 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 518/1037] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:56:23 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:56:23.334426 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e8d9b-a3ba-4798-bc24-4809d9e55075 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:23.343508 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e8d9b-a3ba-4798-bc24-4809d9e55075 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:23.348093 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62504092-6781-4a1c-8673-f1316eceb3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:23.348771 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62504092-6781-4a1c-8673-f1316eceb3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:23.349052 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62504092-6781-4a1c-8673-f1316eceb3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:23.349324 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62504092-6781-4a1c-8673-f1316eceb3e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:23.350056 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62504092-6781-4a1c-8673-f1316eceb3e4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:56:23.350355 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62504092-6781-4a1c-8673-f1316eceb3e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:23.351910 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62504092-6781-4a1c-8673-f1316eceb3e4 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:23.360384 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 520/1038] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:56:23 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:23.366290 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50702a16-f983-400d-8e20-6f30e3c695b5 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:23.375924 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50702a16-f983-400d-8e20-6f30e3c695b5 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:23.380354 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fbc5e-31bf-45e3-97c1-2b4d86ecedfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:23.381202 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fbc5e-31bf-45e3-97c1-2b4d86ecedfe admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:23.381481 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fbc5e-31bf-45e3-97c1-2b4d86ecedfe admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:23.381752 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fbc5e-31bf-45e3-97c1-2b4d86ecedfe admin admin] PATH_INFO: `/v3/users/3c9acfa066e8479b842832d6a9f6ac85` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:23.395239 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2fbc5e-31bf-45e3-97c1-2b4d86ecedfe admin admin] RBAC: Authorizing `identity:get_user(user_id=3c9acfa066e8479b842832d6a9f6ac85)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:23.397386 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2fbc5e-31bf-45e3-97c1-2b4d86ecedfe admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:23.398952 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 519/1039] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:56:23 2021] GET /identity/v3/users/3c9acfa066e8479b842832d6a9f6ac85 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:56:23.405443 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62504092-6781-4a1c-8673-f1316eceb3e4 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:23.414694 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62504092-6781-4a1c-8673-f1316eceb3e4 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:23.419170 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e6bc8-001f-48df-ba37-6c80be985f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:23.419787 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e6bc8-001f-48df-ba37-6c80be985f28 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:23.420067 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e6bc8-001f-48df-ba37-6c80be985f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:23.420371 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e6bc8-001f-48df-ba37-6c80be985f28 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:23.427758 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e6bc8-001f-48df-ba37-6c80be985f28 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:23.429475 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e6bc8-001f-48df-ba37-6c80be985f28 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:23.438030 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 521/1040] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:56:23 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:56:23.443880 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fbc5e-31bf-45e3-97c1-2b4d86ecedfe admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:23.453367 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fbc5e-31bf-45e3-97c1-2b4d86ecedfe admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:23.457839 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c19fb-dabb-4375-9bdb-b80f719fa3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:23.458651 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c19fb-dabb-4375-9bdb-b80f719fa3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:23.458934 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c19fb-dabb-4375-9bdb-b80f719fa3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:23.459210 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c19fb-dabb-4375-9bdb-b80f719fa3a0 admin admin] PATH_INFO: `/v3/projects/57665ee860a440f7bba72e4078f9ca74` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:23.460352 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c19fb-dabb-4375-9bdb-b80f719fa3a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=57665ee860a440f7bba72e4078f9ca74)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:23.462341 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c19fb-dabb-4375-9bdb-b80f719fa3a0 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:23.464053 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 520/1041] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:56:23 2021] GET /identity/v3/projects/57665ee860a440f7bba72e4078f9ca74 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:23.470374 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e6bc8-001f-48df-ba37-6c80be985f28 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:23.478504 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e6bc8-001f-48df-ba37-6c80be985f28 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:23.483213 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f7059-62db-4bba-a8fe-f7a5eb5e3491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:23.483779 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f7059-62db-4bba-a8fe-f7a5eb5e3491 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:23.484062 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f7059-62db-4bba-a8fe-f7a5eb5e3491 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:23.484341 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f7059-62db-4bba-a8fe-f7a5eb5e3491 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:23.485191 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f7059-62db-4bba-a8fe-f7a5eb5e3491 admin admin] RBAC: Adding query filter params (role.id=3e7d7427203a4a4097e2c9a642b9bf69, scope.project.id=57665ee860a440f7bba72e4078f9ca74, user.id=3c9acfa066e8479b842832d6a9f6ac85) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:56:23.485505 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f7059-62db-4bba-a8fe-f7a5eb5e3491 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:23.487258 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f7059-62db-4bba-a8fe-f7a5eb5e3491 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:23.492528 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 522/1042] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:56:23 2021] GET /identity/v3/role_assignments?user.id=3c9acfa066e8479b842832d6a9f6ac85&scope.project.id=57665ee860a440f7bba72e4078f9ca74&role.id=3e7d7427203a4a4097e2c9a642b9bf69 => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:56:25.622636 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab000328-b65a-40a3-8a2a-41c73c8d3c1b None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:25.623276 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab000328-b65a-40a3-8a2a-41c73c8d3c1b None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:25.623276 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab000328-b65a-40a3-8a2a-41c73c8d3c1b None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:25.624985 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 521/1043] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:56:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:56:25.631909 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07474e16-3a15-45df-b37b-af1ef8cf009d None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:25.632348 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07474e16-3a15-45df-b37b-af1ef8cf009d None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:25.632458 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07474e16-3a15-45df-b37b-af1ef8cf009d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:25.651221 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-07474e16-3a15-45df-b37b-af1ef8cf009d None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:56:25.653007 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-07474e16-3a15-45df-b37b-af1ef8cf009d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:56:25.660462 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 523/1044] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:56:25 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:56:25.684309 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab000328-b65a-40a3-8a2a-41c73c8d3c1b None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:25.696148 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab000328-b65a-40a3-8a2a-41c73c8d3c1b None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:25.701020 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25579872-626c-4339-8d47-23219bab1422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:25.701788 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25579872-626c-4339-8d47-23219bab1422 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:25.702073 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25579872-626c-4339-8d47-23219bab1422 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:25.702351 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25579872-626c-4339-8d47-23219bab1422 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:25.712120 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25579872-626c-4339-8d47-23219bab1422 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:56:25.719302 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-25579872-626c-4339-8d47-23219bab1422 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:56:25.720416 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 522/1045] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:56:25 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:56:25.726485 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07474e16-3a15-45df-b37b-af1ef8cf009d None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:25.735198 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07474e16-3a15-45df-b37b-af1ef8cf009d None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:25.739662 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1b227-62ec-4470-9079-2b4ea494e03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:25.740298 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1b227-62ec-4470-9079-2b4ea494e03f admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:25.740613 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1b227-62ec-4470-9079-2b4ea494e03f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:25.740885 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1b227-62ec-4470-9079-2b4ea494e03f admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:25.741679 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1b227-62ec-4470-9079-2b4ea494e03f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:56:25.741980 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1b227-62ec-4470-9079-2b4ea494e03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:25.743586 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1b227-62ec-4470-9079-2b4ea494e03f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:25.751670 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 524/1046] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:56:25 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:25.757612 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25579872-626c-4339-8d47-23219bab1422 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:25.768033 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25579872-626c-4339-8d47-23219bab1422 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:25.772584 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1bfde-e355-4627-b05e-4f3080814fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:25.773404 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1bfde-e355-4627-b05e-4f3080814fdc admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:25.773683 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1bfde-e355-4627-b05e-4f3080814fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:25.773957 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1bfde-e355-4627-b05e-4f3080814fdc admin admin] PATH_INFO: `/v3/users/3c9acfa066e8479b842832d6a9f6ac85` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:25.775137 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1bfde-e355-4627-b05e-4f3080814fdc admin admin] RBAC: Authorizing `identity:get_user(user_id=3c9acfa066e8479b842832d6a9f6ac85)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:25.777825 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1bfde-e355-4627-b05e-4f3080814fdc admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:25.779362 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 523/1047] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:56:25 2021] GET /identity/v3/users/3c9acfa066e8479b842832d6a9f6ac85 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:56:25.785562 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1b227-62ec-4470-9079-2b4ea494e03f admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:25.794965 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1b227-62ec-4470-9079-2b4ea494e03f admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:25.799489 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a25e7-282a-4d8e-a592-2e5e399c0605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:25.800334 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a25e7-282a-4d8e-a592-2e5e399c0605 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:25.800658 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a25e7-282a-4d8e-a592-2e5e399c0605 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:25.800937 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a25e7-282a-4d8e-a592-2e5e399c0605 admin admin] PATH_INFO: `/v3/projects/57665ee860a440f7bba72e4078f9ca74` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:25.802096 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a25e7-282a-4d8e-a592-2e5e399c0605 admin admin] RBAC: Authorizing `identity:get_project(project_id=57665ee860a440f7bba72e4078f9ca74)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:25.804109 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a25e7-282a-4d8e-a592-2e5e399c0605 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:25.805775 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 525/1048] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:56:25 2021] GET /identity/v3/projects/57665ee860a440f7bba72e4078f9ca74 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:25.812341 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1bfde-e355-4627-b05e-4f3080814fdc admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:25.821988 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1bfde-e355-4627-b05e-4f3080814fdc admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:25.827091 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090305d-36e9-40dd-b04f-07fee173397a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:25.827965 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090305d-36e9-40dd-b04f-07fee173397a admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:25.828250 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090305d-36e9-40dd-b04f-07fee173397a admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:25.828560 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090305d-36e9-40dd-b04f-07fee173397a admin admin] PATH_INFO: `/v3/projects/57665ee860a440f7bba72e4078f9ca74/users/3c9acfa066e8479b842832d6a9f6ac85/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:25.830517 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090305d-36e9-40dd-b04f-07fee173397a admin admin] RBAC: Authorizing `identity:create_grant(project_id=57665ee860a440f7bba72e4078f9ca74, user_id=3c9acfa066e8479b842832d6a9f6ac85, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:25.833173 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090305d-36e9-40dd-b04f-07fee173397a admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:25.910477 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 524/1049] 10.222.0.23 () {58 vars in 1461 bytes} [Thu Sep 23 02:56:25 2021] PUT /identity/v3/projects/57665ee860a440f7bba72e4078f9ca74/users/3c9acfa066e8479b842832d6a9f6ac85/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 02:56:28.082800 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a367a-ef5e-4b0f-8f25-5613223be44d None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:28.083321 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a367a-ef5e-4b0f-8f25-5613223be44d None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:28.083321 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a367a-ef5e-4b0f-8f25-5613223be44d None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:28.085053 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 526/1050] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:56:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:56:28.092775 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4c90e-9e2b-49a8-83ed-e219b90970fc None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:28.093180 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4c90e-9e2b-49a8-83ed-e219b90970fc None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:28.093338 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4c90e-9e2b-49a8-83ed-e219b90970fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:28.110532 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-37e4c90e-9e2b-49a8-83ed-e219b90970fc None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:56:28.111717 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-37e4c90e-9e2b-49a8-83ed-e219b90970fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:56:28.165957 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 525/1051] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:56:28 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:56:28.191422 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a367a-ef5e-4b0f-8f25-5613223be44d None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:28.203465 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a367a-ef5e-4b0f-8f25-5613223be44d None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:28.207854 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff2da3-c6f8-412e-a2bb-389aab455c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:28.208667 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff2da3-c6f8-412e-a2bb-389aab455c99 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:28.208956 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff2da3-c6f8-412e-a2bb-389aab455c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:28.209234 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff2da3-c6f8-412e-a2bb-389aab455c99 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:28.219461 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff2da3-c6f8-412e-a2bb-389aab455c99 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:56:28.226149 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-3dff2da3-c6f8-412e-a2bb-389aab455c99 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:56:28.227404 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 527/1052] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:56:28 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:56:28.233973 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4c90e-9e2b-49a8-83ed-e219b90970fc None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:28.242566 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4c90e-9e2b-49a8-83ed-e219b90970fc None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:28.247618 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae60a9-8d5b-41ea-ae58-6d30496ddc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:28.248266 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae60a9-8d5b-41ea-ae58-6d30496ddc2d admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:28.248580 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae60a9-8d5b-41ea-ae58-6d30496ddc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:28.248859 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae60a9-8d5b-41ea-ae58-6d30496ddc2d admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:28.249596 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae60a9-8d5b-41ea-ae58-6d30496ddc2d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:56:28.249906 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae60a9-8d5b-41ea-ae58-6d30496ddc2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:28.251479 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae60a9-8d5b-41ea-ae58-6d30496ddc2d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:28.259357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 526/1053] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:56:28 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:28.265753 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff2da3-c6f8-412e-a2bb-389aab455c99 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:28.275611 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff2da3-c6f8-412e-a2bb-389aab455c99 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:28.280782 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c133008-2d4d-4a66-b337-29dce220f045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:28.281641 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c133008-2d4d-4a66-b337-29dce220f045 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:28.281924 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c133008-2d4d-4a66-b337-29dce220f045 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:28.282203 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c133008-2d4d-4a66-b337-29dce220f045 admin admin] PATH_INFO: `/v3/users/3c9acfa066e8479b842832d6a9f6ac85` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:28.283384 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c133008-2d4d-4a66-b337-29dce220f045 admin admin] RBAC: Authorizing `identity:get_user(user_id=3c9acfa066e8479b842832d6a9f6ac85)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:28.285517 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c133008-2d4d-4a66-b337-29dce220f045 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:28.287062 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 528/1054] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:56:28 2021] GET /identity/v3/users/3c9acfa066e8479b842832d6a9f6ac85 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:28.293365 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae60a9-8d5b-41ea-ae58-6d30496ddc2d admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:28.302427 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae60a9-8d5b-41ea-ae58-6d30496ddc2d admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:28.306884 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e12b4-93a5-4e6f-832f-d49842d7d599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:28.307500 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e12b4-93a5-4e6f-832f-d49842d7d599 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:28.307783 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e12b4-93a5-4e6f-832f-d49842d7d599 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:28.308061 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e12b4-93a5-4e6f-832f-d49842d7d599 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:28.315492 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e12b4-93a5-4e6f-832f-d49842d7d599 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:28.317224 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e12b4-93a5-4e6f-832f-d49842d7d599 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:28.325754 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 527/1055] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:56:28 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 02:56:28.331889 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c133008-2d4d-4a66-b337-29dce220f045 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:28.341762 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c133008-2d4d-4a66-b337-29dce220f045 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:28.346213 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32137223-ff0a-4b34-ad99-7652ce75c635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:28.347019 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32137223-ff0a-4b34-ad99-7652ce75c635 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:28.347307 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32137223-ff0a-4b34-ad99-7652ce75c635 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:28.347579 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32137223-ff0a-4b34-ad99-7652ce75c635 admin admin] PATH_INFO: `/v3/projects/57665ee860a440f7bba72e4078f9ca74` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:28.348763 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32137223-ff0a-4b34-ad99-7652ce75c635 admin admin] RBAC: Authorizing `identity:get_project(project_id=57665ee860a440f7bba72e4078f9ca74)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:28.350730 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32137223-ff0a-4b34-ad99-7652ce75c635 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:28.352319 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 529/1056] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:56:28 2021] GET /identity/v3/projects/57665ee860a440f7bba72e4078f9ca74 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:28.358348 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e12b4-93a5-4e6f-832f-d49842d7d599 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:28.366593 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e12b4-93a5-4e6f-832f-d49842d7d599 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:28.371626 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8ca49-7958-411e-9e77-a7efb9ae3bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:28.372237 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8ca49-7958-411e-9e77-a7efb9ae3bed admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:28.372549 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8ca49-7958-411e-9e77-a7efb9ae3bed admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:28.372831 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8ca49-7958-411e-9e77-a7efb9ae3bed admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:28.373631 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8ca49-7958-411e-9e77-a7efb9ae3bed admin admin] RBAC: Adding query filter params (role.id=3e7d7427203a4a4097e2c9a642b9bf69, scope.project.id=57665ee860a440f7bba72e4078f9ca74, user.id=3c9acfa066e8479b842832d6a9f6ac85) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:56:28.373943 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8ca49-7958-411e-9e77-a7efb9ae3bed admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:28.375702 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8ca49-7958-411e-9e77-a7efb9ae3bed admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:28.381375 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 528/1057] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:56:28 2021] GET /identity/v3/role_assignments?user.id=3c9acfa066e8479b842832d6a9f6ac85&scope.project.id=57665ee860a440f7bba72e4078f9ca74&role.id=3e7d7427203a4a4097e2c9a642b9bf69 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:30.580665 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910aba7b-c754-4641-9510-4f78a52c9e37 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:30.581197 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910aba7b-c754-4641-9510-4f78a52c9e37 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:30.581197 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910aba7b-c754-4641-9510-4f78a52c9e37 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:30.582968 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 530/1058] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:56:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:56:30.590455 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb77bfc-b777-4a45-8486-adc2a95fd318 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:30.590840 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb77bfc-b777-4a45-8486-adc2a95fd318 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:30.591006 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb77bfc-b777-4a45-8486-adc2a95fd318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:30.608677 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-9cb77bfc-b777-4a45-8486-adc2a95fd318 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:56:30.609858 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-9cb77bfc-b777-4a45-8486-adc2a95fd318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:56:30.617369 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 529/1059] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:56:30 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:56:30.640330 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910aba7b-c754-4641-9510-4f78a52c9e37 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:30.652897 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910aba7b-c754-4641-9510-4f78a52c9e37 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:30.657312 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d7e96-41a1-40ba-9f20-01c91c2c93cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:30.657941 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d7e96-41a1-40ba-9f20-01c91c2c93cb admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:30.658220 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d7e96-41a1-40ba-9f20-01c91c2c93cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:30.658495 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d7e96-41a1-40ba-9f20-01c91c2c93cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:30.665984 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d7e96-41a1-40ba-9f20-01c91c2c93cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:30.668303 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d7e96-41a1-40ba-9f20-01c91c2c93cb admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:30.676912 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 531/1060] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:56:30 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:56:30.682911 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb77bfc-b777-4a45-8486-adc2a95fd318 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:30.691493 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb77bfc-b777-4a45-8486-adc2a95fd318 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:30.695964 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9570e2-f18b-42d6-b7ec-b24b4646132b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:30.696769 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9570e2-f18b-42d6-b7ec-b24b4646132b admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:30.697051 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9570e2-f18b-42d6-b7ec-b24b4646132b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:30.697322 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9570e2-f18b-42d6-b7ec-b24b4646132b admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:30.704009 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9570e2-f18b-42d6-b7ec-b24b4646132b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:30.705842 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9570e2-f18b-42d6-b7ec-b24b4646132b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:30.720333 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-7f9570e2-f18b-42d6-b7ec-b24b4646132b admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 23 02:56:30.721456 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 530/1061] 10.222.0.23 () {56 vars in 1139 bytes} [Thu Sep 23 02:56:30 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:56:30.727518 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d7e96-41a1-40ba-9f20-01c91c2c93cb admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:30.736635 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d7e96-41a1-40ba-9f20-01c91c2c93cb admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:30.741124 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b3d86-2aed-4f50-b15a-b95f298712fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:30.741747 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b3d86-2aed-4f50-b15a-b95f298712fe admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:30.742022 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b3d86-2aed-4f50-b15a-b95f298712fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:30.742290 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b3d86-2aed-4f50-b15a-b95f298712fe admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:30.743018 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b3d86-2aed-4f50-b15a-b95f298712fe admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:56:30.743316 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b3d86-2aed-4f50-b15a-b95f298712fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:30.744862 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b3d86-2aed-4f50-b15a-b95f298712fe admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:30.751794 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 532/1062] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Sep 23 02:56:30 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:32.868880 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a105181-585a-4e0d-85b0-8d83612e2889 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:32.869332 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a105181-585a-4e0d-85b0-8d83612e2889 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:32.869423 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a105181-585a-4e0d-85b0-8d83612e2889 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:32.871715 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 531/1063] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:56:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:56:32.878707 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d35a5-2a8a-479d-be9a-92628f078fdd None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:32.879085 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d35a5-2a8a-479d-be9a-92628f078fdd None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:32.879253 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d35a5-2a8a-479d-be9a-92628f078fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:32.897210 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-028d35a5-2a8a-479d-be9a-92628f078fdd None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:56:32.898376 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-028d35a5-2a8a-479d-be9a-92628f078fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:56:32.906800 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 533/1064] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:56:32 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:56:32.930625 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a105181-585a-4e0d-85b0-8d83612e2889 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:32.943118 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a105181-585a-4e0d-85b0-8d83612e2889 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:32.947506 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b59cc-5975-4bb7-b4c5-fa5fecd82793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:32.948734 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b59cc-5975-4bb7-b4c5-fa5fecd82793 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:32.949019 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b59cc-5975-4bb7-b4c5-fa5fecd82793 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:32.949295 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b59cc-5975-4bb7-b4c5-fa5fecd82793 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:32.950023 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b59cc-5975-4bb7-b4c5-fa5fecd82793 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:32.951025 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING py.warnings [None req-660b59cc-5975-4bb7-b4c5-fa5fecd82793 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 02:56:32.951025 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: warnings.warn(msg) Sep 23 02:56:32.951025 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: Sep 23 02:56:32.951904 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b59cc-5975-4bb7-b4c5-fa5fecd82793 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:33.025668 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 532/1065] 10.222.0.23 () {60 vars in 1160 bytes} [Thu Sep 23 02:56:32 2021] POST /identity/v3/domains => generated 267 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 02:56:35.163440 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b10e52-23e1-4f69-a555-8c5a99ba2e65 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:35.163952 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b10e52-23e1-4f69-a555-8c5a99ba2e65 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:35.163952 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b10e52-23e1-4f69-a555-8c5a99ba2e65 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:35.165840 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 534/1066] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:56:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:56:35.173528 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148a07d-7162-4254-a4e3-9dd102f2f086 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:35.173913 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148a07d-7162-4254-a4e3-9dd102f2f086 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:35.174081 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148a07d-7162-4254-a4e3-9dd102f2f086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:35.191294 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-7148a07d-7162-4254-a4e3-9dd102f2f086 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:56:35.192471 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-7148a07d-7162-4254-a4e3-9dd102f2f086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:56:35.246197 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 533/1067] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:56:35 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:56:35.270428 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b10e52-23e1-4f69-a555-8c5a99ba2e65 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:35.283050 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b10e52-23e1-4f69-a555-8c5a99ba2e65 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:35.287436 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f6f4b-1c0a-47ca-b26d-c20c95a7d6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:35.288279 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f6f4b-1c0a-47ca-b26d-c20c95a7d6ee admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:35.288593 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f6f4b-1c0a-47ca-b26d-c20c95a7d6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:35.288874 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f6f4b-1c0a-47ca-b26d-c20c95a7d6ee admin admin] PATH_INFO: `/v3/domains/6364c92ddcaa456d96247741e686b8fa` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:35.299751 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f6f4b-1c0a-47ca-b26d-c20c95a7d6ee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=6364c92ddcaa456d96247741e686b8fa)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:35.301739 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f6f4b-1c0a-47ca-b26d-c20c95a7d6ee admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:35.303309 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 535/1068] 10.222.0.23 () {56 vars in 1205 bytes} [Thu Sep 23 02:56:35 2021] GET /identity/v3/domains/6364c92ddcaa456d96247741e686b8fa => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:35.310003 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148a07d-7162-4254-a4e3-9dd102f2f086 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:35.318496 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148a07d-7162-4254-a4e3-9dd102f2f086 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:35.322981 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb062e-b08e-43a0-96f6-739ee74c6340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:35.323622 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb062e-b08e-43a0-96f6-739ee74c6340 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:35.323900 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb062e-b08e-43a0-96f6-739ee74c6340 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:35.324173 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb062e-b08e-43a0-96f6-739ee74c6340 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:35.324902 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb062e-b08e-43a0-96f6-739ee74c6340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:35.326769 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb062e-b08e-43a0-96f6-739ee74c6340 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:35.408334 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 534/1069] 10.222.0.23 () {60 vars in 1163 bytes} [Thu Sep 23 02:56:35 2021] POST /identity/v3/projects => generated 361 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 02:56:37.579840 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f879d0-66de-4c9d-bb40-44baefa7c8d2 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:37.580374 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f879d0-66de-4c9d-bb40-44baefa7c8d2 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:37.580374 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f879d0-66de-4c9d-bb40-44baefa7c8d2 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:37.582173 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 536/1070] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:56:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:56:37.589695 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2273a64-d525-4a3e-8c8a-26b0708fff0f None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:37.590136 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2273a64-d525-4a3e-8c8a-26b0708fff0f None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:37.590258 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2273a64-d525-4a3e-8c8a-26b0708fff0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:37.608228 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-b2273a64-d525-4a3e-8c8a-26b0708fff0f None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:56:37.609552 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-b2273a64-d525-4a3e-8c8a-26b0708fff0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:56:37.664185 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 535/1071] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:56:37 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:56:37.690951 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f879d0-66de-4c9d-bb40-44baefa7c8d2 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:37.702943 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f879d0-66de-4c9d-bb40-44baefa7c8d2 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:37.707244 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43358b58-299c-403e-84f1-9f9fb3d00b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:37.708087 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43358b58-299c-403e-84f1-9f9fb3d00b82 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:37.708367 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43358b58-299c-403e-84f1-9f9fb3d00b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:37.708680 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43358b58-299c-403e-84f1-9f9fb3d00b82 admin admin] PATH_INFO: `/v3/domains/6364c92ddcaa456d96247741e686b8fa` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:37.709839 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43358b58-299c-403e-84f1-9f9fb3d00b82 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=6364c92ddcaa456d96247741e686b8fa)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:37.711758 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43358b58-299c-403e-84f1-9f9fb3d00b82 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:37.713338 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 537/1072] 10.222.0.23 () {56 vars in 1205 bytes} [Thu Sep 23 02:56:37 2021] GET /identity/v3/domains/6364c92ddcaa456d96247741e686b8fa => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:37.719192 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2273a64-d525-4a3e-8c8a-26b0708fff0f None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:37.727729 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2273a64-d525-4a3e-8c8a-26b0708fff0f None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:37.732714 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923dff0-123f-440f-ab6c-0e9739b28eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:37.733366 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923dff0-123f-440f-ab6c-0e9739b28eba admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:37.733649 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923dff0-123f-440f-ab6c-0e9739b28eba admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:37.733928 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923dff0-123f-440f-ab6c-0e9739b28eba admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:37.734630 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923dff0-123f-440f-ab6c-0e9739b28eba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:37.736541 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923dff0-123f-440f-ab6c-0e9739b28eba admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:37.819914 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 536/1073] 10.222.0.23 () {60 vars in 1154 bytes} [Thu Sep 23 02:56:37 2021] POST /identity/v3/users => generated 311 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 02:56:39.995824 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a5132-1bc2-406c-8754-21b0b1aa273e None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:39.996338 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a5132-1bc2-406c-8754-21b0b1aa273e None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:39.996444 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a5132-1bc2-406c-8754-21b0b1aa273e None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:39.998314 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 538/1074] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:56:39 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:56:40.007116 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b56b0-77da-4582-b139-73a2e5e101ab None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:40.007569 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b56b0-77da-4582-b139-73a2e5e101ab None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:40.007662 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b56b0-77da-4582-b139-73a2e5e101ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:40.027440 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-6c8b56b0-77da-4582-b139-73a2e5e101ab None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:56:40.028674 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-6c8b56b0-77da-4582-b139-73a2e5e101ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:56:40.036235 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 537/1075] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:56:40 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:56:40.063895 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a5132-1bc2-406c-8754-21b0b1aa273e None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:40.076690 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a5132-1bc2-406c-8754-21b0b1aa273e None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:40.081008 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8898e-7a27-4511-a954-8f789e0756ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:40.081788 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8898e-7a27-4511-a954-8f789e0756ae admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:40.082074 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8898e-7a27-4511-a954-8f789e0756ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:40.082353 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8898e-7a27-4511-a954-8f789e0756ae admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:40.093369 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8898e-7a27-4511-a954-8f789e0756ae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:56:40.099943 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-ecd8898e-7a27-4511-a954-8f789e0756ae admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:56:40.101090 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 539/1076] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:56:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:56:40.107572 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b56b0-77da-4582-b139-73a2e5e101ab None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:40.116343 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b56b0-77da-4582-b139-73a2e5e101ab None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:40.120851 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f13af-b835-42fa-89f7-7e2f6956c235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:40.121506 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f13af-b835-42fa-89f7-7e2f6956c235 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:40.121789 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f13af-b835-42fa-89f7-7e2f6956c235 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:40.122065 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f13af-b835-42fa-89f7-7e2f6956c235 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:40.122809 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f13af-b835-42fa-89f7-7e2f6956c235 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:56:40.123113 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f13af-b835-42fa-89f7-7e2f6956c235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:40.124740 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f13af-b835-42fa-89f7-7e2f6956c235 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:40.132732 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 538/1077] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:56:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:40.139163 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8898e-7a27-4511-a954-8f789e0756ae admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:40.148449 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8898e-7a27-4511-a954-8f789e0756ae admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:40.153572 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240bef0-c957-459c-be2c-cb77e37579db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:40.154403 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240bef0-c957-459c-be2c-cb77e37579db admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:40.154691 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240bef0-c957-459c-be2c-cb77e37579db admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:40.154970 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240bef0-c957-459c-be2c-cb77e37579db admin admin] PATH_INFO: `/v3/users/28a7d4018951460699d1b554d5491473` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:40.167902 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240bef0-c957-459c-be2c-cb77e37579db admin admin] RBAC: Authorizing `identity:get_user(user_id=28a7d4018951460699d1b554d5491473)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:40.170036 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240bef0-c957-459c-be2c-cb77e37579db admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:40.171607 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 540/1078] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:56:40 2021] GET /identity/v3/users/28a7d4018951460699d1b554d5491473 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:40.177671 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f13af-b835-42fa-89f7-7e2f6956c235 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:40.186871 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f13af-b835-42fa-89f7-7e2f6956c235 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:40.191302 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c26bd-f17f-4200-a8c4-60f9e59c4663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:40.191922 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c26bd-f17f-4200-a8c4-60f9e59c4663 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:40.192200 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c26bd-f17f-4200-a8c4-60f9e59c4663 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:40.192476 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c26bd-f17f-4200-a8c4-60f9e59c4663 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:40.200330 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c26bd-f17f-4200-a8c4-60f9e59c4663 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:40.202088 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c26bd-f17f-4200-a8c4-60f9e59c4663 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:40.210565 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 539/1079] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:56:40 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 02:56:40.217002 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240bef0-c957-459c-be2c-cb77e37579db admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:40.226138 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240bef0-c957-459c-be2c-cb77e37579db admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:40.230609 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03259cd1-14e5-48e2-bf3f-db22ff4d45e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:40.231419 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03259cd1-14e5-48e2-bf3f-db22ff4d45e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:40.231698 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03259cd1-14e5-48e2-bf3f-db22ff4d45e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:40.231969 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03259cd1-14e5-48e2-bf3f-db22ff4d45e1 admin admin] PATH_INFO: `/v3/projects/173a19f04cc142dbaf96746fcb8fd39d` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:40.233139 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03259cd1-14e5-48e2-bf3f-db22ff4d45e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=173a19f04cc142dbaf96746fcb8fd39d)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:40.235108 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03259cd1-14e5-48e2-bf3f-db22ff4d45e1 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:40.236731 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 541/1080] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:56:40 2021] GET /identity/v3/projects/173a19f04cc142dbaf96746fcb8fd39d => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:40.242722 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c26bd-f17f-4200-a8c4-60f9e59c4663 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:40.251534 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c26bd-f17f-4200-a8c4-60f9e59c4663 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:40.255946 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016b4cb-33e8-4304-8d61-af7b246db533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:40.256589 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016b4cb-33e8-4304-8d61-af7b246db533 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:40.256866 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016b4cb-33e8-4304-8d61-af7b246db533 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:40.257137 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016b4cb-33e8-4304-8d61-af7b246db533 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:40.257937 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016b4cb-33e8-4304-8d61-af7b246db533 admin admin] RBAC: Adding query filter params (role.id=3e7d7427203a4a4097e2c9a642b9bf69, scope.project.id=173a19f04cc142dbaf96746fcb8fd39d, user.id=28a7d4018951460699d1b554d5491473) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:56:40.258245 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016b4cb-33e8-4304-8d61-af7b246db533 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:40.260577 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016b4cb-33e8-4304-8d61-af7b246db533 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:40.265627 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 540/1081] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:56:40 2021] GET /identity/v3/role_assignments?user.id=28a7d4018951460699d1b554d5491473&scope.project.id=173a19f04cc142dbaf96746fcb8fd39d&role.id=3e7d7427203a4a4097e2c9a642b9bf69 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:42.381731 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811dc82b-0485-4f6d-af43-4b087d581908 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:42.382257 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811dc82b-0485-4f6d-af43-4b087d581908 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:42.382364 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811dc82b-0485-4f6d-af43-4b087d581908 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:42.384049 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 542/1082] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:56:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:56:42.391802 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21657703-3c3d-4aa2-9ebb-09d6a924ed03 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:42.392212 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21657703-3c3d-4aa2-9ebb-09d6a924ed03 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:42.392354 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21657703-3c3d-4aa2-9ebb-09d6a924ed03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:42.410533 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-21657703-3c3d-4aa2-9ebb-09d6a924ed03 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:56:42.411717 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-21657703-3c3d-4aa2-9ebb-09d6a924ed03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:56:42.419317 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 541/1083] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:56:42 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:56:42.443450 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811dc82b-0485-4f6d-af43-4b087d581908 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:42.456041 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811dc82b-0485-4f6d-af43-4b087d581908 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:42.460360 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abd9da-33d1-4f73-b29f-c6d1cd963bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:42.461168 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abd9da-33d1-4f73-b29f-c6d1cd963bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:42.461451 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abd9da-33d1-4f73-b29f-c6d1cd963bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:42.461723 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abd9da-33d1-4f73-b29f-c6d1cd963bf3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:42.472224 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96abd9da-33d1-4f73-b29f-c6d1cd963bf3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:56:42.478841 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-96abd9da-33d1-4f73-b29f-c6d1cd963bf3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:56:42.479979 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 543/1084] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:56:42 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:56:42.486597 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21657703-3c3d-4aa2-9ebb-09d6a924ed03 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:42.495879 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21657703-3c3d-4aa2-9ebb-09d6a924ed03 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:42.500356 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430c03a-213e-4548-9502-c591f3eea2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:42.501045 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430c03a-213e-4548-9502-c591f3eea2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:42.501328 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430c03a-213e-4548-9502-c591f3eea2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:42.501600 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430c03a-213e-4548-9502-c591f3eea2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:42.502335 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6430c03a-213e-4548-9502-c591f3eea2b6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:56:42.502639 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6430c03a-213e-4548-9502-c591f3eea2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:42.504252 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6430c03a-213e-4548-9502-c591f3eea2b6 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:42.513176 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 542/1085] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:56:42 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:42.519182 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abd9da-33d1-4f73-b29f-c6d1cd963bf3 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:42.528952 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abd9da-33d1-4f73-b29f-c6d1cd963bf3 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:42.533412 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea4dcc-02c3-45fb-b6a2-8d51ebb862aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:42.534234 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea4dcc-02c3-45fb-b6a2-8d51ebb862aa admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:42.534514 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea4dcc-02c3-45fb-b6a2-8d51ebb862aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:42.534787 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea4dcc-02c3-45fb-b6a2-8d51ebb862aa admin admin] PATH_INFO: `/v3/users/28a7d4018951460699d1b554d5491473` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:42.535945 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea4dcc-02c3-45fb-b6a2-8d51ebb862aa admin admin] RBAC: Authorizing `identity:get_user(user_id=28a7d4018951460699d1b554d5491473)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:42.538068 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea4dcc-02c3-45fb-b6a2-8d51ebb862aa admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:42.539600 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 544/1086] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:56:42 2021] GET /identity/v3/users/28a7d4018951460699d1b554d5491473 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:42.545395 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430c03a-213e-4548-9502-c591f3eea2b6 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:42.554433 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430c03a-213e-4548-9502-c591f3eea2b6 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:42.559411 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0854f9d-b3bf-44ce-bea7-981e1cc51186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:42.560230 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0854f9d-b3bf-44ce-bea7-981e1cc51186 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:42.560535 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0854f9d-b3bf-44ce-bea7-981e1cc51186 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:42.560816 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0854f9d-b3bf-44ce-bea7-981e1cc51186 admin admin] PATH_INFO: `/v3/projects/173a19f04cc142dbaf96746fcb8fd39d` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:42.561965 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0854f9d-b3bf-44ce-bea7-981e1cc51186 admin admin] RBAC: Authorizing `identity:get_project(project_id=173a19f04cc142dbaf96746fcb8fd39d)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:42.563948 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0854f9d-b3bf-44ce-bea7-981e1cc51186 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:42.565562 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 543/1087] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:56:42 2021] GET /identity/v3/projects/173a19f04cc142dbaf96746fcb8fd39d => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:56:42.571383 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea4dcc-02c3-45fb-b6a2-8d51ebb862aa admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:42.580918 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea4dcc-02c3-45fb-b6a2-8d51ebb862aa admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:42.585431 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db7a96-44bb-4ee9-b3d5-cee9fd71617d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:42.586279 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db7a96-44bb-4ee9-b3d5-cee9fd71617d admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:42.586562 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db7a96-44bb-4ee9-b3d5-cee9fd71617d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:42.586841 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db7a96-44bb-4ee9-b3d5-cee9fd71617d admin admin] PATH_INFO: `/v3/projects/173a19f04cc142dbaf96746fcb8fd39d/users/28a7d4018951460699d1b554d5491473/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:42.588792 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db7a96-44bb-4ee9-b3d5-cee9fd71617d admin admin] RBAC: Authorizing `identity:create_grant(project_id=173a19f04cc142dbaf96746fcb8fd39d, user_id=28a7d4018951460699d1b554d5491473, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:42.591312 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db7a96-44bb-4ee9-b3d5-cee9fd71617d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:42.673419 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 545/1088] 10.222.0.23 () {58 vars in 1461 bytes} [Thu Sep 23 02:56:42 2021] PUT /identity/v3/projects/173a19f04cc142dbaf96746fcb8fd39d/users/28a7d4018951460699d1b554d5491473/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 02:56:44.823233 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c881d62-d83e-4532-9a74-a7bd345078c5 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:44.823650 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c881d62-d83e-4532-9a74-a7bd345078c5 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:44.823798 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c881d62-d83e-4532-9a74-a7bd345078c5 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:44.825614 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 544/1089] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:56:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:56:44.832652 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b8879-917b-4300-82d9-fec52e41aeee None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:44.833072 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b8879-917b-4300-82d9-fec52e41aeee None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:44.833209 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b8879-917b-4300-82d9-fec52e41aeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:44.850772 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-654b8879-917b-4300-82d9-fec52e41aeee None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:56:44.851964 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-654b8879-917b-4300-82d9-fec52e41aeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:56:44.906678 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 546/1090] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:56:44 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:56:44.931785 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c881d62-d83e-4532-9a74-a7bd345078c5 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:44.943642 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c881d62-d83e-4532-9a74-a7bd345078c5 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:44.947951 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0731527-4fc9-4241-90ff-09e3e99263f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:44.948758 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0731527-4fc9-4241-90ff-09e3e99263f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:44.949041 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0731527-4fc9-4241-90ff-09e3e99263f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:44.949312 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0731527-4fc9-4241-90ff-09e3e99263f1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:44.959069 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0731527-4fc9-4241-90ff-09e3e99263f1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:56:44.966246 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-c0731527-4fc9-4241-90ff-09e3e99263f1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:56:44.967370 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 545/1091] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:56:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:56:44.973514 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b8879-917b-4300-82d9-fec52e41aeee None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:44.982658 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b8879-917b-4300-82d9-fec52e41aeee None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:44.987118 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605e21f-92d9-4743-a4c0-926a453c09f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:44.987762 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605e21f-92d9-4743-a4c0-926a453c09f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:44.988043 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605e21f-92d9-4743-a4c0-926a453c09f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:44.988318 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605e21f-92d9-4743-a4c0-926a453c09f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:44.989088 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605e21f-92d9-4743-a4c0-926a453c09f9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:56:44.989394 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605e21f-92d9-4743-a4c0-926a453c09f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:44.990974 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605e21f-92d9-4743-a4c0-926a453c09f9 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:44.999327 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 547/1092] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:56:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:45.005272 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0731527-4fc9-4241-90ff-09e3e99263f1 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:45.015642 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0731527-4fc9-4241-90ff-09e3e99263f1 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:45.020123 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684baa0-f50e-4ebc-b2cc-4d28dcd09cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:45.021006 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684baa0-f50e-4ebc-b2cc-4d28dcd09cce admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:45.021287 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684baa0-f50e-4ebc-b2cc-4d28dcd09cce admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:45.021562 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684baa0-f50e-4ebc-b2cc-4d28dcd09cce admin admin] PATH_INFO: `/v3/users/28a7d4018951460699d1b554d5491473` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:45.022727 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684baa0-f50e-4ebc-b2cc-4d28dcd09cce admin admin] RBAC: Authorizing `identity:get_user(user_id=28a7d4018951460699d1b554d5491473)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:45.024896 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684baa0-f50e-4ebc-b2cc-4d28dcd09cce admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:45.026429 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 546/1093] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 02:56:45 2021] GET /identity/v3/users/28a7d4018951460699d1b554d5491473 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:45.032184 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605e21f-92d9-4743-a4c0-926a453c09f9 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:45.041362 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605e21f-92d9-4743-a4c0-926a453c09f9 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:45.045748 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb0aab-6b12-4154-8064-45c7fa399490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:45.046419 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb0aab-6b12-4154-8064-45c7fa399490 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:45.046708 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb0aab-6b12-4154-8064-45c7fa399490 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:45.046979 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb0aab-6b12-4154-8064-45c7fa399490 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:45.054503 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb0aab-6b12-4154-8064-45c7fa399490 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:45.056189 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb0aab-6b12-4154-8064-45c7fa399490 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:45.065709 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 548/1094] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:56:45 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:56:45.076356 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684baa0-f50e-4ebc-b2cc-4d28dcd09cce admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:45.088918 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684baa0-f50e-4ebc-b2cc-4d28dcd09cce admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:45.093547 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801dffff-d9f6-4703-8ca8-6158794ec85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:45.094405 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801dffff-d9f6-4703-8ca8-6158794ec85e admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:45.094685 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801dffff-d9f6-4703-8ca8-6158794ec85e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:45.094960 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801dffff-d9f6-4703-8ca8-6158794ec85e admin admin] PATH_INFO: `/v3/projects/173a19f04cc142dbaf96746fcb8fd39d` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:45.096134 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801dffff-d9f6-4703-8ca8-6158794ec85e admin admin] RBAC: Authorizing `identity:get_project(project_id=173a19f04cc142dbaf96746fcb8fd39d)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:45.098211 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801dffff-d9f6-4703-8ca8-6158794ec85e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:45.099875 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 547/1095] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 02:56:45 2021] GET /identity/v3/projects/173a19f04cc142dbaf96746fcb8fd39d => generated 361 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:56:45.107064 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb0aab-6b12-4154-8064-45c7fa399490 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:56:45.115869 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb0aab-6b12-4154-8064-45c7fa399490 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:56:45.120961 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff29e0-b9c4-46df-b069-ad48e6f117ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:56:45.121599 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff29e0-b9c4-46df-b069-ad48e6f117ed admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:56:45.121880 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff29e0-b9c4-46df-b069-ad48e6f117ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:56:45.122152 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff29e0-b9c4-46df-b069-ad48e6f117ed admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:56:45.122968 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff29e0-b9c4-46df-b069-ad48e6f117ed admin admin] RBAC: Adding query filter params (role.id=3e7d7427203a4a4097e2c9a642b9bf69, scope.project.id=173a19f04cc142dbaf96746fcb8fd39d, user.id=28a7d4018951460699d1b554d5491473) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:56:45.123275 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff29e0-b9c4-46df-b069-ad48e6f117ed admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:56:45.125109 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff29e0-b9c4-46df-b069-ad48e6f117ed admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:56:45.130620 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 549/1096] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:56:45 2021] GET /identity/v3/role_assignments?user.id=28a7d4018951460699d1b554d5491473&scope.project.id=173a19f04cc142dbaf96746fcb8fd39d&role.id=3e7d7427203a4a4097e2c9a642b9bf69 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:57:59.179418 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402e07d-c8d1-476a-8eff-359a3c9d562e None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:57:59.179966 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402e07d-c8d1-476a-8eff-359a3c9d562e None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:57:59.179966 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402e07d-c8d1-476a-8eff-359a3c9d562e None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:57:59.181764 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 548/1097] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:57:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:57:59.188679 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a7e7d-0766-4a61-969f-d9fde41a5178 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:57:59.189118 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a7e7d-0766-4a61-969f-d9fde41a5178 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:57:59.189217 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a7e7d-0766-4a61-969f-d9fde41a5178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:57:59.206873 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-696a7e7d-0766-4a61-969f-d9fde41a5178 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:57:59.213203 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-696a7e7d-0766-4a61-969f-d9fde41a5178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:57:59.216365 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 550/1098] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:57:59 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:57:59.242344 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402e07d-c8d1-476a-8eff-359a3c9d562e None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:57:59.254600 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402e07d-c8d1-476a-8eff-359a3c9d562e None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:57:59.259397 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328a1ac-8d34-4370-8cc2-5aa05ae23a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:57:59.260173 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328a1ac-8d34-4370-8cc2-5aa05ae23a12 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:57:59.260454 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328a1ac-8d34-4370-8cc2-5aa05ae23a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:57:59.260836 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328a1ac-8d34-4370-8cc2-5aa05ae23a12 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:57:59.270801 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328a1ac-8d34-4370-8cc2-5aa05ae23a12 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:57:59.273348 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328a1ac-8d34-4370-8cc2-5aa05ae23a12 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:57:59.290150 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-c328a1ac-8d34-4370-8cc2-5aa05ae23a12 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:57:59.291282 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 549/1099] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:57:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:57:59.297664 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a7e7d-0766-4a61-969f-d9fde41a5178 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:57:59.306741 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a7e7d-0766-4a61-969f-d9fde41a5178 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:57:59.311388 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb70f00-f8a9-4884-a027-939611949e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:57:59.312032 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb70f00-f8a9-4884-a027-939611949e7f admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:57:59.312309 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb70f00-f8a9-4884-a027-939611949e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:57:59.312620 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb70f00-f8a9-4884-a027-939611949e7f admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:57:59.313401 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb70f00-f8a9-4884-a027-939611949e7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:57:59.313705 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb70f00-f8a9-4884-a027-939611949e7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:57:59.315266 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb70f00-f8a9-4884-a027-939611949e7f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:57:59.326548 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 551/1100] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:57:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:57:59.332432 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328a1ac-8d34-4370-8cc2-5aa05ae23a12 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:57:59.342494 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328a1ac-8d34-4370-8cc2-5aa05ae23a12 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:57:59.346918 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226f76d-195b-4b97-8009-2494d5574ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:57:59.347564 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226f76d-195b-4b97-8009-2494d5574ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:57:59.347849 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226f76d-195b-4b97-8009-2494d5574ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:57:59.348126 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226f76d-195b-4b97-8009-2494d5574ea5 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:57:59.348857 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226f76d-195b-4b97-8009-2494d5574ea5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:57:59.351359 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226f76d-195b-4b97-8009-2494d5574ea5 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:57:59.480384 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 550/1101] 10.222.0.23 () {60 vars in 1154 bytes} [Thu Sep 23 02:57:59 2021] POST /identity/v3/users => generated 251 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 02:58:01.659799 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7eea6b-adcd-421c-b00d-f0bc3c867678 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:01.660437 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7eea6b-adcd-421c-b00d-f0bc3c867678 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:01.660596 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7eea6b-adcd-421c-b00d-f0bc3c867678 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:01.662287 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 552/1102] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:58:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:58:01.670116 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ccd0e-92d6-4a30-8dfc-5a858d9f8c9e None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:01.672051 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ccd0e-92d6-4a30-8dfc-5a858d9f8c9e None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:01.672051 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ccd0e-92d6-4a30-8dfc-5a858d9f8c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:01.688961 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-9f8ccd0e-92d6-4a30-8dfc-5a858d9f8c9e None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:58:01.690181 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-9f8ccd0e-92d6-4a30-8dfc-5a858d9f8c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:58:01.697702 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 551/1103] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:58:01 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:58:01.721793 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7eea6b-adcd-421c-b00d-f0bc3c867678 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:01.743417 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7eea6b-adcd-421c-b00d-f0bc3c867678 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:01.749848 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd62387-263d-4761-b3a2-1d4fc6a8dc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:01.750609 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd62387-263d-4761-b3a2-1d4fc6a8dc1e admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:01.750890 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd62387-263d-4761-b3a2-1d4fc6a8dc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:01.751163 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd62387-263d-4761-b3a2-1d4fc6a8dc1e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:01.762462 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd62387-263d-4761-b3a2-1d4fc6a8dc1e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:58:01.769360 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-bcd62387-263d-4761-b3a2-1d4fc6a8dc1e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 02:58:01.770567 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 553/1104] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 23 02:58:01 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:58:01.777207 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ccd0e-92d6-4a30-8dfc-5a858d9f8c9e None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:01.786437 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ccd0e-92d6-4a30-8dfc-5a858d9f8c9e None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:01.791511 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f843288-fff7-4b44-8c98-6c72c726366d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:01.792171 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f843288-fff7-4b44-8c98-6c72c726366d admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:01.792450 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f843288-fff7-4b44-8c98-6c72c726366d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:01.792755 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f843288-fff7-4b44-8c98-6c72c726366d admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:01.793488 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f843288-fff7-4b44-8c98-6c72c726366d admin admin] RBAC: Adding query filter params (name=service) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:01.793817 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f843288-fff7-4b44-8c98-6c72c726366d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:01.795395 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f843288-fff7-4b44-8c98-6c72c726366d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:01.803955 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 552/1105] 10.222.0.23 () {56 vars in 1125 bytes} [Thu Sep 23 02:58:01 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:58:01.811135 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd62387-263d-4761-b3a2-1d4fc6a8dc1e admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:01.821570 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd62387-263d-4761-b3a2-1d4fc6a8dc1e admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:01.825658 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e03e2f-11a9-4735-afda-f0d80df86f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:01.826447 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e03e2f-11a9-4735-afda-f0d80df86f80 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:01.826728 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e03e2f-11a9-4735-afda-f0d80df86f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:01.827008 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e03e2f-11a9-4735-afda-f0d80df86f80 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:01.837127 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e03e2f-11a9-4735-afda-f0d80df86f80 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:01.839073 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e03e2f-11a9-4735-afda-f0d80df86f80 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:01.855787 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-e2e03e2f-11a9-4735-afda-f0d80df86f80 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:58:01.856936 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 554/1106] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:58:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:58:01.863224 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f843288-fff7-4b44-8c98-6c72c726366d admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:01.873412 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f843288-fff7-4b44-8c98-6c72c726366d admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:01.877960 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741bcf2-4135-4800-9e0f-cdcef6f4ebc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:01.878608 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741bcf2-4135-4800-9e0f-cdcef6f4ebc9 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:01.878887 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741bcf2-4135-4800-9e0f-cdcef6f4ebc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:01.879241 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741bcf2-4135-4800-9e0f-cdcef6f4ebc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:01.879980 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741bcf2-4135-4800-9e0f-cdcef6f4ebc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:01.880286 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741bcf2-4135-4800-9e0f-cdcef6f4ebc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:01.881948 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741bcf2-4135-4800-9e0f-cdcef6f4ebc9 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:01.893657 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 553/1107] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:58:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:01.899690 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e03e2f-11a9-4735-afda-f0d80df86f80 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:01.909161 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e03e2f-11a9-4735-afda-f0d80df86f80 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:01.914210 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc08d5c-e557-40af-bcfc-e33f1e1b20aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:01.914935 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc08d5c-e557-40af-bcfc-e33f1e1b20aa admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:01.915217 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc08d5c-e557-40af-bcfc-e33f1e1b20aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:01.915498 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc08d5c-e557-40af-bcfc-e33f1e1b20aa admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:01.922555 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc08d5c-e557-40af-bcfc-e33f1e1b20aa admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:01.924571 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc08d5c-e557-40af-bcfc-e33f1e1b20aa admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:01.938484 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-3dc08d5c-e557-40af-bcfc-e33f1e1b20aa admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 02:58:01.939572 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 555/1108] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:58:01 2021] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:58:01.945543 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741bcf2-4135-4800-9e0f-cdcef6f4ebc9 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:01.954984 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741bcf2-4135-4800-9e0f-cdcef6f4ebc9 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:01.959634 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba282a6-4b48-485d-be5b-6e2eba086ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:01.960295 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba282a6-4b48-485d-be5b-6e2eba086ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:01.960612 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba282a6-4b48-485d-be5b-6e2eba086ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:01.960891 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba282a6-4b48-485d-be5b-6e2eba086ec8 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:01.961716 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba282a6-4b48-485d-be5b-6e2eba086ec8 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:01.962027 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba282a6-4b48-485d-be5b-6e2eba086ec8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:01.963848 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba282a6-4b48-485d-be5b-6e2eba086ec8 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:01.981033 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 554/1109] 10.222.0.23 () {56 vars in 1165 bytes} [Thu Sep 23 02:58:01 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:58:01.987320 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc08d5c-e557-40af-bcfc-e33f1e1b20aa admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:01.996867 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc08d5c-e557-40af-bcfc-e33f1e1b20aa admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:02.001395 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df390b4-0393-4fd3-ade3-4916455a25bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:02.002023 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df390b4-0393-4fd3-ade3-4916455a25bf admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:02.002305 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df390b4-0393-4fd3-ade3-4916455a25bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:02.002583 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df390b4-0393-4fd3-ade3-4916455a25bf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:02.010349 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df390b4-0393-4fd3-ade3-4916455a25bf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:02.012066 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df390b4-0393-4fd3-ade3-4916455a25bf admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:02.020752 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 556/1110] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:58:01 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:58:02.027211 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba282a6-4b48-485d-be5b-6e2eba086ec8 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:02.036645 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba282a6-4b48-485d-be5b-6e2eba086ec8 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:02.041740 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47866e76-957e-4500-bac0-cca3a0ddd588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:02.042562 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47866e76-957e-4500-bac0-cca3a0ddd588 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:02.042853 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47866e76-957e-4500-bac0-cca3a0ddd588 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:02.043136 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47866e76-957e-4500-bac0-cca3a0ddd588 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:02.055205 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47866e76-957e-4500-bac0-cca3a0ddd588 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:02.068989 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47866e76-957e-4500-bac0-cca3a0ddd588 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:02.074097 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-47866e76-957e-4500-bac0-cca3a0ddd588 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:58:02.075280 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 555/1111] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:58:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:58:02.081678 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df390b4-0393-4fd3-ade3-4916455a25bf admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:02.091441 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df390b4-0393-4fd3-ade3-4916455a25bf admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:02.096060 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981f603-a76d-404f-a683-3f6b641e40ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:02.100014 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981f603-a76d-404f-a683-3f6b641e40ad admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:02.100014 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981f603-a76d-404f-a683-3f6b641e40ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:02.100014 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981f603-a76d-404f-a683-3f6b641e40ad admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:02.100014 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981f603-a76d-404f-a683-3f6b641e40ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:02.100014 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981f603-a76d-404f-a683-3f6b641e40ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:02.100014 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981f603-a76d-404f-a683-3f6b641e40ad admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:02.111724 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 557/1112] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:58:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:02.117952 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47866e76-957e-4500-bac0-cca3a0ddd588 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:02.127474 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47866e76-957e-4500-bac0-cca3a0ddd588 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:02.132119 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a40ff-6a33-477a-b78b-71c4f07f53a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:02.133185 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a40ff-6a33-477a-b78b-71c4f07f53a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:02.133465 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a40ff-6a33-477a-b78b-71c4f07f53a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:02.133740 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a40ff-6a33-477a-b78b-71c4f07f53a9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:02.140408 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a40ff-6a33-477a-b78b-71c4f07f53a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:02.142367 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a40ff-6a33-477a-b78b-71c4f07f53a9 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:02.155376 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-426a40ff-6a33-477a-b78b-71c4f07f53a9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:58:02.156503 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 556/1113] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:58:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:58:02.163300 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981f603-a76d-404f-a683-3f6b641e40ad admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:02.172885 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981f603-a76d-404f-a683-3f6b641e40ad admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:02.177419 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5abe7-1ead-4c43-be55-1708966b7f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:02.178060 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5abe7-1ead-4c43-be55-1708966b7f62 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:02.178336 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5abe7-1ead-4c43-be55-1708966b7f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:02.178609 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5abe7-1ead-4c43-be55-1708966b7f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:02.179392 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5abe7-1ead-4c43-be55-1708966b7f62 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:02.179699 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5abe7-1ead-4c43-be55-1708966b7f62 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:02.181601 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5abe7-1ead-4c43-be55-1708966b7f62 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:02.194491 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 558/1114] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:58:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:02.200982 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a40ff-6a33-477a-b78b-71c4f07f53a9 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:02.211788 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a40ff-6a33-477a-b78b-71c4f07f53a9 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:02.216277 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba6ec2-2ed9-423f-b69b-d03899604394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:02.218386 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba6ec2-2ed9-423f-b69b-d03899604394 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:02.218386 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba6ec2-2ed9-423f-b69b-d03899604394 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:02.218386 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba6ec2-2ed9-423f-b69b-d03899604394 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:02.218386 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba6ec2-2ed9-423f-b69b-d03899604394 admin admin] RBAC: Adding query filter params (role.id=8e064794445b4039b2cf2d06b26b49de, scope.project.id=73dcb70ac3714a428a717707e6be8201, user.id=58b7e780a23e4ee499cb7820a85feccb) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:02.218786 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba6ec2-2ed9-423f-b69b-d03899604394 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:02.220364 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba6ec2-2ed9-423f-b69b-d03899604394 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:02.226138 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 557/1115] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:58:02 2021] GET /identity/v3/role_assignments?user.id=58b7e780a23e4ee499cb7820a85feccb&scope.project.id=73dcb70ac3714a428a717707e6be8201&role.id=8e064794445b4039b2cf2d06b26b49de => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:04.337584 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f77758-e00c-47ea-bf88-79ecc962e760 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:04.338144 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f77758-e00c-47ea-bf88-79ecc962e760 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:04.338144 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f77758-e00c-47ea-bf88-79ecc962e760 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:04.339872 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 559/1116] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:58:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:58:04.347157 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c6b91-8bcf-4ed6-938f-09a791810e72 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:04.347572 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c6b91-8bcf-4ed6-938f-09a791810e72 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:04.352066 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c6b91-8bcf-4ed6-938f-09a791810e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:04.365928 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-799c6b91-8bcf-4ed6-938f-09a791810e72 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:58:04.367093 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-799c6b91-8bcf-4ed6-938f-09a791810e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:58:04.374720 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 558/1117] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:58:04 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:58:04.404917 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f77758-e00c-47ea-bf88-79ecc962e760 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:04.418426 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f77758-e00c-47ea-bf88-79ecc962e760 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:04.422858 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64e740-efbd-42a8-84e1-f8abdca68204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:04.423639 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64e740-efbd-42a8-84e1-f8abdca68204 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:04.423918 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64e740-efbd-42a8-84e1-f8abdca68204 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:04.424193 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64e740-efbd-42a8-84e1-f8abdca68204 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:04.434265 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64e740-efbd-42a8-84e1-f8abdca68204 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:58:04.440979 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-1b64e740-efbd-42a8-84e1-f8abdca68204 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 02:58:04.442170 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 560/1118] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 23 02:58:04 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:58:04.448632 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c6b91-8bcf-4ed6-938f-09a791810e72 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:04.457551 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c6b91-8bcf-4ed6-938f-09a791810e72 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:04.462597 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30a4dc-7587-40fa-a98f-58cb1437030b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:04.463250 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30a4dc-7587-40fa-a98f-58cb1437030b admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:04.463926 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30a4dc-7587-40fa-a98f-58cb1437030b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:04.463926 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30a4dc-7587-40fa-a98f-58cb1437030b admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:04.464598 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30a4dc-7587-40fa-a98f-58cb1437030b admin admin] RBAC: Adding query filter params (name=service) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:04.464906 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30a4dc-7587-40fa-a98f-58cb1437030b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:04.466507 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30a4dc-7587-40fa-a98f-58cb1437030b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:04.474269 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 559/1119] 10.222.0.23 () {56 vars in 1125 bytes} [Thu Sep 23 02:58:04 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:04.481027 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64e740-efbd-42a8-84e1-f8abdca68204 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:04.491017 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64e740-efbd-42a8-84e1-f8abdca68204 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:04.495544 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72c1e1-5c56-47a0-b9c3-6bf5dff45a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:04.496309 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72c1e1-5c56-47a0-b9c3-6bf5dff45a9e admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:04.496625 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72c1e1-5c56-47a0-b9c3-6bf5dff45a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:04.496900 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72c1e1-5c56-47a0-b9c3-6bf5dff45a9e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:04.506976 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72c1e1-5c56-47a0-b9c3-6bf5dff45a9e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:04.509160 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72c1e1-5c56-47a0-b9c3-6bf5dff45a9e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:04.525890 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-ec72c1e1-5c56-47a0-b9c3-6bf5dff45a9e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:58:04.527029 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 561/1120] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:58:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:58:04.539544 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30a4dc-7587-40fa-a98f-58cb1437030b admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:04.549198 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30a4dc-7587-40fa-a98f-58cb1437030b admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:04.553891 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790f801-298a-4d88-83d2-17b2dca3f47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:04.554548 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790f801-298a-4d88-83d2-17b2dca3f47a admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:04.554831 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790f801-298a-4d88-83d2-17b2dca3f47a admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:04.555111 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790f801-298a-4d88-83d2-17b2dca3f47a admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:04.555885 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790f801-298a-4d88-83d2-17b2dca3f47a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:04.556199 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790f801-298a-4d88-83d2-17b2dca3f47a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:04.557821 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790f801-298a-4d88-83d2-17b2dca3f47a admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:04.569269 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 560/1121] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:58:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:04.575357 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72c1e1-5c56-47a0-b9c3-6bf5dff45a9e admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:04.585533 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72c1e1-5c56-47a0-b9c3-6bf5dff45a9e admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:04.590188 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87840ac3-0872-4999-a9b1-fcb558eb1f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:04.590786 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87840ac3-0872-4999-a9b1-fcb558eb1f46 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:04.591063 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87840ac3-0872-4999-a9b1-fcb558eb1f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:04.591334 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87840ac3-0872-4999-a9b1-fcb558eb1f46 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:04.598399 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87840ac3-0872-4999-a9b1-fcb558eb1f46 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:04.600980 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87840ac3-0872-4999-a9b1-fcb558eb1f46 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:04.615204 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-87840ac3-0872-4999-a9b1-fcb558eb1f46 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 02:58:04.625547 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 562/1122] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:58:04 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:58:04.625651 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790f801-298a-4d88-83d2-17b2dca3f47a admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:04.632973 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790f801-298a-4d88-83d2-17b2dca3f47a admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:04.637490 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10096a-86a5-4dc3-95e2-3bdbcc9fef8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:04.638144 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10096a-86a5-4dc3-95e2-3bdbcc9fef8d admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:04.638470 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10096a-86a5-4dc3-95e2-3bdbcc9fef8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:04.638747 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10096a-86a5-4dc3-95e2-3bdbcc9fef8d admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:04.639570 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10096a-86a5-4dc3-95e2-3bdbcc9fef8d admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:04.639881 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10096a-86a5-4dc3-95e2-3bdbcc9fef8d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:04.641749 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10096a-86a5-4dc3-95e2-3bdbcc9fef8d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:04.658895 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 561/1123] 10.222.0.23 () {56 vars in 1165 bytes} [Thu Sep 23 02:58:04 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:04.665085 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87840ac3-0872-4999-a9b1-fcb558eb1f46 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:04.674521 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87840ac3-0872-4999-a9b1-fcb558eb1f46 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:04.679130 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fa386-0f8a-4d29-9606-c2cd1482d20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:04.679930 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fa386-0f8a-4d29-9606-c2cd1482d20a admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:04.680201 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fa386-0f8a-4d29-9606-c2cd1482d20a admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:04.680474 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fa386-0f8a-4d29-9606-c2cd1482d20a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:04.690516 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fa386-0f8a-4d29-9606-c2cd1482d20a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:04.692303 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fa386-0f8a-4d29-9606-c2cd1482d20a admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:04.708890 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-cd1fa386-0f8a-4d29-9606-c2cd1482d20a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:58:04.710554 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 563/1124] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:58:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:58:04.716617 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10096a-86a5-4dc3-95e2-3bdbcc9fef8d admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:04.726108 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10096a-86a5-4dc3-95e2-3bdbcc9fef8d admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:04.734077 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb60f2-da51-48c2-aa42-6c1f327d246c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:04.734726 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb60f2-da51-48c2-aa42-6c1f327d246c admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:04.735011 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb60f2-da51-48c2-aa42-6c1f327d246c admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:04.735319 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb60f2-da51-48c2-aa42-6c1f327d246c admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:04.736029 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb60f2-da51-48c2-aa42-6c1f327d246c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:04.736336 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb60f2-da51-48c2-aa42-6c1f327d246c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:04.737968 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb60f2-da51-48c2-aa42-6c1f327d246c admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:04.749046 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 562/1125] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:58:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:04.754973 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fa386-0f8a-4d29-9606-c2cd1482d20a admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:04.765212 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fa386-0f8a-4d29-9606-c2cd1482d20a admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:04.769705 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5a88b-11ef-4e6f-bef7-15ef752fb246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:04.770471 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5a88b-11ef-4e6f-bef7-15ef752fb246 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:04.774346 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5a88b-11ef-4e6f-bef7-15ef752fb246 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:04.774346 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5a88b-11ef-4e6f-bef7-15ef752fb246 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:04.778298 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5a88b-11ef-4e6f-bef7-15ef752fb246 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:04.780219 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5a88b-11ef-4e6f-bef7-15ef752fb246 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:04.792841 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-5cc5a88b-11ef-4e6f-bef7-15ef752fb246 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:58:04.793969 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 564/1126] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:58:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:58:04.800234 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb60f2-da51-48c2-aa42-6c1f327d246c admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:04.810111 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb60f2-da51-48c2-aa42-6c1f327d246c admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:04.814676 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37553b21-3dd2-4ff5-9879-7418c923e9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:04.815341 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37553b21-3dd2-4ff5-9879-7418c923e9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:04.815626 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37553b21-3dd2-4ff5-9879-7418c923e9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:04.815905 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37553b21-3dd2-4ff5-9879-7418c923e9f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:04.816738 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37553b21-3dd2-4ff5-9879-7418c923e9f0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:04.817036 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37553b21-3dd2-4ff5-9879-7418c923e9f0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:04.819518 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37553b21-3dd2-4ff5-9879-7418c923e9f0 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:04.832459 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 563/1127] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:58:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:04.839565 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5a88b-11ef-4e6f-bef7-15ef752fb246 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:04.850011 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5a88b-11ef-4e6f-bef7-15ef752fb246 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:04.854495 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d9628-b4d1-40f1-87d8-725070c9883d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:04.855372 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d9628-b4d1-40f1-87d8-725070c9883d admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:04.855661 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d9628-b4d1-40f1-87d8-725070c9883d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:04.855931 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d9628-b4d1-40f1-87d8-725070c9883d admin admin] PATH_INFO: `/v3/projects/73dcb70ac3714a428a717707e6be8201/users/58b7e780a23e4ee499cb7820a85feccb/roles/8e064794445b4039b2cf2d06b26b49de` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:04.869664 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d9628-b4d1-40f1-87d8-725070c9883d admin admin] RBAC: Authorizing `identity:create_grant(project_id=73dcb70ac3714a428a717707e6be8201, user_id=58b7e780a23e4ee499cb7820a85feccb, role_id=8e064794445b4039b2cf2d06b26b49de)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:04.872296 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d9628-b4d1-40f1-87d8-725070c9883d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:04.952768 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 565/1128] 10.222.0.23 () {58 vars in 1461 bytes} [Thu Sep 23 02:58:04 2021] PUT /identity/v3/projects/73dcb70ac3714a428a717707e6be8201/users/58b7e780a23e4ee499cb7820a85feccb/roles/8e064794445b4039b2cf2d06b26b49de => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 02:58:07.137180 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7233607-e75c-4df8-9e48-d840f6ad506d None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:07.137716 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7233607-e75c-4df8-9e48-d840f6ad506d None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:07.137716 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7233607-e75c-4df8-9e48-d840f6ad506d None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:07.139468 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 564/1129] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:58:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:58:07.147578 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4f466-39d9-4745-80c4-21411369f365 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:07.150077 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4f466-39d9-4745-80c4-21411369f365 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:07.150077 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4f466-39d9-4745-80c4-21411369f365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:07.166775 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-d7b4f466-39d9-4745-80c4-21411369f365 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:58:07.168012 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-d7b4f466-39d9-4745-80c4-21411369f365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:58:07.228309 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 566/1130] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:58:07 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:58:07.257084 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7233607-e75c-4df8-9e48-d840f6ad506d None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:07.271255 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7233607-e75c-4df8-9e48-d840f6ad506d None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:07.275540 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97be96d-ce44-471a-840e-dad8199d9c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:07.276318 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97be96d-ce44-471a-840e-dad8199d9c04 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:07.276631 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97be96d-ce44-471a-840e-dad8199d9c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:07.276904 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97be96d-ce44-471a-840e-dad8199d9c04 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:07.286709 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97be96d-ce44-471a-840e-dad8199d9c04 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:58:07.293365 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-d97be96d-ce44-471a-840e-dad8199d9c04 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 02:58:07.294771 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 565/1131] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 23 02:58:07 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:58:07.301370 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4f466-39d9-4745-80c4-21411369f365 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:07.310892 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4f466-39d9-4745-80c4-21411369f365 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:07.315549 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e1e66-752a-4bd1-859a-43ee86b9d839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:07.316216 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e1e66-752a-4bd1-859a-43ee86b9d839 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:07.316537 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e1e66-752a-4bd1-859a-43ee86b9d839 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:07.316802 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e1e66-752a-4bd1-859a-43ee86b9d839 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:07.317608 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e1e66-752a-4bd1-859a-43ee86b9d839 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:07.317910 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e1e66-752a-4bd1-859a-43ee86b9d839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:07.320105 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e1e66-752a-4bd1-859a-43ee86b9d839 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:07.329477 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 567/1132] 10.222.0.23 () {56 vars in 1125 bytes} [Thu Sep 23 02:58:07 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:07.336194 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97be96d-ce44-471a-840e-dad8199d9c04 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:07.345822 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97be96d-ce44-471a-840e-dad8199d9c04 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:07.350323 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcabbe-ab18-4f64-97a2-854ffcc073f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:07.354474 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcabbe-ab18-4f64-97a2-854ffcc073f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:07.354474 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcabbe-ab18-4f64-97a2-854ffcc073f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:07.354474 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcabbe-ab18-4f64-97a2-854ffcc073f3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:07.363235 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcabbe-ab18-4f64-97a2-854ffcc073f3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:07.365106 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcabbe-ab18-4f64-97a2-854ffcc073f3 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:07.381902 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-6bbcabbe-ab18-4f64-97a2-854ffcc073f3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:58:07.383429 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 566/1133] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:58:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:58:07.389977 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e1e66-752a-4bd1-859a-43ee86b9d839 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:07.400904 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e1e66-752a-4bd1-859a-43ee86b9d839 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:07.405607 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d814c-e4ff-4c83-a90e-1be1affa2690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:07.406268 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d814c-e4ff-4c83-a90e-1be1affa2690 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:07.406551 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d814c-e4ff-4c83-a90e-1be1affa2690 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:07.406830 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d814c-e4ff-4c83-a90e-1be1affa2690 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:07.407550 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d814c-e4ff-4c83-a90e-1be1affa2690 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:07.407860 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d814c-e4ff-4c83-a90e-1be1affa2690 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:07.409533 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d814c-e4ff-4c83-a90e-1be1affa2690 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:07.422360 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 568/1134] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:58:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:07.429355 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcabbe-ab18-4f64-97a2-854ffcc073f3 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:07.441236 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcabbe-ab18-4f64-97a2-854ffcc073f3 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:07.446875 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f70336-a47a-404b-87d9-e7e092b49f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:07.447674 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f70336-a47a-404b-87d9-e7e092b49f53 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:07.447953 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f70336-a47a-404b-87d9-e7e092b49f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:07.448226 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f70336-a47a-404b-87d9-e7e092b49f53 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:07.459636 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f70336-a47a-404b-87d9-e7e092b49f53 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:07.461697 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f70336-a47a-404b-87d9-e7e092b49f53 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:07.477031 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-b0f70336-a47a-404b-87d9-e7e092b49f53 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 02:58:07.478480 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 567/1135] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:58:07 2021] GET /identity/v3/users/placement => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:58:07.486115 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d814c-e4ff-4c83-a90e-1be1affa2690 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:07.496221 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d814c-e4ff-4c83-a90e-1be1affa2690 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:07.502251 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34876b00-273f-48bc-bb77-d4c629e4b08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:07.503138 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34876b00-273f-48bc-bb77-d4c629e4b08b admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:07.503429 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34876b00-273f-48bc-bb77-d4c629e4b08b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:07.503701 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34876b00-273f-48bc-bb77-d4c629e4b08b admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:07.506023 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34876b00-273f-48bc-bb77-d4c629e4b08b admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:07.506023 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34876b00-273f-48bc-bb77-d4c629e4b08b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:07.507524 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34876b00-273f-48bc-bb77-d4c629e4b08b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:07.524752 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 569/1136] 10.222.0.23 () {56 vars in 1165 bytes} [Thu Sep 23 02:58:07 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:07.532690 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f70336-a47a-404b-87d9-e7e092b49f53 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:07.542447 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f70336-a47a-404b-87d9-e7e092b49f53 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:07.547286 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e50bfe-c569-427e-9257-f7f33635fa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:07.547868 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e50bfe-c569-427e-9257-f7f33635fa0e admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:07.548145 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e50bfe-c569-427e-9257-f7f33635fa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:07.548420 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e50bfe-c569-427e-9257-f7f33635fa0e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:07.558541 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e50bfe-c569-427e-9257-f7f33635fa0e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:07.560281 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e50bfe-c569-427e-9257-f7f33635fa0e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:07.569571 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 568/1137] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:58:07 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:58:07.576096 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34876b00-273f-48bc-bb77-d4c629e4b08b admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:07.588402 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34876b00-273f-48bc-bb77-d4c629e4b08b admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:07.593048 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1284f7e-51d7-49c5-9450-3dcbd47b11c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:07.595646 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1284f7e-51d7-49c5-9450-3dcbd47b11c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:07.595646 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1284f7e-51d7-49c5-9450-3dcbd47b11c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:07.595646 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1284f7e-51d7-49c5-9450-3dcbd47b11c9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:07.605413 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1284f7e-51d7-49c5-9450-3dcbd47b11c9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:07.607304 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1284f7e-51d7-49c5-9450-3dcbd47b11c9 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:07.624253 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-f1284f7e-51d7-49c5-9450-3dcbd47b11c9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:58:07.626548 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 570/1138] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:58:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:58:07.633116 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e50bfe-c569-427e-9257-f7f33635fa0e admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:07.642997 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e50bfe-c569-427e-9257-f7f33635fa0e admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:07.650823 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac42c47-b71b-48bf-99b4-ad78442802d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:07.651494 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac42c47-b71b-48bf-99b4-ad78442802d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:07.651776 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac42c47-b71b-48bf-99b4-ad78442802d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:07.652052 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac42c47-b71b-48bf-99b4-ad78442802d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:07.652818 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac42c47-b71b-48bf-99b4-ad78442802d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:07.653188 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac42c47-b71b-48bf-99b4-ad78442802d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:07.654775 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac42c47-b71b-48bf-99b4-ad78442802d5 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:07.667697 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 569/1139] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:58:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:07.674324 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1284f7e-51d7-49c5-9450-3dcbd47b11c9 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:07.684997 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1284f7e-51d7-49c5-9450-3dcbd47b11c9 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:07.689923 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca58f6a-c224-485e-a1b4-cd0e988c0c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:07.690797 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca58f6a-c224-485e-a1b4-cd0e988c0c54 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:07.691083 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca58f6a-c224-485e-a1b4-cd0e988c0c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:07.691363 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca58f6a-c224-485e-a1b4-cd0e988c0c54 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:07.698414 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca58f6a-c224-485e-a1b4-cd0e988c0c54 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:07.700512 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca58f6a-c224-485e-a1b4-cd0e988c0c54 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:07.713557 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-aca58f6a-c224-485e-a1b4-cd0e988c0c54 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:58:07.714707 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 571/1140] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:58:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:58:07.721237 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac42c47-b71b-48bf-99b4-ad78442802d5 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:07.731241 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac42c47-b71b-48bf-99b4-ad78442802d5 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:07.735733 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2dfc3-bdbc-47fa-a8c1-20486a4dd773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:07.736384 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2dfc3-bdbc-47fa-a8c1-20486a4dd773 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:07.736698 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2dfc3-bdbc-47fa-a8c1-20486a4dd773 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:07.736977 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2dfc3-bdbc-47fa-a8c1-20486a4dd773 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:07.737755 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2dfc3-bdbc-47fa-a8c1-20486a4dd773 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:07.738063 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2dfc3-bdbc-47fa-a8c1-20486a4dd773 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:07.739879 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2dfc3-bdbc-47fa-a8c1-20486a4dd773 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:07.751719 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 570/1141] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:58:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:07.758528 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca58f6a-c224-485e-a1b4-cd0e988c0c54 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:07.768863 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca58f6a-c224-485e-a1b4-cd0e988c0c54 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:07.773773 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d6c0c-3eb4-449d-885b-006fa4418e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:07.774410 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d6c0c-3eb4-449d-885b-006fa4418e16 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:07.774696 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d6c0c-3eb4-449d-885b-006fa4418e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:07.774976 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d6c0c-3eb4-449d-885b-006fa4418e16 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:07.775800 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d6c0c-3eb4-449d-885b-006fa4418e16 admin admin] RBAC: Adding query filter params (role.id=8e064794445b4039b2cf2d06b26b49de, scope.project.id=73dcb70ac3714a428a717707e6be8201, user.id=58b7e780a23e4ee499cb7820a85feccb) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:07.776114 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d6c0c-3eb4-449d-885b-006fa4418e16 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:07.777985 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d6c0c-3eb4-449d-885b-006fa4418e16 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:07.783661 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 572/1142] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:58:07 2021] GET /identity/v3/role_assignments?user.id=58b7e780a23e4ee499cb7820a85feccb&scope.project.id=73dcb70ac3714a428a717707e6be8201&role.id=8e064794445b4039b2cf2d06b26b49de => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:10.035486 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51944fae-b952-4cfa-8be3-77dbd4179276 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:10.036009 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51944fae-b952-4cfa-8be3-77dbd4179276 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:10.036141 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51944fae-b952-4cfa-8be3-77dbd4179276 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:10.038437 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 571/1143] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:58:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:58:10.045948 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ffd98-35b6-4d05-88e0-897dd81f8ada None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:10.046358 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ffd98-35b6-4d05-88e0-897dd81f8ada None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:10.046498 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ffd98-35b6-4d05-88e0-897dd81f8ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:10.065072 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-8e7ffd98-35b6-4d05-88e0-897dd81f8ada None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:58:10.066261 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-8e7ffd98-35b6-4d05-88e0-897dd81f8ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:58:10.074112 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 573/1144] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:58:10 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:58:10.098674 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51944fae-b952-4cfa-8be3-77dbd4179276 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:10.111599 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51944fae-b952-4cfa-8be3-77dbd4179276 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:10.116523 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c7e90-26cf-445b-bf14-da7ab67d3d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:10.117304 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c7e90-26cf-445b-bf14-da7ab67d3d07 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:10.117585 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c7e90-26cf-445b-bf14-da7ab67d3d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:10.117904 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c7e90-26cf-445b-bf14-da7ab67d3d07 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:10.127761 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c7e90-26cf-445b-bf14-da7ab67d3d07 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:58:10.134765 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-651c7e90-26cf-445b-bf14-da7ab67d3d07 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:58:10.135934 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 572/1145] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:58:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:58:10.142467 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ffd98-35b6-4d05-88e0-897dd81f8ada None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:10.151342 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ffd98-35b6-4d05-88e0-897dd81f8ada None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:10.155884 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5c3de-ac82-47c4-ab3c-5a8cc933c388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:10.156569 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5c3de-ac82-47c4-ab3c-5a8cc933c388 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:10.156851 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5c3de-ac82-47c4-ab3c-5a8cc933c388 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:10.157123 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5c3de-ac82-47c4-ab3c-5a8cc933c388 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:10.157871 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5c3de-ac82-47c4-ab3c-5a8cc933c388 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:10.158189 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5c3de-ac82-47c4-ab3c-5a8cc933c388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:10.159779 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5c3de-ac82-47c4-ab3c-5a8cc933c388 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:10.168397 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 574/1146] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:58:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:10.174638 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c7e90-26cf-445b-bf14-da7ab67d3d07 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:10.185195 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c7e90-26cf-445b-bf14-da7ab67d3d07 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:10.189778 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f545a9c-ca83-4167-811d-bde2e28b3ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:10.190543 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f545a9c-ca83-4167-811d-bde2e28b3ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:10.190821 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f545a9c-ca83-4167-811d-bde2e28b3ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:10.191092 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f545a9c-ca83-4167-811d-bde2e28b3ee1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:10.201021 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f545a9c-ca83-4167-811d-bde2e28b3ee1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:10.203301 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f545a9c-ca83-4167-811d-bde2e28b3ee1 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:10.219227 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-6f545a9c-ca83-4167-811d-bde2e28b3ee1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:58:10.220360 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 573/1147] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:58:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:58:10.226997 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5c3de-ac82-47c4-ab3c-5a8cc933c388 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:10.236456 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5c3de-ac82-47c4-ab3c-5a8cc933c388 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:10.241524 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af53cc3-c147-4281-ba48-6410eefcb819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:10.242168 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af53cc3-c147-4281-ba48-6410eefcb819 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:10.245130 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af53cc3-c147-4281-ba48-6410eefcb819 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:10.245130 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af53cc3-c147-4281-ba48-6410eefcb819 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:10.245130 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af53cc3-c147-4281-ba48-6410eefcb819 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:10.245130 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af53cc3-c147-4281-ba48-6410eefcb819 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:10.245439 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af53cc3-c147-4281-ba48-6410eefcb819 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:10.256634 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 575/1148] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:58:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:10.263064 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f545a9c-ca83-4167-811d-bde2e28b3ee1 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:10.273871 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f545a9c-ca83-4167-811d-bde2e28b3ee1 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:10.278563 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79cd2f8-921f-41cb-92b6-4838867bee50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:10.279347 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cd2f8-921f-41cb-92b6-4838867bee50 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:10.279627 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cd2f8-921f-41cb-92b6-4838867bee50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:10.279905 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cd2f8-921f-41cb-92b6-4838867bee50 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:10.287063 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79cd2f8-921f-41cb-92b6-4838867bee50 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:10.289845 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79cd2f8-921f-41cb-92b6-4838867bee50 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:10.303802 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-b79cd2f8-921f-41cb-92b6-4838867bee50 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 02:58:10.305011 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 574/1149] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:58:10 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:58:10.311281 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af53cc3-c147-4281-ba48-6410eefcb819 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:10.321447 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af53cc3-c147-4281-ba48-6410eefcb819 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:10.326044 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca2a65-17c4-44b0-b834-7a46127b55ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:10.326645 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca2a65-17c4-44b0-b834-7a46127b55ec admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:10.326952 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca2a65-17c4-44b0-b834-7a46127b55ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:10.327222 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca2a65-17c4-44b0-b834-7a46127b55ec admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:10.328046 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca2a65-17c4-44b0-b834-7a46127b55ec admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:10.328347 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca2a65-17c4-44b0-b834-7a46127b55ec admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:10.330233 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca2a65-17c4-44b0-b834-7a46127b55ec admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:10.349166 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 576/1150] 10.222.0.23 () {56 vars in 1165 bytes} [Thu Sep 23 02:58:10 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:10.355980 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79cd2f8-921f-41cb-92b6-4838867bee50 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:10.365574 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79cd2f8-921f-41cb-92b6-4838867bee50 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:10.370124 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c71fba-2ec8-4f34-a46a-87ca1f60ae8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:10.370756 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c71fba-2ec8-4f34-a46a-87ca1f60ae8e admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:10.371038 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c71fba-2ec8-4f34-a46a-87ca1f60ae8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:10.371314 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c71fba-2ec8-4f34-a46a-87ca1f60ae8e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:10.378838 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c71fba-2ec8-4f34-a46a-87ca1f60ae8e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:10.380592 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c71fba-2ec8-4f34-a46a-87ca1f60ae8e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:10.389580 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 575/1151] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:58:10 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 02:58:10.395806 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca2a65-17c4-44b0-b834-7a46127b55ec admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:10.408744 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca2a65-17c4-44b0-b834-7a46127b55ec admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:10.415796 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289db6e-6711-449d-86c2-3f64dee87407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:10.417283 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289db6e-6711-449d-86c2-3f64dee87407 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:10.417283 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289db6e-6711-449d-86c2-3f64dee87407 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:10.417283 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289db6e-6711-449d-86c2-3f64dee87407 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:10.427621 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289db6e-6711-449d-86c2-3f64dee87407 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:10.429519 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289db6e-6711-449d-86c2-3f64dee87407 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:10.445750 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-a289db6e-6711-449d-86c2-3f64dee87407 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:58:10.446902 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 577/1152] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:58:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:58:10.453253 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c71fba-2ec8-4f34-a46a-87ca1f60ae8e admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:10.462697 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c71fba-2ec8-4f34-a46a-87ca1f60ae8e admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:10.467488 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c00dce-965a-480e-8a37-f0a7336cb1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:10.468137 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c00dce-965a-480e-8a37-f0a7336cb1af admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:10.468424 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c00dce-965a-480e-8a37-f0a7336cb1af admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:10.468733 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c00dce-965a-480e-8a37-f0a7336cb1af admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:10.469448 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c00dce-965a-480e-8a37-f0a7336cb1af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:10.469760 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c00dce-965a-480e-8a37-f0a7336cb1af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:10.471337 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c00dce-965a-480e-8a37-f0a7336cb1af admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:10.483125 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 576/1153] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:58:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:10.489414 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289db6e-6711-449d-86c2-3f64dee87407 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:10.499129 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289db6e-6711-449d-86c2-3f64dee87407 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:10.503722 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04472904-436e-4a7e-9e7e-d19ec7b20612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:10.504547 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04472904-436e-4a7e-9e7e-d19ec7b20612 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:10.504829 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04472904-436e-4a7e-9e7e-d19ec7b20612 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:10.505104 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04472904-436e-4a7e-9e7e-d19ec7b20612 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:10.512248 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04472904-436e-4a7e-9e7e-d19ec7b20612 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:10.516566 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04472904-436e-4a7e-9e7e-d19ec7b20612 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:10.527684 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-04472904-436e-4a7e-9e7e-d19ec7b20612 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:58:10.528868 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 578/1154] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:58:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:58:10.535250 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c00dce-965a-480e-8a37-f0a7336cb1af admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:10.545262 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c00dce-965a-480e-8a37-f0a7336cb1af admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:10.549858 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c865059-3539-45e2-87d9-35a3ef87ada3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:10.552260 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c865059-3539-45e2-87d9-35a3ef87ada3 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:10.552260 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c865059-3539-45e2-87d9-35a3ef87ada3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:10.552260 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c865059-3539-45e2-87d9-35a3ef87ada3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:10.552260 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c865059-3539-45e2-87d9-35a3ef87ada3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:10.552260 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c865059-3539-45e2-87d9-35a3ef87ada3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:10.554472 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c865059-3539-45e2-87d9-35a3ef87ada3 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:10.570880 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 577/1155] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:58:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:10.581318 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04472904-436e-4a7e-9e7e-d19ec7b20612 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:10.588976 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04472904-436e-4a7e-9e7e-d19ec7b20612 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:10.593916 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bb739-bb6e-4f22-82a9-d4164ccbc76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:10.594549 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bb739-bb6e-4f22-82a9-d4164ccbc76e admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:10.594828 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bb739-bb6e-4f22-82a9-d4164ccbc76e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:10.595104 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bb739-bb6e-4f22-82a9-d4164ccbc76e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:10.595923 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1bb739-bb6e-4f22-82a9-d4164ccbc76e admin admin] RBAC: Adding query filter params (role.id=3e7d7427203a4a4097e2c9a642b9bf69, scope.project.id=73dcb70ac3714a428a717707e6be8201, user.id=58b7e780a23e4ee499cb7820a85feccb) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:10.596234 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1bb739-bb6e-4f22-82a9-d4164ccbc76e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:10.598130 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1bb739-bb6e-4f22-82a9-d4164ccbc76e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:10.603802 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 579/1156] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:58:10 2021] GET /identity/v3/role_assignments?user.id=58b7e780a23e4ee499cb7820a85feccb&scope.project.id=73dcb70ac3714a428a717707e6be8201&role.id=3e7d7427203a4a4097e2c9a642b9bf69 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:12.746602 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c65413-c0f9-48ae-8382-b879d7208439 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:12.747176 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c65413-c0f9-48ae-8382-b879d7208439 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:12.747270 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c65413-c0f9-48ae-8382-b879d7208439 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:12.749042 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 578/1157] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:58:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:58:12.756138 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e041153-69a1-4309-9edf-05824f3ea317 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:12.756600 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e041153-69a1-4309-9edf-05824f3ea317 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:12.756714 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e041153-69a1-4309-9edf-05824f3ea317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:12.774741 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-0e041153-69a1-4309-9edf-05824f3ea317 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:58:12.775972 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-0e041153-69a1-4309-9edf-05824f3ea317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:58:12.783782 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 580/1158] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:58:12 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:58:12.807764 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c65413-c0f9-48ae-8382-b879d7208439 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:12.819983 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c65413-c0f9-48ae-8382-b879d7208439 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:12.824273 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0321f4-1b56-467c-9f20-e0fcb9b89321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:12.825084 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0321f4-1b56-467c-9f20-e0fcb9b89321 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:12.825363 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0321f4-1b56-467c-9f20-e0fcb9b89321 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:12.825635 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0321f4-1b56-467c-9f20-e0fcb9b89321 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:12.836071 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0321f4-1b56-467c-9f20-e0fcb9b89321 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:58:12.842688 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-1f0321f4-1b56-467c-9f20-e0fcb9b89321 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:58:12.843835 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 579/1159] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:58:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:58:12.850628 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e041153-69a1-4309-9edf-05824f3ea317 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:12.859651 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e041153-69a1-4309-9edf-05824f3ea317 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:12.864181 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c50142-8dfb-4320-bd0b-481879963d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:12.864876 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c50142-8dfb-4320-bd0b-481879963d1f admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:12.865159 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c50142-8dfb-4320-bd0b-481879963d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:12.865436 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c50142-8dfb-4320-bd0b-481879963d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:12.866175 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c50142-8dfb-4320-bd0b-481879963d1f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:12.866481 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c50142-8dfb-4320-bd0b-481879963d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:12.868060 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c50142-8dfb-4320-bd0b-481879963d1f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:12.876090 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 581/1160] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:58:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:12.883002 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0321f4-1b56-467c-9f20-e0fcb9b89321 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:12.893011 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0321f4-1b56-467c-9f20-e0fcb9b89321 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:12.898089 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3a625-6800-49d4-85ec-1bf381632af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:12.898850 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3a625-6800-49d4-85ec-1bf381632af1 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:12.899126 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3a625-6800-49d4-85ec-1bf381632af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:12.899399 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3a625-6800-49d4-85ec-1bf381632af1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:12.909482 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3a625-6800-49d4-85ec-1bf381632af1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:12.911292 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3a625-6800-49d4-85ec-1bf381632af1 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:12.927404 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-8ae3a625-6800-49d4-85ec-1bf381632af1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:58:12.928741 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 580/1161] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:58:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:58:12.935004 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c50142-8dfb-4320-bd0b-481879963d1f admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:12.945087 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c50142-8dfb-4320-bd0b-481879963d1f admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:12.949643 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f1865-4ed4-4d57-9ec4-90cb5ca4efa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:12.950290 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f1865-4ed4-4d57-9ec4-90cb5ca4efa7 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:12.950572 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f1865-4ed4-4d57-9ec4-90cb5ca4efa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:12.950882 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f1865-4ed4-4d57-9ec4-90cb5ca4efa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:12.951555 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f1865-4ed4-4d57-9ec4-90cb5ca4efa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:12.951861 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f1865-4ed4-4d57-9ec4-90cb5ca4efa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:12.953467 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f1865-4ed4-4d57-9ec4-90cb5ca4efa7 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:12.965538 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 582/1162] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:58:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:12.971739 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3a625-6800-49d4-85ec-1bf381632af1 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:12.981590 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3a625-6800-49d4-85ec-1bf381632af1 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:12.986233 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38ecb4-b26e-4aa0-85a3-ea8f274ae1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:12.987050 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38ecb4-b26e-4aa0-85a3-ea8f274ae1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:12.987625 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38ecb4-b26e-4aa0-85a3-ea8f274ae1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:12.987973 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38ecb4-b26e-4aa0-85a3-ea8f274ae1e5 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:12.995207 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38ecb4-b26e-4aa0-85a3-ea8f274ae1e5 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:12.997262 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38ecb4-b26e-4aa0-85a3-ea8f274ae1e5 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:13.011680 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-de38ecb4-b26e-4aa0-85a3-ea8f274ae1e5 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 02:58:13.012815 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 581/1163] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:58:12 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:58:13.019065 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f1865-4ed4-4d57-9ec4-90cb5ca4efa7 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:13.029151 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f1865-4ed4-4d57-9ec4-90cb5ca4efa7 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:13.033706 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2f885-5268-4d75-94b8-62d84cae9aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:13.034366 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2f885-5268-4d75-94b8-62d84cae9aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:13.034647 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2f885-5268-4d75-94b8-62d84cae9aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:13.034926 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2f885-5268-4d75-94b8-62d84cae9aa8 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:13.035758 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2f885-5268-4d75-94b8-62d84cae9aa8 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:13.036067 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2f885-5268-4d75-94b8-62d84cae9aa8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:13.037921 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2f885-5268-4d75-94b8-62d84cae9aa8 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:13.054564 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 583/1164] 10.222.0.23 () {56 vars in 1165 bytes} [Thu Sep 23 02:58:13 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:13.060793 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38ecb4-b26e-4aa0-85a3-ea8f274ae1e5 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:13.071343 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38ecb4-b26e-4aa0-85a3-ea8f274ae1e5 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:13.076028 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84696070-8049-4e97-9fbb-add12de261b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:13.076845 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84696070-8049-4e97-9fbb-add12de261b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:13.077125 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84696070-8049-4e97-9fbb-add12de261b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:13.077396 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84696070-8049-4e97-9fbb-add12de261b8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:13.088631 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84696070-8049-4e97-9fbb-add12de261b8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:13.090608 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84696070-8049-4e97-9fbb-add12de261b8 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:13.107030 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-84696070-8049-4e97-9fbb-add12de261b8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:58:13.108162 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 582/1165] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:58:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:58:13.114679 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2f885-5268-4d75-94b8-62d84cae9aa8 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:13.124141 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2f885-5268-4d75-94b8-62d84cae9aa8 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:13.128732 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e7915-dd2d-485a-bad6-45530c27ccc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:13.129379 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e7915-dd2d-485a-bad6-45530c27ccc3 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:13.129656 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e7915-dd2d-485a-bad6-45530c27ccc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:13.129930 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e7915-dd2d-485a-bad6-45530c27ccc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:13.130640 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e7915-dd2d-485a-bad6-45530c27ccc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:13.131437 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e7915-dd2d-485a-bad6-45530c27ccc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:13.133307 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e7915-dd2d-485a-bad6-45530c27ccc3 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:13.147597 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 584/1166] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:58:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:13.153880 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84696070-8049-4e97-9fbb-add12de261b8 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:13.165620 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84696070-8049-4e97-9fbb-add12de261b8 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:13.170152 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed796ce7-86af-4b1e-914c-c5ca5d2a0674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:13.170926 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed796ce7-86af-4b1e-914c-c5ca5d2a0674 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:13.171203 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed796ce7-86af-4b1e-914c-c5ca5d2a0674 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:13.171474 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed796ce7-86af-4b1e-914c-c5ca5d2a0674 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:13.178242 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed796ce7-86af-4b1e-914c-c5ca5d2a0674 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:13.180286 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed796ce7-86af-4b1e-914c-c5ca5d2a0674 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:13.195729 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-ed796ce7-86af-4b1e-914c-c5ca5d2a0674 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:58:13.196899 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 583/1167] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:58:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:58:13.203261 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e7915-dd2d-485a-bad6-45530c27ccc3 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:13.213584 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e7915-dd2d-485a-bad6-45530c27ccc3 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:13.218345 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0f47c-312f-4b6c-925b-f7fba89c6714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:13.218994 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0f47c-312f-4b6c-925b-f7fba89c6714 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:13.219279 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0f47c-312f-4b6c-925b-f7fba89c6714 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:13.219561 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0f47c-312f-4b6c-925b-f7fba89c6714 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:13.220344 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0f47c-312f-4b6c-925b-f7fba89c6714 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:13.220692 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0f47c-312f-4b6c-925b-f7fba89c6714 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:13.222663 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0f47c-312f-4b6c-925b-f7fba89c6714 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:13.234609 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 585/1168] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:58:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:13.241681 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed796ce7-86af-4b1e-914c-c5ca5d2a0674 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:13.252966 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed796ce7-86af-4b1e-914c-c5ca5d2a0674 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:13.258726 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65a78d-4a91-4d07-a45f-8a8217098acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:13.259584 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65a78d-4a91-4d07-a45f-8a8217098acf admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:13.259864 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65a78d-4a91-4d07-a45f-8a8217098acf admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:13.260176 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65a78d-4a91-4d07-a45f-8a8217098acf admin admin] PATH_INFO: `/v3/projects/73dcb70ac3714a428a717707e6be8201/users/58b7e780a23e4ee499cb7820a85feccb/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:13.262166 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65a78d-4a91-4d07-a45f-8a8217098acf admin admin] RBAC: Authorizing `identity:create_grant(project_id=73dcb70ac3714a428a717707e6be8201, user_id=58b7e780a23e4ee499cb7820a85feccb, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:13.265049 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65a78d-4a91-4d07-a45f-8a8217098acf admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:13.353756 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 584/1169] 10.222.0.23 () {58 vars in 1461 bytes} [Thu Sep 23 02:58:13 2021] PUT /identity/v3/projects/73dcb70ac3714a428a717707e6be8201/users/58b7e780a23e4ee499cb7820a85feccb/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 02:58:15.521240 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36117b74-fdd1-4fcf-bfe0-7e2193e50863 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:15.522405 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36117b74-fdd1-4fcf-bfe0-7e2193e50863 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:15.522405 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36117b74-fdd1-4fcf-bfe0-7e2193e50863 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:15.524180 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 586/1170] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:58:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:58:15.531467 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09be326-48a6-406e-85fc-582a3913883e None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:15.531913 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09be326-48a6-406e-85fc-582a3913883e None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:15.532017 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09be326-48a6-406e-85fc-582a3913883e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:15.549303 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-e09be326-48a6-406e-85fc-582a3913883e None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:58:15.550495 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-e09be326-48a6-406e-85fc-582a3913883e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:58:15.604915 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 585/1171] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:58:15 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:58:15.629080 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36117b74-fdd1-4fcf-bfe0-7e2193e50863 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:15.641380 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36117b74-fdd1-4fcf-bfe0-7e2193e50863 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:15.645762 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b30a0-a002-4337-8074-19306bf06c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:15.647076 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b30a0-a002-4337-8074-19306bf06c18 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:15.647358 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b30a0-a002-4337-8074-19306bf06c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:15.647616 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b30a0-a002-4337-8074-19306bf06c18 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:15.657618 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b30a0-a002-4337-8074-19306bf06c18 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 02:58:15.664898 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-2e1b30a0-a002-4337-8074-19306bf06c18 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 02:58:15.666021 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 587/1172] 10.222.0.23 () {56 vars in 1118 bytes} [Thu Sep 23 02:58:15 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:58:15.672511 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09be326-48a6-406e-85fc-582a3913883e None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:15.681258 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09be326-48a6-406e-85fc-582a3913883e None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:15.685847 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98373168-25a1-4ec4-a4ec-8179eabd2532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:15.686509 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98373168-25a1-4ec4-a4ec-8179eabd2532 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:15.686791 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98373168-25a1-4ec4-a4ec-8179eabd2532 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:15.687067 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98373168-25a1-4ec4-a4ec-8179eabd2532 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:15.687807 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98373168-25a1-4ec4-a4ec-8179eabd2532 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:15.688113 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98373168-25a1-4ec4-a4ec-8179eabd2532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:15.689778 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98373168-25a1-4ec4-a4ec-8179eabd2532 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:15.697877 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 586/1173] 10.222.0.23 () {56 vars in 1121 bytes} [Thu Sep 23 02:58:15 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:15.703730 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b30a0-a002-4337-8074-19306bf06c18 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:15.714280 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b30a0-a002-4337-8074-19306bf06c18 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:15.718832 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1542b69-de74-4158-81dc-61a37a2fca40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:15.719584 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1542b69-de74-4158-81dc-61a37a2fca40 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:15.719865 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1542b69-de74-4158-81dc-61a37a2fca40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:15.720141 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1542b69-de74-4158-81dc-61a37a2fca40 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:15.730621 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1542b69-de74-4158-81dc-61a37a2fca40 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:15.734688 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1542b69-de74-4158-81dc-61a37a2fca40 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:15.748671 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-b1542b69-de74-4158-81dc-61a37a2fca40 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:58:15.749778 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 588/1174] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:58:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:58:15.756098 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98373168-25a1-4ec4-a4ec-8179eabd2532 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:15.765796 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98373168-25a1-4ec4-a4ec-8179eabd2532 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:15.770617 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821ac6e-6f60-4ef6-a3b8-c3083482ebae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:15.778974 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821ac6e-6f60-4ef6-a3b8-c3083482ebae admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:15.778974 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821ac6e-6f60-4ef6-a3b8-c3083482ebae admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:15.778974 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821ac6e-6f60-4ef6-a3b8-c3083482ebae admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:15.778974 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821ac6e-6f60-4ef6-a3b8-c3083482ebae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:15.778974 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821ac6e-6f60-4ef6-a3b8-c3083482ebae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:15.778974 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821ac6e-6f60-4ef6-a3b8-c3083482ebae admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:15.786699 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 587/1175] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:58:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:15.793442 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1542b69-de74-4158-81dc-61a37a2fca40 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:15.803056 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1542b69-de74-4158-81dc-61a37a2fca40 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:15.807809 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd6990-7c9e-4015-845d-0f581c21ad68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:15.808662 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd6990-7c9e-4015-845d-0f581c21ad68 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:15.808948 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd6990-7c9e-4015-845d-0f581c21ad68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:15.809220 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd6990-7c9e-4015-845d-0f581c21ad68 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:15.816658 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd6990-7c9e-4015-845d-0f581c21ad68 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:15.818707 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd6990-7c9e-4015-845d-0f581c21ad68 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:15.832500 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-b9bd6990-7c9e-4015-845d-0f581c21ad68 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 02:58:15.833654 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 589/1176] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:58:15 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 02:58:15.840479 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821ac6e-6f60-4ef6-a3b8-c3083482ebae admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:15.851190 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821ac6e-6f60-4ef6-a3b8-c3083482ebae admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:15.855765 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff371bef-04cb-49e8-a566-e267b20169ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:15.856425 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff371bef-04cb-49e8-a566-e267b20169ec admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:15.856767 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff371bef-04cb-49e8-a566-e267b20169ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:15.857045 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff371bef-04cb-49e8-a566-e267b20169ec admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:15.857914 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff371bef-04cb-49e8-a566-e267b20169ec admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:15.858224 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff371bef-04cb-49e8-a566-e267b20169ec admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:15.860059 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff371bef-04cb-49e8-a566-e267b20169ec admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:15.877120 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 588/1177] 10.222.0.23 () {56 vars in 1165 bytes} [Thu Sep 23 02:58:15 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:15.883942 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd6990-7c9e-4015-845d-0f581c21ad68 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:15.893513 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd6990-7c9e-4015-845d-0f581c21ad68 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:15.898768 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a72321-4d63-4932-95cd-9b9763a1b11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:15.899409 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a72321-4d63-4932-95cd-9b9763a1b11e admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:15.899731 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a72321-4d63-4932-95cd-9b9763a1b11e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:15.900010 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a72321-4d63-4932-95cd-9b9763a1b11e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:15.907706 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a72321-4d63-4932-95cd-9b9763a1b11e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:15.909484 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a72321-4d63-4932-95cd-9b9763a1b11e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:15.918529 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 590/1178] 10.222.0.23 () {58 vars in 1325 bytes} [Thu Sep 23 02:58:15 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 02:58:15.924954 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff371bef-04cb-49e8-a566-e267b20169ec admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:15.934759 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff371bef-04cb-49e8-a566-e267b20169ec admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:15.939330 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe537bce-5074-4e19-b355-15af839e6f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:15.940140 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe537bce-5074-4e19-b355-15af839e6f41 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:15.940458 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe537bce-5074-4e19-b355-15af839e6f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:15.940802 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe537bce-5074-4e19-b355-15af839e6f41 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:15.951551 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe537bce-5074-4e19-b355-15af839e6f41 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:15.953417 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe537bce-5074-4e19-b355-15af839e6f41 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:15.970201 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-fe537bce-5074-4e19-b355-15af839e6f41 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 02:58:15.971520 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 589/1179] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Sep 23 02:58:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:58:15.978412 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a72321-4d63-4932-95cd-9b9763a1b11e admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:15.987380 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a72321-4d63-4932-95cd-9b9763a1b11e admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:15.992665 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88149f-9bc7-42a7-9f42-7863998e54c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:15.993311 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88149f-9bc7-42a7-9f42-7863998e54c5 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:15.993591 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88149f-9bc7-42a7-9f42-7863998e54c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:15.993865 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88149f-9bc7-42a7-9f42-7863998e54c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:15.994581 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88149f-9bc7-42a7-9f42-7863998e54c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:15.994888 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88149f-9bc7-42a7-9f42-7863998e54c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:15.996461 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88149f-9bc7-42a7-9f42-7863998e54c5 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:16.009596 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 591/1180] 10.222.0.23 () {56 vars in 1131 bytes} [Thu Sep 23 02:58:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:16.015774 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe537bce-5074-4e19-b355-15af839e6f41 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:16.025620 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe537bce-5074-4e19-b355-15af839e6f41 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:16.030493 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc00cc8-a75c-4edf-97e4-b3ed768eecf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:16.031281 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc00cc8-a75c-4edf-97e4-b3ed768eecf8 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:16.031561 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc00cc8-a75c-4edf-97e4-b3ed768eecf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:16.031835 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc00cc8-a75c-4edf-97e4-b3ed768eecf8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:16.039197 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc00cc8-a75c-4edf-97e4-b3ed768eecf8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:16.041184 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc00cc8-a75c-4edf-97e4-b3ed768eecf8 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:16.054345 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING keystone.server.flask.application [None req-8bc00cc8-a75c-4edf-97e4-b3ed768eecf8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 02:58:16.055489 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 590/1181] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 23 02:58:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:58:16.061996 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88149f-9bc7-42a7-9f42-7863998e54c5 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:16.072018 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88149f-9bc7-42a7-9f42-7863998e54c5 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:16.076624 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d922a-1af9-4e20-8192-7d6def231cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:16.077280 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d922a-1af9-4e20-8192-7d6def231cde admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:16.077562 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d922a-1af9-4e20-8192-7d6def231cde admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:16.077838 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d922a-1af9-4e20-8192-7d6def231cde admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:16.078652 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d922a-1af9-4e20-8192-7d6def231cde admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:16.078934 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d922a-1af9-4e20-8192-7d6def231cde admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:16.080819 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d922a-1af9-4e20-8192-7d6def231cde admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:16.093983 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 592/1182] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Sep 23 02:58:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:16.101453 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc00cc8-a75c-4edf-97e4-b3ed768eecf8 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:16.111942 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc00cc8-a75c-4edf-97e4-b3ed768eecf8 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:16.117078 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbbada-4856-4e2d-af8c-519b28fed594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:16.117724 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbbada-4856-4e2d-af8c-519b28fed594 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:16.122503 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbbada-4856-4e2d-af8c-519b28fed594 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:16.122503 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbbada-4856-4e2d-af8c-519b28fed594 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:16.122503 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbbada-4856-4e2d-af8c-519b28fed594 admin admin] RBAC: Adding query filter params (role.id=3e7d7427203a4a4097e2c9a642b9bf69, scope.project.id=73dcb70ac3714a428a717707e6be8201, user.id=58b7e780a23e4ee499cb7820a85feccb) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:16.122503 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbbada-4856-4e2d-af8c-519b28fed594 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:16.122503 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbbada-4856-4e2d-af8c-519b28fed594 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:16.126956 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 591/1183] 10.222.0.23 () {56 vars in 1396 bytes} [Thu Sep 23 02:58:16 2021] GET /identity/v3/role_assignments?user.id=58b7e780a23e4ee499cb7820a85feccb&scope.project.id=73dcb70ac3714a428a717707e6be8201&role.id=3e7d7427203a4a4097e2c9a642b9bf69 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:18.345291 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c1fd3-26fd-4650-bf19-bb16698fb409 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:18.345823 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c1fd3-26fd-4650-bf19-bb16698fb409 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:18.345823 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c1fd3-26fd-4650-bf19-bb16698fb409 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:18.347652 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 593/1184] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:58:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:58:18.354626 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce94032-3a39-4ece-beb9-02e5e51dbb2a None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:18.355035 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce94032-3a39-4ece-beb9-02e5e51dbb2a None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:18.355178 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce94032-3a39-4ece-beb9-02e5e51dbb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:18.372141 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-3ce94032-3a39-4ece-beb9-02e5e51dbb2a None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:58:18.373359 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-3ce94032-3a39-4ece-beb9-02e5e51dbb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:58:18.381703 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 592/1185] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:58:18 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:58:18.405002 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c1fd3-26fd-4650-bf19-bb16698fb409 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:18.417394 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c1fd3-26fd-4650-bf19-bb16698fb409 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:18.421900 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe602fed-de46-42e8-8104-900f251b3801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:18.422721 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe602fed-de46-42e8-8104-900f251b3801 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:18.423001 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe602fed-de46-42e8-8104-900f251b3801 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:18.423273 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe602fed-de46-42e8-8104-900f251b3801 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:18.423913 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe602fed-de46-42e8-8104-900f251b3801 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:18.425530 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe602fed-de46-42e8-8104-900f251b3801 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:18.436228 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-fe602fed-de46-42e8-8104-900f251b3801 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 02:58:18.437370 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 594/1186] 10.222.0.23 () {56 vars in 1139 bytes} [Thu Sep 23 02:58:18 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:58:18.444278 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce94032-3a39-4ece-beb9-02e5e51dbb2a None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:18.453275 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce94032-3a39-4ece-beb9-02e5e51dbb2a None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:18.457824 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b878e1-5725-4f15-b761-93e2867dc2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:18.458479 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b878e1-5725-4f15-b761-93e2867dc2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:18.458761 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b878e1-5725-4f15-b761-93e2867dc2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:18.459590 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b878e1-5725-4f15-b761-93e2867dc2d6 admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:18.460274 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b878e1-5725-4f15-b761-93e2867dc2d6 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:18.460614 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b878e1-5725-4f15-b761-93e2867dc2d6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:18.462188 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b878e1-5725-4f15-b761-93e2867dc2d6 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:18.466899 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 593/1187] 10.222.0.23 () {56 vars in 1138 bytes} [Thu Sep 23 02:58:18 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:18.472843 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe602fed-de46-42e8-8104-900f251b3801 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:18.483326 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe602fed-de46-42e8-8104-900f251b3801 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:18.487818 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f707b1-80b4-4959-8e81-5baa074971e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:18.488460 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f707b1-80b4-4959-8e81-5baa074971e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:18.488768 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f707b1-80b4-4959-8e81-5baa074971e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:18.489045 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f707b1-80b4-4959-8e81-5baa074971e7 admin admin] PATH_INFO: `/v3/services` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:18.489777 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f707b1-80b4-4959-8e81-5baa074971e7 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:18.490080 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f707b1-80b4-4959-8e81-5baa074971e7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:18.492272 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f707b1-80b4-4959-8e81-5baa074971e7 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:18.496854 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 595/1188] 10.222.0.23 () {56 vars in 1138 bytes} [Thu Sep 23 02:58:18 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:20.624245 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90a31f-5727-4fd5-8d93-35ca0d794d4d None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:20.624841 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90a31f-5727-4fd5-8d93-35ca0d794d4d None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:20.624841 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90a31f-5727-4fd5-8d93-35ca0d794d4d None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:20.626609 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 594/1189] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:58:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:58:20.634578 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab4158-7342-493d-ac73-7cd9ef4cb362 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:20.635046 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab4158-7342-493d-ac73-7cd9ef4cb362 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:20.635138 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab4158-7342-493d-ac73-7cd9ef4cb362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:20.652948 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-ceab4158-7342-493d-ac73-7cd9ef4cb362 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:58:20.654118 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-ceab4158-7342-493d-ac73-7cd9ef4cb362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:58:20.661587 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 596/1190] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:58:20 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:58:20.684944 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90a31f-5727-4fd5-8d93-35ca0d794d4d None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:20.697587 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90a31f-5727-4fd5-8d93-35ca0d794d4d None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:20.702011 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09e7b4-e6a1-4717-8b5e-0457e2280fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:20.702657 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09e7b4-e6a1-4717-8b5e-0457e2280fab admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:20.702938 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09e7b4-e6a1-4717-8b5e-0457e2280fab admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:20.703211 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09e7b4-e6a1-4717-8b5e-0457e2280fab admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:20.703930 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09e7b4-e6a1-4717-8b5e-0457e2280fab admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:20.705646 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09e7b4-e6a1-4717-8b5e-0457e2280fab admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:20.799508 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 595/1191] 10.222.0.23 () {60 vars in 1163 bytes} [Thu Sep 23 02:58:20 2021] POST /identity/v3/services => generated 246 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 02:58:22.934576 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a6823-ab0b-4537-8475-a371608e3908 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:22.935119 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a6823-ab0b-4537-8475-a371608e3908 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:22.935119 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a6823-ab0b-4537-8475-a371608e3908 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:22.936902 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 597/1192] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:58:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:58:22.943830 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da3588-9291-43f4-9a30-56acf2e782d9 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:22.944308 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da3588-9291-43f4-9a30-56acf2e782d9 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:22.944399 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da3588-9291-43f4-9a30-56acf2e782d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:22.961771 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-43da3588-9291-43f4-9a30-56acf2e782d9 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:58:22.962959 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-43da3588-9291-43f4-9a30-56acf2e782d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:58:22.980157 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 596/1193] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:58:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 02:58:23.004309 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a6823-ab0b-4537-8475-a371608e3908 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:23.016835 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a6823-ab0b-4537-8475-a371608e3908 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:23.021212 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feeac62-06bc-4383-b6ff-454f3db9613b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:23.022514 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feeac62-06bc-4383-b6ff-454f3db9613b admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:23.022797 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feeac62-06bc-4383-b6ff-454f3db9613b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:23.023078 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feeac62-06bc-4383-b6ff-454f3db9613b admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:23.023724 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feeac62-06bc-4383-b6ff-454f3db9613b admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:23.025343 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feeac62-06bc-4383-b6ff-454f3db9613b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:23.035942 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-4feeac62-06bc-4383-b6ff-454f3db9613b admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 02:58:23.037617 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 598/1194] 10.222.0.23 () {56 vars in 1139 bytes} [Thu Sep 23 02:58:23 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:58:23.043667 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da3588-9291-43f4-9a30-56acf2e782d9 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:23.052780 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da3588-9291-43f4-9a30-56acf2e782d9 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:23.068022 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52b671-0d31-41d6-bb73-11afc74289cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:23.068022 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52b671-0d31-41d6-bb73-11afc74289cb admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:23.068022 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52b671-0d31-41d6-bb73-11afc74289cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:23.068022 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52b671-0d31-41d6-bb73-11afc74289cb admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:23.068373 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52b671-0d31-41d6-bb73-11afc74289cb admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:23.068373 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52b671-0d31-41d6-bb73-11afc74289cb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:23.068373 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52b671-0d31-41d6-bb73-11afc74289cb admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:23.068373 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 597/1195] 10.222.0.23 () {56 vars in 1138 bytes} [Thu Sep 23 02:58:23 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 02:58:23.072711 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feeac62-06bc-4383-b6ff-454f3db9613b admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:23.082238 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feeac62-06bc-4383-b6ff-454f3db9613b admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:23.087242 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e8329-ff80-482b-a7f7-238a69892431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:23.087877 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e8329-ff80-482b-a7f7-238a69892431 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:23.088157 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e8329-ff80-482b-a7f7-238a69892431 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:23.088430 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e8329-ff80-482b-a7f7-238a69892431 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:23.089291 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e8329-ff80-482b-a7f7-238a69892431 admin admin] RBAC: Adding query filter params (interface=public, service_id=0bb8387b0d684939b15086d6c0f9fd36, region_id=RegionOne) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:23.089678 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e8329-ff80-482b-a7f7-238a69892431 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:23.091240 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e8329-ff80-482b-a7f7-238a69892431 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:23.096543 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 599/1196] 10.222.0.23 () {56 vars in 1273 bytes} [Thu Sep 23 02:58:23 2021] GET /identity/v3/endpoints?service_id=0bb8387b0d684939b15086d6c0f9fd36&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:23.103156 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52b671-0d31-41d6-bb73-11afc74289cb admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:23.112656 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52b671-0d31-41d6-bb73-11afc74289cb admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:23.117217 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008b3a7-dabe-4f90-9854-e0ce076b1e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:23.117868 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008b3a7-dabe-4f90-9854-e0ce076b1e9f admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:23.118153 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008b3a7-dabe-4f90-9854-e0ce076b1e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:23.118432 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008b3a7-dabe-4f90-9854-e0ce076b1e9f admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:23.119109 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008b3a7-dabe-4f90-9854-e0ce076b1e9f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:23.120717 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008b3a7-dabe-4f90-9854-e0ce076b1e9f admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:23.127310 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 598/1197] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 23 02:58:23 2021] GET /identity/v3/services => generated 2191 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 02:58:25.284865 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d691a-08c0-4523-86ab-2fe81841fa98 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:25.285429 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d691a-08c0-4523-86ab-2fe81841fa98 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:25.285429 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d691a-08c0-4523-86ab-2fe81841fa98 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:25.287759 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 600/1198] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 02:58:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 02:58:25.295048 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e9fa3-e845-49cf-9dae-dbbe2cecef1c None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:25.295508 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e9fa3-e845-49cf-9dae-dbbe2cecef1c None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:25.295641 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e9fa3-e845-49cf-9dae-dbbe2cecef1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:25.312960 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-0a9e9fa3-e845-49cf-9dae-dbbe2cecef1c None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 02:58:25.314141 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-0a9e9fa3-e845-49cf-9dae-dbbe2cecef1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 02:58:25.321770 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 599/1199] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 02:58:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 02:58:25.346894 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d691a-08c0-4523-86ab-2fe81841fa98 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:25.359685 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d691a-08c0-4523-86ab-2fe81841fa98 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:25.364390 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ae4cb-a6f8-477d-9e17-8b86448ebe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:25.365700 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ae4cb-a6f8-477d-9e17-8b86448ebe6f admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:25.365979 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ae4cb-a6f8-477d-9e17-8b86448ebe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:25.366250 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ae4cb-a6f8-477d-9e17-8b86448ebe6f admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:25.366893 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ae4cb-a6f8-477d-9e17-8b86448ebe6f admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:25.368546 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ae4cb-a6f8-477d-9e17-8b86448ebe6f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:25.379136 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING keystone.server.flask.application [None req-5a2ae4cb-a6f8-477d-9e17-8b86448ebe6f admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 02:58:25.380273 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 601/1200] 10.222.0.23 () {56 vars in 1139 bytes} [Thu Sep 23 02:58:25 2021] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 02:58:25.387705 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e9fa3-e845-49cf-9dae-dbbe2cecef1c None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:25.396694 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e9fa3-e845-49cf-9dae-dbbe2cecef1c None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:25.401281 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd061ba-cb04-4fd7-8f05-4b0d371d9b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:25.401935 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd061ba-cb04-4fd7-8f05-4b0d371d9b0b admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:25.402218 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd061ba-cb04-4fd7-8f05-4b0d371d9b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:25.402496 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd061ba-cb04-4fd7-8f05-4b0d371d9b0b admin admin] PATH_INFO: `/v3/services` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:25.403196 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd061ba-cb04-4fd7-8f05-4b0d371d9b0b admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 02:58:25.403514 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd061ba-cb04-4fd7-8f05-4b0d371d9b0b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:25.405135 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd061ba-cb04-4fd7-8f05-4b0d371d9b0b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:25.410102 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 600/1201] 10.222.0.23 () {56 vars in 1138 bytes} [Thu Sep 23 02:58:25 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 02:58:25.416170 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ae4cb-a6f8-477d-9e17-8b86448ebe6f admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 02:58:25.425623 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ae4cb-a6f8-477d-9e17-8b86448ebe6f admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 02:58:25.434762 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679189c-f1f6-40bf-bf37-457ab9478a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 02:58:25.434762 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679189c-f1f6-40bf-bf37-457ab9478a4d admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 02:58:25.434762 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679189c-f1f6-40bf-bf37-457ab9478a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 02:58:25.434762 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679189c-f1f6-40bf-bf37-457ab9478a4d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 02:58:25.435223 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679189c-f1f6-40bf-bf37-457ab9478a4d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 02:58:25.435223 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679189c-f1f6-40bf-bf37-457ab9478a4d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 02:58:25.535702 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 602/1202] 10.222.0.23 () {60 vars in 1166 bytes} [Thu Sep 23 02:58:25 2021] POST /identity/v3/endpoints => generated 331 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:04:55.124836 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c6b75-39dc-42e2-ab62-7dafa4f305e3 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:04:55.126156 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c6b75-39dc-42e2-ab62-7dafa4f305e3 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:04:55.127383 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c6b75-39dc-42e2-ab62-7dafa4f305e3 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:04:55.132000 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 601/1203] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:04:55 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 03:04:55.144155 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f8a83-058d-4320-9d1f-face67ee8d6c None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:04:55.144680 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f8a83-058d-4320-9d1f-face67ee8d6c None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:04:55.145445 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f8a83-058d-4320-9d1f-face67ee8d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:04:55.248217 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-fd4f8a83-058d-4320-9d1f-face67ee8d6c None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:04:55.249609 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-fd4f8a83-058d-4320-9d1f-face67ee8d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:04:55.346818 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 603/1204] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:04:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:04:55.370709 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c6b75-39dc-42e2-ab62-7dafa4f305e3 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:04:55.372442 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-211c6b75-39dc-42e2-ab62-7dafa4f305e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:04:55.498172 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c6b75-39dc-42e2-ab62-7dafa4f305e3 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:04:55.590401 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a827b71-ea6e-4e17-bd1b-482e0d5c38bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:04:55.591858 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a827b71-ea6e-4e17-bd1b-482e0d5c38bd admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:04:55.592342 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a827b71-ea6e-4e17-bd1b-482e0d5c38bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:04:55.592922 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a827b71-ea6e-4e17-bd1b-482e0d5c38bd admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:04:55.593930 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a827b71-ea6e-4e17-bd1b-482e0d5c38bd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:04:55.596173 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a827b71-ea6e-4e17-bd1b-482e0d5c38bd admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:04:55.615815 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 602/1205] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 23 03:04:55 2021] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:04:57.827282 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78997f06-498e-46a7-851b-f3e21b35efb7 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:04:57.828355 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78997f06-498e-46a7-851b-f3e21b35efb7 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:04:57.828447 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78997f06-498e-46a7-851b-f3e21b35efb7 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:04:57.830220 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 604/1206] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:04:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:04:57.837200 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0465926-589a-471b-bdbc-1d4b1acc6de4 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:04:57.837618 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0465926-589a-471b-bdbc-1d4b1acc6de4 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:04:57.837756 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0465926-589a-471b-bdbc-1d4b1acc6de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:04:57.914048 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-d0465926-589a-471b-bdbc-1d4b1acc6de4 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:04:57.915237 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-d0465926-589a-471b-bdbc-1d4b1acc6de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:04:58.005742 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 603/1207] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:04:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:04:58.055990 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe7e38-d8c3-49ff-a0fa-0d758f56cc85 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:04:58.056278 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe7e38-d8c3-49ff-a0fa-0d758f56cc85 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:04:58.056607 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe7e38-d8c3-49ff-a0fa-0d758f56cc85 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:04:58.058361 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 605/1208] 10.222.0.23 () {54 vars in 963 bytes} [Thu Sep 23 03:04:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:04:58.064295 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298b36b-6330-403c-a4bc-9c7be0ace01c None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:04:58.064622 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298b36b-6330-403c-a4bc-9c7be0ace01c None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:04:58.064907 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298b36b-6330-403c-a4bc-9c7be0ace01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:04:58.136836 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-d298b36b-6330-403c-a4bc-9c7be0ace01c None None] MFA Rules not processed for user `621e97bd0914448c8afadba25510053d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:04:58.137972 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-d298b36b-6330-403c-a4bc-9c7be0ace01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:04:58.208870 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 604/1209] 10.222.0.23 () {58 vars in 1061 bytes} [Thu Sep 23 03:04:58 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:04:58.217983 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe7e38-d8c3-49ff-a0fa-0d758f56cc85 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:04:58.220030 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-63fe7e38-d8c3-49ff-a0fa-0d758f56cc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:04:58.317919 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe7e38-d8c3-49ff-a0fa-0d758f56cc85 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:04:58.392724 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a854dd3-ae48-4ece-9bb3-0636768d45b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:04:58.393298 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a854dd3-ae48-4ece-9bb3-0636768d45b0 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:04:58.393587 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a854dd3-ae48-4ece-9bb3-0636768d45b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:04:58.393863 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a854dd3-ae48-4ece-9bb3-0636768d45b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:04:58.395494 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-3a854dd3-ae48-4ece-9bb3-0636768d45b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:04:58.498280 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a854dd3-ae48-4ece-9bb3-0636768d45b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:04:58.500230 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a854dd3-ae48-4ece-9bb3-0636768d45b0 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:04:58.517887 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 606/1210] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:04:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:05:00.919449 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8909b3-fdd6-4396-8ce9-5c668838abd1 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:00.919971 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8909b3-fdd6-4396-8ce9-5c668838abd1 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:00.920091 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8909b3-fdd6-4396-8ce9-5c668838abd1 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:00.921868 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 605/1211] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:05:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:05:00.929173 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96319cfb-4049-4e17-a440-8130858ed789 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:00.929566 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96319cfb-4049-4e17-a440-8130858ed789 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:00.929731 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96319cfb-4049-4e17-a440-8130858ed789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:00.992162 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-96319cfb-4049-4e17-a440-8130858ed789 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:05:00.993387 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-96319cfb-4049-4e17-a440-8130858ed789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:01.085553 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 607/1212] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:05:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:05:01.124138 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8909b3-fdd6-4396-8ce9-5c668838abd1 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:05:01.126554 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-3b8909b3-fdd6-4396-8ce9-5c668838abd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:01.229500 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8909b3-fdd6-4396-8ce9-5c668838abd1 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:05:01.302494 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094788f-272a-477a-80b8-cfeac545c0ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:05:01.303146 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094788f-272a-477a-80b8-cfeac545c0ef service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:01.303424 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094788f-272a-477a-80b8-cfeac545c0ef service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:01.303768 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094788f-272a-477a-80b8-cfeac545c0ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:01.305490 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-2094788f-272a-477a-80b8-cfeac545c0ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:01.407624 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094788f-272a-477a-80b8-cfeac545c0ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:05:01.409018 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094788f-272a-477a-80b8-cfeac545c0ef service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:05:01.426247 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 606/1213] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:05:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:05:04.129685 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6937e19-5c32-4b07-b4f1-72a5027fcfeb None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:04.130189 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6937e19-5c32-4b07-b4f1-72a5027fcfeb None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:04.130189 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6937e19-5c32-4b07-b4f1-72a5027fcfeb None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:04.131901 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 608/1214] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:05:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:05:04.138796 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f4f65-b08d-409f-9979-29916a67348c None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:04.139241 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f4f65-b08d-409f-9979-29916a67348c None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:04.139383 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f4f65-b08d-409f-9979-29916a67348c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:04.208698 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-9c0f4f65-b08d-409f-9979-29916a67348c None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:05:04.209944 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-9c0f4f65-b08d-409f-9979-29916a67348c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:04.300468 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 607/1215] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:05:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:05:04.335653 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6937e19-5c32-4b07-b4f1-72a5027fcfeb None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:05:04.337196 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-c6937e19-5c32-4b07-b4f1-72a5027fcfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:04.454664 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6937e19-5c32-4b07-b4f1-72a5027fcfeb None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:05:04.542560 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672fcb9-8acd-4acf-9b56-a9ba8853e7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:05:04.543402 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672fcb9-8acd-4acf-9b56-a9ba8853e7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:04.543677 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672fcb9-8acd-4acf-9b56-a9ba8853e7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:04.543946 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672fcb9-8acd-4acf-9b56-a9ba8853e7e8 admin admin] PATH_INFO: `/v3/projects/edbaae8686104e0483eccd80dd7b042d` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:04.553399 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672fcb9-8acd-4acf-9b56-a9ba8853e7e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=edbaae8686104e0483eccd80dd7b042d)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:05:04.555444 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672fcb9-8acd-4acf-9b56-a9ba8853e7e8 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:05:04.557175 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 609/1216] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 03:05:04 2021] GET /identity/v3/projects/edbaae8686104e0483eccd80dd7b042d => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:05:04.570262 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f4f65-b08d-409f-9979-29916a67348c None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:05:04.571618 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-9c0f4f65-b08d-409f-9979-29916a67348c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:04.657073 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f4f65-b08d-409f-9979-29916a67348c None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:05:04.725971 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13cdea-374f-449d-80aa-8272b83078c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:05:04.726538 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13cdea-374f-449d-80aa-8272b83078c0 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:04.726818 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13cdea-374f-449d-80aa-8272b83078c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:04.727091 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13cdea-374f-449d-80aa-8272b83078c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:04.728707 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-7e13cdea-374f-449d-80aa-8272b83078c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:04.830539 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e13cdea-374f-449d-80aa-8272b83078c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:05:04.831987 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e13cdea-374f-449d-80aa-8272b83078c0 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:05:04.849472 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 608/1217] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:05:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:05:07.864412 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106df9f-83f2-4c11-80ae-c1323f674b57 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:07.864961 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106df9f-83f2-4c11-80ae-c1323f674b57 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:07.865069 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106df9f-83f2-4c11-80ae-c1323f674b57 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:07.866752 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 610/1218] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:05:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:05:07.873643 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35377c3-cd57-4a81-a504-9a7caf1a84ec None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:07.874580 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35377c3-cd57-4a81-a504-9a7caf1a84ec None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:07.874788 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35377c3-cd57-4a81-a504-9a7caf1a84ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:07.935998 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-e35377c3-cd57-4a81-a504-9a7caf1a84ec None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:05:07.937765 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-e35377c3-cd57-4a81-a504-9a7caf1a84ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:08.027275 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 609/1219] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:05:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:05:08.061498 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106df9f-83f2-4c11-80ae-c1323f674b57 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:05:08.063008 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-e106df9f-83f2-4c11-80ae-c1323f674b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:08.182282 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106df9f-83f2-4c11-80ae-c1323f674b57 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:05:08.270629 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33592c8c-7daa-4cf7-9811-4fb0a513314a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:05:08.271479 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33592c8c-7daa-4cf7-9811-4fb0a513314a admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:08.271759 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33592c8c-7daa-4cf7-9811-4fb0a513314a admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:08.272030 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33592c8c-7daa-4cf7-9811-4fb0a513314a admin admin] PATH_INFO: `/v3/projects/edbaae8686104e0483eccd80dd7b042d` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:08.281475 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33592c8c-7daa-4cf7-9811-4fb0a513314a admin admin] RBAC: Authorizing `identity:get_project(project_id=edbaae8686104e0483eccd80dd7b042d)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:05:08.283529 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33592c8c-7daa-4cf7-9811-4fb0a513314a admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:05:08.285240 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 611/1220] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 03:05:08 2021] GET /identity/v3/projects/edbaae8686104e0483eccd80dd7b042d => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 03:05:08.297518 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35377c3-cd57-4a81-a504-9a7caf1a84ec None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:05:08.298713 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-e35377c3-cd57-4a81-a504-9a7caf1a84ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:08.382920 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35377c3-cd57-4a81-a504-9a7caf1a84ec None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:05:08.450709 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891a50f-336a-4659-96cd-5f3b7f6afef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:05:08.451286 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891a50f-336a-4659-96cd-5f3b7f6afef5 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:08.451564 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891a50f-336a-4659-96cd-5f3b7f6afef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:08.451834 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891a50f-336a-4659-96cd-5f3b7f6afef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:08.454009 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-8891a50f-336a-4659-96cd-5f3b7f6afef5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:08.555778 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891a50f-336a-4659-96cd-5f3b7f6afef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:05:08.557260 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891a50f-336a-4659-96cd-5f3b7f6afef5 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:05:08.574168 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 610/1221] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:05:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:05:11.628055 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95799faa-a934-4ed3-a131-5f4208a576cb None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:11.628595 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95799faa-a934-4ed3-a131-5f4208a576cb None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:11.628688 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95799faa-a934-4ed3-a131-5f4208a576cb None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:11.630454 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 612/1222] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:05:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:05:11.637720 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f596d4-8f9c-4d58-99b9-afda9e1b2d61 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:11.638165 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f596d4-8f9c-4d58-99b9-afda9e1b2d61 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:11.638276 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f596d4-8f9c-4d58-99b9-afda9e1b2d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:11.704038 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-b1f596d4-8f9c-4d58-99b9-afda9e1b2d61 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:05:11.705315 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-b1f596d4-8f9c-4d58-99b9-afda9e1b2d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:11.806637 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 611/1223] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:05:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:05:11.843814 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95799faa-a934-4ed3-a131-5f4208a576cb None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:05:11.845379 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-95799faa-a934-4ed3-a131-5f4208a576cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:11.966510 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95799faa-a934-4ed3-a131-5f4208a576cb None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:05:12.039565 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7621b0-0a43-4f67-bcd3-a8ffed9283c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:05:12.040221 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7621b0-0a43-4f67-bcd3-a8ffed9283c8 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:12.040587 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7621b0-0a43-4f67-bcd3-a8ffed9283c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:12.040829 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7621b0-0a43-4f67-bcd3-a8ffed9283c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:12.042460 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-4e7621b0-0a43-4f67-bcd3-a8ffed9283c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:12.161675 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7621b0-0a43-4f67-bcd3-a8ffed9283c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:05:12.163038 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7621b0-0a43-4f67-bcd3-a8ffed9283c8 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:05:12.181730 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 613/1224] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:05:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:05:14.429069 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db3c57-9264-4bc0-a849-c5249b95dea8 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:14.429607 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db3c57-9264-4bc0-a849-c5249b95dea8 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:14.429717 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db3c57-9264-4bc0-a849-c5249b95dea8 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:14.431504 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 612/1225] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:05:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:05:14.439476 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304cf51-dc4b-43cd-8b60-43fe9a6e6219 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:14.440039 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304cf51-dc4b-43cd-8b60-43fe9a6e6219 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:14.440039 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304cf51-dc4b-43cd-8b60-43fe9a6e6219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:14.503566 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-9304cf51-dc4b-43cd-8b60-43fe9a6e6219 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:05:14.504803 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-9304cf51-dc4b-43cd-8b60-43fe9a6e6219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:14.599396 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 614/1226] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:05:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:05:14.637120 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db3c57-9264-4bc0-a849-c5249b95dea8 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:05:14.638624 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-03db3c57-9264-4bc0-a849-c5249b95dea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:14.739773 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db3c57-9264-4bc0-a849-c5249b95dea8 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:05:14.810122 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06384d8c-0b99-4642-8a35-a81b1b76cd88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:05:14.810789 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06384d8c-0b99-4642-8a35-a81b1b76cd88 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:14.811093 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06384d8c-0b99-4642-8a35-a81b1b76cd88 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:14.811895 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06384d8c-0b99-4642-8a35-a81b1b76cd88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:14.813553 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-06384d8c-0b99-4642-8a35-a81b1b76cd88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:14.917318 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06384d8c-0b99-4642-8a35-a81b1b76cd88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:05:14.918754 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06384d8c-0b99-4642-8a35-a81b1b76cd88 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:05:14.938503 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 613/1227] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:05:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:05:17.168820 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdebb8c-c2ff-4c76-9b05-66e879ff4a6b None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:17.169321 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdebb8c-c2ff-4c76-9b05-66e879ff4a6b None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:17.169321 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdebb8c-c2ff-4c76-9b05-66e879ff4a6b None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:17.171614 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 615/1228] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:05:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:05:17.178646 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b5235-2063-45e1-a0f1-d685025ba038 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:17.179082 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b5235-2063-45e1-a0f1-d685025ba038 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:17.179335 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b5235-2063-45e1-a0f1-d685025ba038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:17.244472 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-cf1b5235-2063-45e1-a0f1-d685025ba038 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:05:17.245761 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-cf1b5235-2063-45e1-a0f1-d685025ba038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:17.338911 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 614/1229] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:05:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:05:17.370767 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdebb8c-c2ff-4c76-9b05-66e879ff4a6b None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:05:17.372297 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-1bdebb8c-c2ff-4c76-9b05-66e879ff4a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:17.491399 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdebb8c-c2ff-4c76-9b05-66e879ff4a6b None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:05:17.583311 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb653723-dec8-40cb-bfdf-9d8121f0f41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:05:17.584178 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb653723-dec8-40cb-bfdf-9d8121f0f41b admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:17.584460 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb653723-dec8-40cb-bfdf-9d8121f0f41b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:17.584772 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb653723-dec8-40cb-bfdf-9d8121f0f41b admin admin] PATH_INFO: `/v3/projects/edbaae8686104e0483eccd80dd7b042d` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:17.594953 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb653723-dec8-40cb-bfdf-9d8121f0f41b admin admin] RBAC: Authorizing `identity:get_project(project_id=edbaae8686104e0483eccd80dd7b042d)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:05:17.597060 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb653723-dec8-40cb-bfdf-9d8121f0f41b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:05:17.598760 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 616/1230] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 03:05:17 2021] GET /identity/v3/projects/edbaae8686104e0483eccd80dd7b042d => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:05:17.627310 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015ab73-6a81-4331-97af-ac5e97552957 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:17.627601 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015ab73-6a81-4331-97af-ac5e97552957 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:17.627884 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015ab73-6a81-4331-97af-ac5e97552957 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:17.629802 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 615/1231] 10.222.0.23 () {54 vars in 963 bytes} [Thu Sep 23 03:05:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:05:17.636121 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e4693-3ee9-4bdc-985d-a128c36cb79a None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:17.636405 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e4693-3ee9-4bdc-985d-a128c36cb79a None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:17.636712 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e4693-3ee9-4bdc-985d-a128c36cb79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:17.707256 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-205e4693-3ee9-4bdc-985d-a128c36cb79a None None] MFA Rules not processed for user `621e97bd0914448c8afadba25510053d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:05:17.708430 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-205e4693-3ee9-4bdc-985d-a128c36cb79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:17.783944 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 617/1232] 10.222.0.23 () {58 vars in 1061 bytes} [Thu Sep 23 03:05:17 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:05:17.793293 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015ab73-6a81-4331-97af-ac5e97552957 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:05:17.794888 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-5015ab73-6a81-4331-97af-ac5e97552957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:17.897855 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015ab73-6a81-4331-97af-ac5e97552957 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:05:17.967021 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d23a170-5ef1-4f28-853f-b45264e8d568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:05:17.967698 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23a170-5ef1-4f28-853f-b45264e8d568 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:17.968014 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23a170-5ef1-4f28-853f-b45264e8d568 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:17.968289 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23a170-5ef1-4f28-853f-b45264e8d568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:17.969959 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-5d23a170-5ef1-4f28-853f-b45264e8d568 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:18.099106 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d23a170-5ef1-4f28-853f-b45264e8d568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:05:18.100586 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d23a170-5ef1-4f28-853f-b45264e8d568 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:05:18.119506 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 616/1233] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:05:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:05:21.103115 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e01cfa-0ca4-4b3f-9d68-9ceb70a1f195 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:21.103639 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e01cfa-0ca4-4b3f-9d68-9ceb70a1f195 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:21.103639 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e01cfa-0ca4-4b3f-9d68-9ceb70a1f195 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:21.105415 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 618/1234] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:05:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:05:21.112366 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67feba-c093-427d-8c7a-a08b88941471 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:21.112798 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67feba-c093-427d-8c7a-a08b88941471 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:21.112966 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67feba-c093-427d-8c7a-a08b88941471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:21.176028 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-9c67feba-c093-427d-8c7a-a08b88941471 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:05:21.177275 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-9c67feba-c093-427d-8c7a-a08b88941471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:21.270001 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 617/1235] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:05:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:05:21.307253 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e01cfa-0ca4-4b3f-9d68-9ceb70a1f195 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:05:21.308800 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-18e01cfa-0ca4-4b3f-9d68-9ceb70a1f195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:21.411029 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e01cfa-0ca4-4b3f-9d68-9ceb70a1f195 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:05:21.476044 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c512a6-ea6e-422c-9aec-547709af8943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:05:21.476713 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c512a6-ea6e-422c-9aec-547709af8943 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:21.476991 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c512a6-ea6e-422c-9aec-547709af8943 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:21.477260 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c512a6-ea6e-422c-9aec-547709af8943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:21.478844 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-f6c512a6-ea6e-422c-9aec-547709af8943 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:21.583775 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c512a6-ea6e-422c-9aec-547709af8943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:05:21.585281 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c512a6-ea6e-422c-9aec-547709af8943 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:05:21.615317 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 619/1236] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:05:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:05:23.814997 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1daa01c-aca0-41c4-9e3a-5ff2c81b6d98 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:23.815561 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1daa01c-aca0-41c4-9e3a-5ff2c81b6d98 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:23.815561 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1daa01c-aca0-41c4-9e3a-5ff2c81b6d98 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:23.817365 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 618/1237] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:05:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:05:23.824803 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11993d17-c1e7-4171-a543-67a260b3dc3e None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:23.825200 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11993d17-c1e7-4171-a543-67a260b3dc3e None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:23.825365 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11993d17-c1e7-4171-a543-67a260b3dc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:23.887352 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-11993d17-c1e7-4171-a543-67a260b3dc3e None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:05:23.888567 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-11993d17-c1e7-4171-a543-67a260b3dc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:23.979098 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 620/1238] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:05:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:05:24.020738 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1daa01c-aca0-41c4-9e3a-5ff2c81b6d98 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:05:24.022259 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-c1daa01c-aca0-41c4-9e3a-5ff2c81b6d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:24.121098 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1daa01c-aca0-41c4-9e3a-5ff2c81b6d98 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:05:24.189002 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b729161-99cc-4a45-9935-46bd5fb1123a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:05:24.189642 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b729161-99cc-4a45-9935-46bd5fb1123a service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:24.189920 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b729161-99cc-4a45-9935-46bd5fb1123a service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:24.190192 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b729161-99cc-4a45-9935-46bd5fb1123a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:24.191793 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-3b729161-99cc-4a45-9935-46bd5fb1123a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:24.296680 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b729161-99cc-4a45-9935-46bd5fb1123a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:05:24.298149 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b729161-99cc-4a45-9935-46bd5fb1123a service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:05:24.315608 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 619/1239] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:05:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:05:27.129483 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a4f2b-4ae2-4dc4-a9ed-c0721cdaebb6 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:27.130001 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a4f2b-4ae2-4dc4-a9ed-c0721cdaebb6 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:27.130001 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a4f2b-4ae2-4dc4-a9ed-c0721cdaebb6 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:27.131726 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 621/1240] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:05:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:05:27.139400 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339eb52-f472-48fe-bd71-52a73cd50516 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:27.139803 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339eb52-f472-48fe-bd71-52a73cd50516 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:27.140040 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339eb52-f472-48fe-bd71-52a73cd50516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:27.206621 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-a339eb52-f472-48fe-bd71-52a73cd50516 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:05:27.207801 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-a339eb52-f472-48fe-bd71-52a73cd50516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:27.306958 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 620/1241] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:05:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:05:27.344064 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a4f2b-4ae2-4dc4-a9ed-c0721cdaebb6 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:05:27.346229 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-ed2a4f2b-4ae2-4dc4-a9ed-c0721cdaebb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:27.446171 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a4f2b-4ae2-4dc4-a9ed-c0721cdaebb6 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:05:27.449719 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bd9b8-79b9-4c96-a338-3755d8d9daf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:05:27.450372 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bd9b8-79b9-4c96-a338-3755d8d9daf9 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:27.450658 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bd9b8-79b9-4c96-a338-3755d8d9daf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:27.450935 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bd9b8-79b9-4c96-a338-3755d8d9daf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:27.460193 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81bd9b8-79b9-4c96-a338-3755d8d9daf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:05:27.461666 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81bd9b8-79b9-4c96-a338-3755d8d9daf9 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:05:27.471409 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 622/1242] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:05:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:05:31.924247 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7e9ec-035b-451b-a7c2-cfa47ba839f9 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:31.924816 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7e9ec-035b-451b-a7c2-cfa47ba839f9 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:31.924912 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7e9ec-035b-451b-a7c2-cfa47ba839f9 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:31.926605 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 621/1243] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:05:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:05:31.934205 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fb39a-d0a6-46a9-9762-3cc2270a2d60 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:31.934655 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fb39a-d0a6-46a9-9762-3cc2270a2d60 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:31.934807 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fb39a-d0a6-46a9-9762-3cc2270a2d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:31.953300 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-ba3fb39a-d0a6-46a9-9762-3cc2270a2d60 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:05:31.954473 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-ba3fb39a-d0a6-46a9-9762-3cc2270a2d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:31.964895 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 623/1244] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:05:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:05:32.002225 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7e9ec-035b-451b-a7c2-cfa47ba839f9 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:05:32.004051 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-f9c7e9ec-035b-451b-a7c2-cfa47ba839f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:32.017427 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7e9ec-035b-451b-a7c2-cfa47ba839f9 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:05:32.021044 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1c14e-64d2-4da3-9f4c-63d25ea8284c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:05:32.021765 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1c14e-64d2-4da3-9f4c-63d25ea8284c service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:32.022114 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1c14e-64d2-4da3-9f4c-63d25ea8284c service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:32.022462 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1c14e-64d2-4da3-9f4c-63d25ea8284c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:32.032067 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1c14e-64d2-4da3-9f4c-63d25ea8284c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:05:32.033549 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1c14e-64d2-4da3-9f4c-63d25ea8284c service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:05:32.042694 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 622/1245] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:05:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:05:35.286045 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bbab8-e1ca-4577-a8a1-b014d40249cb None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:35.286589 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bbab8-e1ca-4577-a8a1-b014d40249cb None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:35.286589 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bbab8-e1ca-4577-a8a1-b014d40249cb None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:35.288452 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 624/1246] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:05:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:05:35.296626 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3f0c7-87a1-4b89-818b-946d5a0763d2 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:35.297081 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3f0c7-87a1-4b89-818b-946d5a0763d2 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:35.297187 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3f0c7-87a1-4b89-818b-946d5a0763d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:35.314847 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-5bf3f0c7-87a1-4b89-818b-946d5a0763d2 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:05:35.316044 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-5bf3f0c7-87a1-4b89-818b-946d5a0763d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:35.323973 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 623/1247] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:05:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:05:35.362298 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1bbab8-e1ca-4577-a8a1-b014d40249cb None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:05:35.372881 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1bbab8-e1ca-4577-a8a1-b014d40249cb None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:05:35.376643 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1037418-403f-4e95-9219-ccd00d3db91e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:05:35.377293 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1037418-403f-4e95-9219-ccd00d3db91e service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:35.377575 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1037418-403f-4e95-9219-ccd00d3db91e service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:35.377852 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1037418-403f-4e95-9219-ccd00d3db91e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:35.386598 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1037418-403f-4e95-9219-ccd00d3db91e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:05:35.388027 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1037418-403f-4e95-9219-ccd00d3db91e service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:05:35.397227 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 625/1248] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:05:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:05:39.735083 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976c289-f31a-49aa-9e51-6aa264a79884 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:39.735645 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976c289-f31a-49aa-9e51-6aa264a79884 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:39.735645 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976c289-f31a-49aa-9e51-6aa264a79884 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:39.737386 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 624/1249] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:05:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:05:39.744967 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bc875-6973-4248-848e-1ae5af07639d None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:39.745443 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bc875-6973-4248-848e-1ae5af07639d None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:39.745619 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bc875-6973-4248-848e-1ae5af07639d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:39.764016 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-158bc875-6973-4248-848e-1ae5af07639d None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:05:39.765253 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-158bc875-6973-4248-848e-1ae5af07639d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:39.773163 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 626/1250] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:05:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:05:39.812774 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976c289-f31a-49aa-9e51-6aa264a79884 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:05:39.823299 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976c289-f31a-49aa-9e51-6aa264a79884 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:05:39.827051 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79ce25-563a-4dd3-a2d1-63f783edb569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:05:39.827700 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79ce25-563a-4dd3-a2d1-63f783edb569 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:39.827982 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79ce25-563a-4dd3-a2d1-63f783edb569 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:39.828258 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79ce25-563a-4dd3-a2d1-63f783edb569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:39.837273 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79ce25-563a-4dd3-a2d1-63f783edb569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:05:39.838695 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79ce25-563a-4dd3-a2d1-63f783edb569 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:05:39.848319 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 625/1251] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:05:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:05:45.011765 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd946b1-fc5d-4c4d-8b0b-4d676143ab17 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:45.012785 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd946b1-fc5d-4c4d-8b0b-4d676143ab17 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:45.013358 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd946b1-fc5d-4c4d-8b0b-4d676143ab17 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:45.015840 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 627/1252] 10.222.0.23 () {54 vars in 921 bytes} [Thu Sep 23 03:05:45 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:05:45.021820 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a607263-d5b7-47ec-a3ff-86bfaaa9b643 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:45.022692 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a607263-d5b7-47ec-a3ff-86bfaaa9b643 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:45.023174 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a607263-d5b7-47ec-a3ff-86bfaaa9b643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:45.110853 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-2a607263-d5b7-47ec-a3ff-86bfaaa9b643 None None] MFA Rules not processed for user `58b7e780a23e4ee499cb7820a85feccb`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:05:45.112270 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-2a607263-d5b7-47ec-a3ff-86bfaaa9b643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:45.184549 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 626/1253] 10.222.0.23 () {58 vars in 1019 bytes} [Thu Sep 23 03:05:45 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:05:49.764236 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b021aff-01cd-4f23-b6cd-511e24a52b13 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:49.765105 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b021aff-01cd-4f23-b6cd-511e24a52b13 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:49.765376 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b021aff-01cd-4f23-b6cd-511e24a52b13 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:49.767147 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 628/1254] 10.222.0.23 () {54 vars in 921 bytes} [Thu Sep 23 03:05:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:05:49.773870 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8ed47-d26e-4177-859c-051800e598ab None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:49.774310 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8ed47-d26e-4177-859c-051800e598ab None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:49.774674 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8ed47-d26e-4177-859c-051800e598ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:49.796062 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-9ee8ed47-d26e-4177-859c-051800e598ab None None] MFA Rules not processed for user `58b7e780a23e4ee499cb7820a85feccb`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:05:49.797680 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-9ee8ed47-d26e-4177-859c-051800e598ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:49.807173 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 627/1255] 10.222.0.23 () {58 vars in 1019 bytes} [Thu Sep 23 03:05:49 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:05:51.115492 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b41be-97fb-474b-a00c-4c96a6e894b7 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:51.116055 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b41be-97fb-474b-a00c-4c96a6e894b7 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:51.116055 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b41be-97fb-474b-a00c-4c96a6e894b7 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:51.117997 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 629/1256] 10.222.0.23 () {54 vars in 921 bytes} [Thu Sep 23 03:05:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:05:51.123430 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1567b2b-b7fb-485a-80f5-d05d09a8582e None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:51.123860 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1567b2b-b7fb-485a-80f5-d05d09a8582e None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:51.124254 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1567b2b-b7fb-485a-80f5-d05d09a8582e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:51.142624 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-e1567b2b-b7fb-485a-80f5-d05d09a8582e None None] MFA Rules not processed for user `58b7e780a23e4ee499cb7820a85feccb`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:05:51.143815 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-e1567b2b-b7fb-485a-80f5-d05d09a8582e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:51.152415 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 628/1257] 10.222.0.23 () {58 vars in 1019 bytes} [Thu Sep 23 03:05:51 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:05:54.984127 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4e721-2854-43b9-a118-838b6a84497e None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:54.984685 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4e721-2854-43b9-a118-838b6a84497e None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:54.984858 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4e721-2854-43b9-a118-838b6a84497e None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:54.986867 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 630/1258] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:05:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:05:54.993833 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885051b1-a3a1-4725-9ad8-cd366e392bfb None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:54.994224 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885051b1-a3a1-4725-9ad8-cd366e392bfb None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:54.994386 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885051b1-a3a1-4725-9ad8-cd366e392bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:55.012006 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-885051b1-a3a1-4725-9ad8-cd366e392bfb None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:05:55.013254 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-885051b1-a3a1-4725-9ad8-cd366e392bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:55.021192 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 629/1259] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:05:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:05:55.072175 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52497792-7a32-41b9-a287-fb975175179c None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:55.072463 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52497792-7a32-41b9-a287-fb975175179c None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:55.072961 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52497792-7a32-41b9-a287-fb975175179c None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:55.074857 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 631/1260] 10.222.0.23 () {54 vars in 959 bytes} [Thu Sep 23 03:05:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:05:55.081193 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b521e66-36df-40ce-9e9b-20c8bf8986cc None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:55.081480 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b521e66-36df-40ce-9e9b-20c8bf8986cc None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:55.081758 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b521e66-36df-40ce-9e9b-20c8bf8986cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:55.131160 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-8b521e66-36df-40ce-9e9b-20c8bf8986cc None None] MFA Rules not processed for user `83aa47f723434143b22aac1b96b6a610`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:05:55.132465 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-8b521e66-36df-40ce-9e9b-20c8bf8986cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:55.214341 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 630/1261] 10.222.0.23 () {58 vars in 1057 bytes} [Thu Sep 23 03:05:55 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:05:55.223170 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52497792-7a32-41b9-a287-fb975175179c None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:05:55.237811 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52497792-7a32-41b9-a287-fb975175179c None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:05:55.243479 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3640f6f-cc17-4f27-aceb-83703d491167 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:05:55.244401 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3640f6f-cc17-4f27-aceb-83703d491167 service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:55.244880 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3640f6f-cc17-4f27-aceb-83703d491167 service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:55.245310 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3640f6f-cc17-4f27-aceb-83703d491167 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:55.253942 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3640f6f-cc17-4f27-aceb-83703d491167 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:05:55.255829 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3640f6f-cc17-4f27-aceb-83703d491167 service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:05:55.266426 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 632/1262] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:05:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:05:57.723718 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5e106-b4a7-401c-8b9b-f2baa08b912a None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:57.724249 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5e106-b4a7-401c-8b9b-f2baa08b912a None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:57.724342 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5e106-b4a7-401c-8b9b-f2baa08b912a None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:57.726256 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 631/1263] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:05:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:05:57.733928 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0489d9-2c5d-4f60-8d17-c86bad18b344 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:57.734364 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0489d9-2c5d-4f60-8d17-c86bad18b344 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:57.734488 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0489d9-2c5d-4f60-8d17-c86bad18b344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:57.753439 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-4f0489d9-2c5d-4f60-8d17-c86bad18b344 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:05:57.754623 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-4f0489d9-2c5d-4f60-8d17-c86bad18b344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:05:57.762986 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 633/1264] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:05:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:05:57.807385 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5e106-b4a7-401c-8b9b-f2baa08b912a None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:05:57.824674 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5e106-b4a7-401c-8b9b-f2baa08b912a None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:05:57.831150 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2045a-77af-4b70-897d-2d3bb8ff19cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:05:57.832092 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2045a-77af-4b70-897d-2d3bb8ff19cb service nova] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:05:57.832617 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2045a-77af-4b70-897d-2d3bb8ff19cb service nova] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:05:57.833038 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2045a-77af-4b70-897d-2d3bb8ff19cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:05:57.841966 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2045a-77af-4b70-897d-2d3bb8ff19cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:05:57.843701 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2045a-77af-4b70-897d-2d3bb8ff19cb service nova] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:05:57.854139 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 632/1265] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:05:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:06:00.483688 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c1f7c-5acc-44ef-9c15-9dac5bbd4fdf None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:00.484152 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c1f7c-5acc-44ef-9c15-9dac5bbd4fdf None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:00.484264 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c1f7c-5acc-44ef-9c15-9dac5bbd4fdf None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:00.486075 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 634/1266] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:06:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:06:00.493427 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad9b53-8230-4fe7-af75-3ed209a217de None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:00.493822 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad9b53-8230-4fe7-af75-3ed209a217de None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:00.493996 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad9b53-8230-4fe7-af75-3ed209a217de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:00.513313 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-5cad9b53-8230-4fe7-af75-3ed209a217de None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:06:00.514516 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-5cad9b53-8230-4fe7-af75-3ed209a217de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:06:00.522411 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 633/1267] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:06:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:06:00.569308 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9562b0-2b45-450c-9608-e1ef5cc2db9b None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:00.569595 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9562b0-2b45-450c-9608-e1ef5cc2db9b None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:00.570103 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9562b0-2b45-450c-9608-e1ef5cc2db9b None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:00.571872 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 635/1268] 10.222.0.23 () {54 vars in 959 bytes} [Thu Sep 23 03:06:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:06:00.578078 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6609a5e-370d-4db9-bbeb-bb00d5111c90 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:00.578492 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6609a5e-370d-4db9-bbeb-bb00d5111c90 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:00.578856 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6609a5e-370d-4db9-bbeb-bb00d5111c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:00.599138 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-b6609a5e-370d-4db9-bbeb-bb00d5111c90 None None] MFA Rules not processed for user `83aa47f723434143b22aac1b96b6a610`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:06:00.600344 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-b6609a5e-370d-4db9-bbeb-bb00d5111c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:06:00.612042 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 634/1269] 10.222.0.23 () {58 vars in 1057 bytes} [Thu Sep 23 03:06:00 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:06:00.628760 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9562b0-2b45-450c-9608-e1ef5cc2db9b None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:00.648438 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9562b0-2b45-450c-9608-e1ef5cc2db9b None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:00.654457 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd5363-c972-4f6f-91f5-7ba8f02323d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:00.655126 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd5363-c972-4f6f-91f5-7ba8f02323d5 service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:00.655407 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd5363-c972-4f6f-91f5-7ba8f02323d5 service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:00.655687 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd5363-c972-4f6f-91f5-7ba8f02323d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:00.664602 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd5363-c972-4f6f-91f5-7ba8f02323d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:00.666388 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd5363-c972-4f6f-91f5-7ba8f02323d5 service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:00.680732 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 636/1270] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:06:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:06:03.028165 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d959f-4fb5-4247-aeac-e213c32e1f15 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:03.028911 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d959f-4fb5-4247-aeac-e213c32e1f15 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:03.028911 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d959f-4fb5-4247-aeac-e213c32e1f15 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:03.030661 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 635/1271] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:06:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:06:03.038483 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b717f-7d7f-49e2-b09a-5ea19c37c519 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:03.038944 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b717f-7d7f-49e2-b09a-5ea19c37c519 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:03.039026 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b717f-7d7f-49e2-b09a-5ea19c37c519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:03.057887 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-cb0b717f-7d7f-49e2-b09a-5ea19c37c519 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:06:03.059115 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-cb0b717f-7d7f-49e2-b09a-5ea19c37c519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:06:03.067230 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 637/1272] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:06:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:06:03.083026 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a22cdc-e7a0-4f4e-9b40-0e1d080c434b None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:03.083243 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a22cdc-e7a0-4f4e-9b40-0e1d080c434b None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:03.083708 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a22cdc-e7a0-4f4e-9b40-0e1d080c434b None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:03.085533 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 636/1273] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:06:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:06:03.093788 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178fa86-0ae9-4404-b7be-08f64e248308 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:03.094256 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178fa86-0ae9-4404-b7be-08f64e248308 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:03.094673 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178fa86-0ae9-4404-b7be-08f64e248308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:03.114937 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-3178fa86-0ae9-4404-b7be-08f64e248308 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:06:03.116461 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-3178fa86-0ae9-4404-b7be-08f64e248308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:06:03.120474 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709c6ae-e5c5-4201-b3d2-28ff8389b2c9 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:03.120820 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709c6ae-e5c5-4201-b3d2-28ff8389b2c9 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:03.121103 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709c6ae-e5c5-4201-b3d2-28ff8389b2c9 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:03.123925 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 637/1274] 10.222.0.23 () {54 vars in 962 bytes} [Thu Sep 23 03:06:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:06:03.127723 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 638/1275] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:06:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:06:03.129906 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077fa56-93bc-4750-90ee-d486979aa1f2 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:03.130197 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077fa56-93bc-4750-90ee-d486979aa1f2 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:03.130473 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077fa56-93bc-4750-90ee-d486979aa1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:03.174813 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178fa86-0ae9-4404-b7be-08f64e248308 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:03.182833 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-0077fa56-93bc-4750-90ee-d486979aa1f2 None None] MFA Rules not processed for user `5a435fd22fdc4160888f942e634c0a08`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:06:03.184977 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-0077fa56-93bc-4750-90ee-d486979aa1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:06:03.187429 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178fa86-0ae9-4404-b7be-08f64e248308 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:03.193135 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab1620-e94b-4d0d-9557-6764a39168b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:03.193858 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab1620-e94b-4d0d-9557-6764a39168b9 service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:03.194212 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab1620-e94b-4d0d-9557-6764a39168b9 service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:03.194900 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab1620-e94b-4d0d-9557-6764a39168b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:03.203375 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab1620-e94b-4d0d-9557-6764a39168b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:03.205097 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab1620-e94b-4d0d-9557-6764a39168b9 service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:03.218315 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 639/1276] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:06:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:06:03.245510 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 638/1277] 10.222.0.23 () {58 vars in 1060 bytes} [Thu Sep 23 03:06:03 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:06:03.254373 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab1620-e94b-4d0d-9557-6764a39168b9 service nova] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:03.263972 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab1620-e94b-4d0d-9557-6764a39168b9 service nova] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:03.267824 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e931d-39e2-4c8a-8430-1f16b49dca09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:03.268463 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e931d-39e2-4c8a-8430-1f16b49dca09 service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:03.268818 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e931d-39e2-4c8a-8430-1f16b49dca09 service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:03.269083 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e931d-39e2-4c8a-8430-1f16b49dca09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:03.278159 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e931d-39e2-4c8a-8430-1f16b49dca09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:03.281875 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e931d-39e2-4c8a-8430-1f16b49dca09 service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:03.288900 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 640/1278] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:06:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:06:05.647570 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0837e-a473-4681-b748-e1d0596f0c33 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:05.648088 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0837e-a473-4681-b748-e1d0596f0c33 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:05.648205 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0837e-a473-4681-b748-e1d0596f0c33 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:05.650007 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 639/1279] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:06:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:06:05.657755 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446052e-86e9-4e43-beb0-c42dcf9b2fb9 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:05.658167 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446052e-86e9-4e43-beb0-c42dcf9b2fb9 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:05.658313 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446052e-86e9-4e43-beb0-c42dcf9b2fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:05.683175 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-7446052e-86e9-4e43-beb0-c42dcf9b2fb9 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:06:05.684905 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-7446052e-86e9-4e43-beb0-c42dcf9b2fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:06:05.697695 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 641/1280] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:06:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:06:05.744146 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0837e-a473-4681-b748-e1d0596f0c33 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:05.758973 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0837e-a473-4681-b748-e1d0596f0c33 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:05.764955 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867aa4c8-d45c-4675-b548-67f50d80a0ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:05.765597 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867aa4c8-d45c-4675-b548-67f50d80a0ce service nova] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:05.765878 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867aa4c8-d45c-4675-b548-67f50d80a0ce service nova] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:05.766153 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867aa4c8-d45c-4675-b548-67f50d80a0ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:05.774214 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867aa4c8-d45c-4675-b548-67f50d80a0ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:05.775790 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867aa4c8-d45c-4675-b548-67f50d80a0ce service nova] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:05.785937 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 640/1281] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:06:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:06:08.156355 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41c91a-6213-4883-9954-c638571d87df None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:08.156903 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41c91a-6213-4883-9954-c638571d87df None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:08.156983 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41c91a-6213-4883-9954-c638571d87df None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:08.158681 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 642/1282] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:06:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:06:08.166237 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf7a5f-d7b6-40f0-8d8c-14364cee5297 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:08.166684 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf7a5f-d7b6-40f0-8d8c-14364cee5297 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:08.166859 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf7a5f-d7b6-40f0-8d8c-14364cee5297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:08.185657 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-cacf7a5f-d7b6-40f0-8d8c-14364cee5297 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:06:08.186841 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-cacf7a5f-d7b6-40f0-8d8c-14364cee5297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:06:08.196846 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 641/1283] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:06:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:06:08.239292 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41c91a-6213-4883-9954-c638571d87df None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:08.254905 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41c91a-6213-4883-9954-c638571d87df None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:08.260589 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e49b95-8849-4bc8-b7f4-7034b8d84ac6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:08.261336 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e49b95-8849-4bc8-b7f4-7034b8d84ac6 service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:08.261692 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e49b95-8849-4bc8-b7f4-7034b8d84ac6 service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:08.262994 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e49b95-8849-4bc8-b7f4-7034b8d84ac6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:08.271972 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e49b95-8849-4bc8-b7f4-7034b8d84ac6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:08.273707 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e49b95-8849-4bc8-b7f4-7034b8d84ac6 service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:08.288898 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 643/1284] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:06:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:06:10.790354 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406836ce-140d-430a-ae6e-f42d4632d2da None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:10.791040 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406836ce-140d-430a-ae6e-f42d4632d2da None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:10.791040 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406836ce-140d-430a-ae6e-f42d4632d2da None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:10.797196 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 642/1285] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:06:10 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:06:10.800212 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d8c93-a09c-41c7-94c3-36430954d395 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:10.800212 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d8c93-a09c-41c7-94c3-36430954d395 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:10.801033 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d8c93-a09c-41c7-94c3-36430954d395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:10.828418 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-b46d8c93-a09c-41c7-94c3-36430954d395 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:06:10.829862 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-b46d8c93-a09c-41c7-94c3-36430954d395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:06:10.839848 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 644/1286] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:06:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:06:10.883706 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406836ce-140d-430a-ae6e-f42d4632d2da None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:10.901677 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406836ce-140d-430a-ae6e-f42d4632d2da None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:10.909062 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c69bd1-43b2-409e-b5f2-6ae8818790bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:10.909719 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c69bd1-43b2-409e-b5f2-6ae8818790bc service nova] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:10.909999 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c69bd1-43b2-409e-b5f2-6ae8818790bc service nova] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:10.910278 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c69bd1-43b2-409e-b5f2-6ae8818790bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:10.923928 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c69bd1-43b2-409e-b5f2-6ae8818790bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:10.925539 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c69bd1-43b2-409e-b5f2-6ae8818790bc service nova] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:10.935372 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 643/1287] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:06:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:06:13.362381 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6e8a2-54ac-4f4b-ad46-d062e02dab24 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:13.362930 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6e8a2-54ac-4f4b-ad46-d062e02dab24 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:13.362930 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6e8a2-54ac-4f4b-ad46-d062e02dab24 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:13.364808 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 645/1288] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:06:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:06:13.376537 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5f570-1cea-49e5-9236-1e67ebcf2350 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:13.377075 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5f570-1cea-49e5-9236-1e67ebcf2350 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:13.377203 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5f570-1cea-49e5-9236-1e67ebcf2350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:13.398596 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-50a5f570-1cea-49e5-9236-1e67ebcf2350 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:06:13.399832 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-50a5f570-1cea-49e5-9236-1e67ebcf2350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:06:13.408448 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 644/1289] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:06:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:06:13.456916 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6e8a2-54ac-4f4b-ad46-d062e02dab24 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:13.474240 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6e8a2-54ac-4f4b-ad46-d062e02dab24 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:13.479854 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ca282-e2fb-4670-9538-a81f38134367 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:13.480688 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ca282-e2fb-4670-9538-a81f38134367 service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:13.481132 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ca282-e2fb-4670-9538-a81f38134367 service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:13.481405 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ca282-e2fb-4670-9538-a81f38134367 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:13.490426 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ca282-e2fb-4670-9538-a81f38134367 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:13.491999 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ca282-e2fb-4670-9538-a81f38134367 service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:13.503495 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 646/1290] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:06:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:06:16.696207 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa644234-7545-442a-abb2-3a4c4651be67 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:16.696816 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa644234-7545-442a-abb2-3a4c4651be67 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:16.696816 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa644234-7545-442a-abb2-3a4c4651be67 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:16.698619 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 645/1291] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:06:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 03:06:16.708080 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842786a-a326-4114-afa4-0dd7e16c70db None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:16.708637 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842786a-a326-4114-afa4-0dd7e16c70db None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:16.708637 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842786a-a326-4114-afa4-0dd7e16c70db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:16.726658 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-c842786a-a326-4114-afa4-0dd7e16c70db None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:06:16.730995 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-c842786a-a326-4114-afa4-0dd7e16c70db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:06:16.735770 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 647/1292] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:06:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:06:16.782514 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa644234-7545-442a-abb2-3a4c4651be67 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:16.797367 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa644234-7545-442a-abb2-3a4c4651be67 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:16.802761 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f92600-ab54-4fbb-9d3a-646e0c97b51d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:16.803398 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f92600-ab54-4fbb-9d3a-646e0c97b51d service nova] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:16.803684 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f92600-ab54-4fbb-9d3a-646e0c97b51d service nova] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:16.803960 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f92600-ab54-4fbb-9d3a-646e0c97b51d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:16.812937 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f92600-ab54-4fbb-9d3a-646e0c97b51d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:16.814568 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f92600-ab54-4fbb-9d3a-646e0c97b51d service nova] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:16.824702 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 646/1293] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:06:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:06:18.641747 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef912b9-7292-4bff-a86b-e5c4e6648a12 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:18.642310 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef912b9-7292-4bff-a86b-e5c4e6648a12 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:18.642310 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef912b9-7292-4bff-a86b-e5c4e6648a12 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:18.644214 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 648/1294] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:06:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:06:18.651722 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71caecb6-44fb-4e06-91ab-15e2dcf661d4 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:18.652729 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71caecb6-44fb-4e06-91ab-15e2dcf661d4 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:18.652849 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71caecb6-44fb-4e06-91ab-15e2dcf661d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:18.670680 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-71caecb6-44fb-4e06-91ab-15e2dcf661d4 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:06:18.671873 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-71caecb6-44fb-4e06-91ab-15e2dcf661d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:06:18.679682 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 647/1295] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:06:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:06:18.743101 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40da24a-8f5e-4edc-a0c7-04faf48ef557 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:18.743393 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40da24a-8f5e-4edc-a0c7-04faf48ef557 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:18.743702 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40da24a-8f5e-4edc-a0c7-04faf48ef557 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:18.745528 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 649/1296] 10.222.0.23 () {54 vars in 961 bytes} [Thu Sep 23 03:06:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:06:18.751262 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a9417-be34-460b-9dbf-56e2ac1af3b8 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:18.751550 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a9417-be34-460b-9dbf-56e2ac1af3b8 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:18.751827 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a9417-be34-460b-9dbf-56e2ac1af3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:18.799408 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-020a9417-be34-460b-9dbf-56e2ac1af3b8 None None] MFA Rules not processed for user `83242c1ef12d4a5b800e67346f4ad963`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:06:18.800649 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-020a9417-be34-460b-9dbf-56e2ac1af3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:06:18.858443 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 648/1297] 10.222.0.23 () {58 vars in 1059 bytes} [Thu Sep 23 03:06:18 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:06:18.865976 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40da24a-8f5e-4edc-a0c7-04faf48ef557 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:18.877550 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40da24a-8f5e-4edc-a0c7-04faf48ef557 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:18.881488 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc0c62-743c-40ae-9eee-66f6a24bc9ef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83242c1ef12d4a5b800e67346f4ad963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:18.882138 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc0c62-743c-40ae-9eee-66f6a24bc9ef service glance] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:18.882419 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc0c62-743c-40ae-9eee-66f6a24bc9ef service glance] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:18.882690 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc0c62-743c-40ae-9eee-66f6a24bc9ef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:18.891687 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc0c62-743c-40ae-9eee-66f6a24bc9ef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:18.893215 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc0c62-743c-40ae-9eee-66f6a24bc9ef service glance] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:18.902755 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 650/1298] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:06:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:06:19.197847 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8abe97-f284-4a5f-aaf7-c65fa650dd42 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:19.198127 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8abe97-f284-4a5f-aaf7-c65fa650dd42 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:19.198528 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8abe97-f284-4a5f-aaf7-c65fa650dd42 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:19.204522 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 649/1299] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:06:19 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:06:19.214351 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770a72b-e284-4ed3-9f62-f53507d4a0cd None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:19.215924 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770a72b-e284-4ed3-9f62-f53507d4a0cd None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:19.216409 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770a72b-e284-4ed3-9f62-f53507d4a0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:19.236408 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-e770a72b-e284-4ed3-9f62-f53507d4a0cd None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:06:19.237781 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-e770a72b-e284-4ed3-9f62-f53507d4a0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:06:19.246202 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 651/1300] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:06:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:06:19.293754 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8abe97-f284-4a5f-aaf7-c65fa650dd42 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:19.307697 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8abe97-f284-4a5f-aaf7-c65fa650dd42 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:19.313235 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e86bb-f0d5-43c5-a1b7-b25e5a3d7165 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:19.313883 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e86bb-f0d5-43c5-a1b7-b25e5a3d7165 service nova] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:19.314168 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e86bb-f0d5-43c5-a1b7-b25e5a3d7165 service nova] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:19.314439 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e86bb-f0d5-43c5-a1b7-b25e5a3d7165 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:19.322765 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e86bb-f0d5-43c5-a1b7-b25e5a3d7165 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:19.324921 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e86bb-f0d5-43c5-a1b7-b25e5a3d7165 service nova] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:19.334171 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 650/1301] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:06:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:06:19.569272 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9d484-f63a-4f20-8630-a5e98d7ec5de None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:19.569567 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9d484-f63a-4f20-8630-a5e98d7ec5de None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:19.571729 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9d484-f63a-4f20-8630-a5e98d7ec5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:19.616455 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-72b9d484-f63a-4f20-8630-a5e98d7ec5de None None] MFA Rules not processed for user `96c9b76133d74b79a0d2da9a884651e1`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:06:19.617670 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-72b9d484-f63a-4f20-8630-a5e98d7ec5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:06:19.687704 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 652/1302] 10.222.0.23 () {58 vars in 1010 bytes} [Thu Sep 23 03:06:19 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:06:19.731670 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d55a34-f431-4d6a-818f-a460441b5c54 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:19.732170 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d55a34-f431-4d6a-818f-a460441b5c54 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:19.732267 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d55a34-f431-4d6a-818f-a460441b5c54 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:19.734033 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 651/1303] 10.222.0.23 () {54 vars in 942 bytes} [Thu Sep 23 03:06:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:06:19.741607 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8a888-3288-42aa-9fbb-4bce3e61481f None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:19.742004 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8a888-3288-42aa-9fbb-4bce3e61481f None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:19.742273 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8a888-3288-42aa-9fbb-4bce3e61481f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:19.796835 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-2aa8a888-3288-42aa-9fbb-4bce3e61481f None None] MFA Rules not processed for user `df051fd059b34fe0993f501546d1610f`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:06:19.798095 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-2aa8a888-3288-42aa-9fbb-4bce3e61481f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:06:19.873806 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 653/1304] 10.222.0.23 () {58 vars in 1040 bytes} [Thu Sep 23 03:06:19 2021] POST /identity/v3/auth/tokens => generated 3447 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:06:19.883799 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d55a34-f431-4d6a-818f-a460441b5c54 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:19.897336 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d55a34-f431-4d6a-818f-a460441b5c54 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:19.902397 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f32550-d249-423a-9883-e87ba809c962 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df051fd059b34fe0993f501546d1610f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:19.903075 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f32550-d249-423a-9883-e87ba809c962 service swift] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:19.903359 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f32550-d249-423a-9883-e87ba809c962 service swift] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:19.903638 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f32550-d249-423a-9883-e87ba809c962 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:19.911554 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f32550-d249-423a-9883-e87ba809c962 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:19.913203 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f32550-d249-423a-9883-e87ba809c962 service swift] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:19.921843 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 652/1305] 10.222.0.23 () {60 vars in 1385 bytes} [Thu Sep 23 03:06:19 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 03:06:21.817988 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4ce64-9904-40e2-89aa-5f59bdd57806 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:21.818617 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4ce64-9904-40e2-89aa-5f59bdd57806 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:21.818617 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4ce64-9904-40e2-89aa-5f59bdd57806 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:21.820631 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 654/1306] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:06:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:06:21.828782 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecf0d8-f937-4b97-b9de-e9fb4a04e984 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:21.829508 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecf0d8-f937-4b97-b9de-e9fb4a04e984 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:21.829508 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecf0d8-f937-4b97-b9de-e9fb4a04e984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:21.852301 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-5eecf0d8-f937-4b97-b9de-e9fb4a04e984 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:06:21.853943 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-5eecf0d8-f937-4b97-b9de-e9fb4a04e984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:06:21.863272 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 653/1307] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:06:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:06:21.914038 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4ce64-9904-40e2-89aa-5f59bdd57806 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:21.944883 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4ce64-9904-40e2-89aa-5f59bdd57806 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:21.994506 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7952c43-75d6-4305-acbd-7b2a6f273789 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:21.994506 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7952c43-75d6-4305-acbd-7b2a6f273789 service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:21.994506 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7952c43-75d6-4305-acbd-7b2a6f273789 service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:21.994506 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7952c43-75d6-4305-acbd-7b2a6f273789 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:21.996672 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7952c43-75d6-4305-acbd-7b2a6f273789 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:21.996672 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7952c43-75d6-4305-acbd-7b2a6f273789 service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:21.996672 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 655/1308] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:06:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:06:24.747849 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d59fa-aaaa-4422-a1de-700aea7ecbb4 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:24.756425 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d59fa-aaaa-4422-a1de-700aea7ecbb4 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:24.756425 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d59fa-aaaa-4422-a1de-700aea7ecbb4 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:24.756425 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 654/1309] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:06:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:06:24.762764 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788b453-fd14-4743-a14a-bbd19cd17807 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:24.763350 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788b453-fd14-4743-a14a-bbd19cd17807 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:24.763451 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788b453-fd14-4743-a14a-bbd19cd17807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:24.781625 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-c788b453-fd14-4743-a14a-bbd19cd17807 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:06:24.782817 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-c788b453-fd14-4743-a14a-bbd19cd17807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:06:24.791085 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 656/1310] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:06:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:06:24.839134 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d59fa-aaaa-4422-a1de-700aea7ecbb4 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:24.854393 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d59fa-aaaa-4422-a1de-700aea7ecbb4 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:24.860468 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79767cbc-8356-49fd-879d-913d0f447e5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:24.861344 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79767cbc-8356-49fd-879d-913d0f447e5a service nova] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:24.861787 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79767cbc-8356-49fd-879d-913d0f447e5a service nova] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:24.862221 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79767cbc-8356-49fd-879d-913d0f447e5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:24.872038 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79767cbc-8356-49fd-879d-913d0f447e5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:24.874093 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79767cbc-8356-49fd-879d-913d0f447e5a service nova] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:24.883803 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 655/1311] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:06:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:06:38.709680 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa1981-4ee2-4b32-b3a8-cff3eedfd110 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:38.710275 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa1981-4ee2-4b32-b3a8-cff3eedfd110 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:38.710275 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa1981-4ee2-4b32-b3a8-cff3eedfd110 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:38.711977 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 657/1312] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:06:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:06:38.719152 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb95103-0e83-4371-85b6-5bc3da42020b None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:38.719591 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb95103-0e83-4371-85b6-5bc3da42020b None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:38.719696 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb95103-0e83-4371-85b6-5bc3da42020b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:38.737454 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-7cb95103-0e83-4371-85b6-5bc3da42020b None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:06:38.738643 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-7cb95103-0e83-4371-85b6-5bc3da42020b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:06:38.746923 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 656/1313] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:06:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:06:38.771655 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa1981-4ee2-4b32-b3a8-cff3eedfd110 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:38.783715 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa1981-4ee2-4b32-b3a8-cff3eedfd110 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:38.788090 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77edc8-27f0-4e82-bd48-c610951c1df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:38.788770 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77edc8-27f0-4e82-bd48-c610951c1df1 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:38.789054 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77edc8-27f0-4e82-bd48-c610951c1df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:38.789330 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77edc8-27f0-4e82-bd48-c610951c1df1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:38.790060 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77edc8-27f0-4e82-bd48-c610951c1df1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:38.792395 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77edc8-27f0-4e82-bd48-c610951c1df1 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:38.811385 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 658/1314] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 23 03:06:38 2021] GET /identity/v3/projects => generated 2553 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:06:40.941267 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e19bdb-db99-4150-acf5-ab4a6e98fa05 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:40.941850 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e19bdb-db99-4150-acf5-ab4a6e98fa05 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:40.941850 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e19bdb-db99-4150-acf5-ab4a6e98fa05 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:40.943579 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 657/1315] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:06:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:06:40.951071 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf9dbe-bdc0-41dc-8dec-58a43a535170 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:40.951526 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf9dbe-bdc0-41dc-8dec-58a43a535170 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:40.951670 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf9dbe-bdc0-41dc-8dec-58a43a535170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:40.969734 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-eddf9dbe-bdc0-41dc-8dec-58a43a535170 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:06:40.970952 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-eddf9dbe-bdc0-41dc-8dec-58a43a535170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:06:40.978654 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 659/1316] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:06:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:06:41.002347 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e19bdb-db99-4150-acf5-ab4a6e98fa05 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:41.015155 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e19bdb-db99-4150-acf5-ab4a6e98fa05 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:41.019563 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99f7f0-9c02-4b64-a1cd-42b49a3d3a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:41.020400 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99f7f0-9c02-4b64-a1cd-42b49a3d3a04 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:41.020706 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99f7f0-9c02-4b64-a1cd-42b49a3d3a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:41.020979 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99f7f0-9c02-4b64-a1cd-42b49a3d3a04 admin admin] PATH_INFO: `/v3/projects/0df6b3a453954ff0bf75829697616d35` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:41.031755 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99f7f0-9c02-4b64-a1cd-42b49a3d3a04 admin admin] RBAC: Authorizing `identity:get_project(project_id=0df6b3a453954ff0bf75829697616d35)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:41.033828 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99f7f0-9c02-4b64-a1cd-42b49a3d3a04 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:41.035475 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 658/1317] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 03:06:41 2021] GET /identity/v3/projects/0df6b3a453954ff0bf75829697616d35 => generated 312 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:06:41.041813 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf9dbe-bdc0-41dc-8dec-58a43a535170 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:41.050782 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf9dbe-bdc0-41dc-8dec-58a43a535170 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:41.055378 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2219e-00f4-44cb-9a89-d7c0250767ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:41.056031 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2219e-00f4-44cb-9a89-d7c0250767ab admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:41.056315 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2219e-00f4-44cb-9a89-d7c0250767ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:41.056618 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2219e-00f4-44cb-9a89-d7c0250767ab admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:41.057387 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2219e-00f4-44cb-9a89-d7c0250767ab admin admin] RBAC: Adding query filter params (scope.project.id=0df6b3a453954ff0bf75829697616d35) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:06:41.057696 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2219e-00f4-44cb-9a89-d7c0250767ab admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:41.059537 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2219e-00f4-44cb-9a89-d7c0250767ab admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:41.066075 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 660/1318] 10.222.0.23 () {56 vars in 1232 bytes} [Thu Sep 23 03:06:41 2021] GET /identity/v3/role_assignments?scope.project.id=0df6b3a453954ff0bf75829697616d35 => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:06:41.072665 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99f7f0-9c02-4b64-a1cd-42b49a3d3a04 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:41.082999 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99f7f0-9c02-4b64-a1cd-42b49a3d3a04 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:41.087596 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c29951-6cdc-4f20-a937-751f10490dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:41.088459 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c29951-6cdc-4f20-a937-751f10490dbd admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:41.089321 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c29951-6cdc-4f20-a937-751f10490dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:41.089597 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c29951-6cdc-4f20-a937-751f10490dbd admin admin] PATH_INFO: `/v3/users/2dab58951d01463b8f6d621dcf653d30` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:41.103514 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c29951-6cdc-4f20-a937-751f10490dbd admin admin] RBAC: Authorizing `identity:get_user(user_id=2dab58951d01463b8f6d621dcf653d30)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:41.105751 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c29951-6cdc-4f20-a937-751f10490dbd admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:41.107349 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 659/1319] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 03:06:41 2021] GET /identity/v3/users/2dab58951d01463b8f6d621dcf653d30 => generated 275 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:06:43.290496 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442dc38-2c89-4773-a447-b3775d7b5b40 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:43.291017 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442dc38-2c89-4773-a447-b3775d7b5b40 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:43.291143 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442dc38-2c89-4773-a447-b3775d7b5b40 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:43.293419 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 661/1320] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:06:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:06:43.300967 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2e6d6-2a94-45f0-ae46-2920eb32b151 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:43.301398 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2e6d6-2a94-45f0-ae46-2920eb32b151 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:43.301553 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2e6d6-2a94-45f0-ae46-2920eb32b151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:43.319590 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-d3f2e6d6-2a94-45f0-ae46-2920eb32b151 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:06:43.320857 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-d3f2e6d6-2a94-45f0-ae46-2920eb32b151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:06:43.328683 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 660/1321] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:06:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:06:43.352104 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442dc38-2c89-4773-a447-b3775d7b5b40 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:43.364866 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442dc38-2c89-4773-a447-b3775d7b5b40 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:43.369358 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6bd26-817f-43c0-bbd3-1034cc5e9538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:43.370785 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6bd26-817f-43c0-bbd3-1034cc5e9538 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:43.371064 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6bd26-817f-43c0-bbd3-1034cc5e9538 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:43.371340 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6bd26-817f-43c0-bbd3-1034cc5e9538 admin admin] PATH_INFO: `/v3/projects/173a19f04cc142dbaf96746fcb8fd39d` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:43.382205 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6bd26-817f-43c0-bbd3-1034cc5e9538 admin admin] RBAC: Authorizing `identity:get_project(project_id=173a19f04cc142dbaf96746fcb8fd39d)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:43.384261 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6bd26-817f-43c0-bbd3-1034cc5e9538 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:43.385961 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 662/1322] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 03:06:43 2021] GET /identity/v3/projects/173a19f04cc142dbaf96746fcb8fd39d => generated 361 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:06:43.392684 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2e6d6-2a94-45f0-ae46-2920eb32b151 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:43.401976 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2e6d6-2a94-45f0-ae46-2920eb32b151 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:43.406481 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc857f3-7412-49fb-97c3-81b81fd6b701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:43.407124 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc857f3-7412-49fb-97c3-81b81fd6b701 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:43.407406 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc857f3-7412-49fb-97c3-81b81fd6b701 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:43.407682 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc857f3-7412-49fb-97c3-81b81fd6b701 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:43.408441 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc857f3-7412-49fb-97c3-81b81fd6b701 admin admin] RBAC: Adding query filter params (scope.project.id=173a19f04cc142dbaf96746fcb8fd39d) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:06:43.408784 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc857f3-7412-49fb-97c3-81b81fd6b701 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:43.410605 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc857f3-7412-49fb-97c3-81b81fd6b701 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:43.417491 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 661/1323] 10.222.0.23 () {56 vars in 1232 bytes} [Thu Sep 23 03:06:43 2021] GET /identity/v3/role_assignments?scope.project.id=173a19f04cc142dbaf96746fcb8fd39d => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:06:43.429743 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6bd26-817f-43c0-bbd3-1034cc5e9538 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:43.433312 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6bd26-817f-43c0-bbd3-1034cc5e9538 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:43.437847 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cfe71-0d70-4fd2-bbbe-1be3b1843726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:43.438711 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cfe71-0d70-4fd2-bbbe-1be3b1843726 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:43.439068 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cfe71-0d70-4fd2-bbbe-1be3b1843726 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:43.439394 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cfe71-0d70-4fd2-bbbe-1be3b1843726 admin admin] PATH_INFO: `/v3/users/28a7d4018951460699d1b554d5491473` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:43.452879 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179cfe71-0d70-4fd2-bbbe-1be3b1843726 admin admin] RBAC: Authorizing `identity:get_user(user_id=28a7d4018951460699d1b554d5491473)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:43.454987 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179cfe71-0d70-4fd2-bbbe-1be3b1843726 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:43.456604 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 663/1324] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 03:06:43 2021] GET /identity/v3/users/28a7d4018951460699d1b554d5491473 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:06:45.669943 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93397ad-317e-4ca0-a979-a3e62a739b68 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:45.670482 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93397ad-317e-4ca0-a979-a3e62a739b68 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:45.670599 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93397ad-317e-4ca0-a979-a3e62a739b68 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:45.672461 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 662/1325] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:06:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:06:45.679752 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31f0f5-a46d-4cec-8dbc-b99db0ddd2f1 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:45.680268 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31f0f5-a46d-4cec-8dbc-b99db0ddd2f1 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:45.680372 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31f0f5-a46d-4cec-8dbc-b99db0ddd2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:45.698803 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-4e31f0f5-a46d-4cec-8dbc-b99db0ddd2f1 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:06:45.699993 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-4e31f0f5-a46d-4cec-8dbc-b99db0ddd2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:06:45.708188 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 664/1326] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:06:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:06:45.731841 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93397ad-317e-4ca0-a979-a3e62a739b68 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:45.744268 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93397ad-317e-4ca0-a979-a3e62a739b68 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:45.749905 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c790af9-09c0-4187-92e0-127e4f9b39bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:45.750771 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c790af9-09c0-4187-92e0-127e4f9b39bb admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:45.751054 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c790af9-09c0-4187-92e0-127e4f9b39bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:45.751328 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c790af9-09c0-4187-92e0-127e4f9b39bb admin admin] PATH_INFO: `/v3/projects/57665ee860a440f7bba72e4078f9ca74` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:45.762846 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c790af9-09c0-4187-92e0-127e4f9b39bb admin admin] RBAC: Authorizing `identity:get_project(project_id=57665ee860a440f7bba72e4078f9ca74)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:45.764933 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c790af9-09c0-4187-92e0-127e4f9b39bb admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:45.766588 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 663/1327] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 03:06:45 2021] GET /identity/v3/projects/57665ee860a440f7bba72e4078f9ca74 => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:06:45.773202 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31f0f5-a46d-4cec-8dbc-b99db0ddd2f1 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:45.782149 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31f0f5-a46d-4cec-8dbc-b99db0ddd2f1 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:45.787097 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e829ef-48f7-4442-a3c8-4d64d6098ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:45.787742 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e829ef-48f7-4442-a3c8-4d64d6098ece admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:45.788021 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e829ef-48f7-4442-a3c8-4d64d6098ece admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:45.788298 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e829ef-48f7-4442-a3c8-4d64d6098ece admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:45.789128 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e829ef-48f7-4442-a3c8-4d64d6098ece admin admin] RBAC: Adding query filter params (scope.project.id=57665ee860a440f7bba72e4078f9ca74) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:06:45.789431 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e829ef-48f7-4442-a3c8-4d64d6098ece admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:45.791245 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e829ef-48f7-4442-a3c8-4d64d6098ece admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:45.796453 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 665/1328] 10.222.0.23 () {56 vars in 1232 bytes} [Thu Sep 23 03:06:45 2021] GET /identity/v3/role_assignments?scope.project.id=57665ee860a440f7bba72e4078f9ca74 => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:06:45.802525 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c790af9-09c0-4187-92e0-127e4f9b39bb admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:45.812819 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c790af9-09c0-4187-92e0-127e4f9b39bb admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:45.818412 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc731f-bff9-4c04-847e-b768ef0a56bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:45.819284 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc731f-bff9-4c04-847e-b768ef0a56bc admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:45.819561 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc731f-bff9-4c04-847e-b768ef0a56bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:45.819832 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc731f-bff9-4c04-847e-b768ef0a56bc admin admin] PATH_INFO: `/v3/users/3c9acfa066e8479b842832d6a9f6ac85` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:45.833596 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc731f-bff9-4c04-847e-b768ef0a56bc admin admin] RBAC: Authorizing `identity:get_user(user_id=3c9acfa066e8479b842832d6a9f6ac85)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:45.835699 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc731f-bff9-4c04-847e-b768ef0a56bc admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:45.837359 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 664/1329] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 03:06:45 2021] GET /identity/v3/users/3c9acfa066e8479b842832d6a9f6ac85 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 03:06:47.997171 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ea17e-41f2-40a8-988e-a8eaac200d3f None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:47.997944 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ea17e-41f2-40a8-988e-a8eaac200d3f None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:47.998038 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ea17e-41f2-40a8-988e-a8eaac200d3f None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:47.999784 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 666/1330] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:06:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:06:48.006797 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005b364-1b19-483b-9c7a-c13de532f9d6 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:48.007246 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005b364-1b19-483b-9c7a-c13de532f9d6 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:48.007346 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005b364-1b19-483b-9c7a-c13de532f9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:48.024800 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-6005b364-1b19-483b-9c7a-c13de532f9d6 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:06:48.026536 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-6005b364-1b19-483b-9c7a-c13de532f9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:06:48.034165 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 665/1331] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:06:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:06:48.058038 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ea17e-41f2-40a8-988e-a8eaac200d3f None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:48.070050 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ea17e-41f2-40a8-988e-a8eaac200d3f None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:48.074459 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ec408-1b19-486e-bc49-52cdcc5ea885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:48.075298 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ec408-1b19-486e-bc49-52cdcc5ea885 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:48.075576 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ec408-1b19-486e-bc49-52cdcc5ea885 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:48.075856 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ec408-1b19-486e-bc49-52cdcc5ea885 admin admin] PATH_INFO: `/v3/projects/b14ee5a594124946b89ac1b6a329702f` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:48.086407 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ec408-1b19-486e-bc49-52cdcc5ea885 admin admin] RBAC: Authorizing `identity:get_project(project_id=b14ee5a594124946b89ac1b6a329702f)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:48.089051 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ec408-1b19-486e-bc49-52cdcc5ea885 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:48.090762 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 667/1332] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 03:06:48 2021] GET /identity/v3/projects/b14ee5a594124946b89ac1b6a329702f => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:06:48.097162 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005b364-1b19-483b-9c7a-c13de532f9d6 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:48.106512 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005b364-1b19-483b-9c7a-c13de532f9d6 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:48.111142 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab4d4b-06e9-4ef1-8392-9612c8239f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:48.111792 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab4d4b-06e9-4ef1-8392-9612c8239f66 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:48.112077 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab4d4b-06e9-4ef1-8392-9612c8239f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:48.112357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab4d4b-06e9-4ef1-8392-9612c8239f66 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:48.113155 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab4d4b-06e9-4ef1-8392-9612c8239f66 admin admin] RBAC: Adding query filter params (scope.project.id=b14ee5a594124946b89ac1b6a329702f) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:06:48.113486 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab4d4b-06e9-4ef1-8392-9612c8239f66 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:48.115296 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab4d4b-06e9-4ef1-8392-9612c8239f66 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:48.121552 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 666/1333] 10.222.0.23 () {56 vars in 1232 bytes} [Thu Sep 23 03:06:48 2021] GET /identity/v3/role_assignments?scope.project.id=b14ee5a594124946b89ac1b6a329702f => generated 877 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:06:48.127079 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ec408-1b19-486e-bc49-52cdcc5ea885 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:48.136996 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ec408-1b19-486e-bc49-52cdcc5ea885 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:48.141552 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f9e4d-c979-47b6-bd8a-2369dfa6e9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:48.142388 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f9e4d-c979-47b6-bd8a-2369dfa6e9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:48.142668 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f9e4d-c979-47b6-bd8a-2369dfa6e9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:48.142942 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f9e4d-c979-47b6-bd8a-2369dfa6e9a8 admin admin] PATH_INFO: `/v3/users/0d59a62f440f40ce80b3f695faca5e99` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:48.156439 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f9e4d-c979-47b6-bd8a-2369dfa6e9a8 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d59a62f440f40ce80b3f695faca5e99)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:48.158564 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f9e4d-c979-47b6-bd8a-2369dfa6e9a8 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:48.160149 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 668/1334] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 03:06:48 2021] GET /identity/v3/users/0d59a62f440f40ce80b3f695faca5e99 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:06:48.166083 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab4d4b-06e9-4ef1-8392-9612c8239f66 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:48.176014 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab4d4b-06e9-4ef1-8392-9612c8239f66 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:48.180452 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a570f7-356f-46b2-8fb8-2839a9ed264c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:48.181325 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a570f7-356f-46b2-8fb8-2839a9ed264c admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:48.181606 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a570f7-356f-46b2-8fb8-2839a9ed264c admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:48.181883 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a570f7-356f-46b2-8fb8-2839a9ed264c admin admin] PATH_INFO: `/v3/users/9d5afac4a209495ead61325db16dbdfe` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:48.195158 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a570f7-356f-46b2-8fb8-2839a9ed264c admin admin] RBAC: Authorizing `identity:get_user(user_id=9d5afac4a209495ead61325db16dbdfe)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:48.197288 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a570f7-356f-46b2-8fb8-2839a9ed264c admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:48.198891 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 667/1335] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 03:06:48 2021] GET /identity/v3/users/9d5afac4a209495ead61325db16dbdfe => generated 285 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 03:06:50.419936 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663e92b-efce-4698-8049-1e9c5adb81e4 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:50.420464 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663e92b-efce-4698-8049-1e9c5adb81e4 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:50.420464 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663e92b-efce-4698-8049-1e9c5adb81e4 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:50.422252 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 669/1336] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:06:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:06:50.429367 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220acae1-d107-4934-bb1e-743cf8b137f8 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:50.429768 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220acae1-d107-4934-bb1e-743cf8b137f8 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:50.429922 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220acae1-d107-4934-bb1e-743cf8b137f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:50.447496 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-220acae1-d107-4934-bb1e-743cf8b137f8 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:06:50.449247 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-220acae1-d107-4934-bb1e-743cf8b137f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:06:50.456874 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 668/1337] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:06:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:06:50.480476 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663e92b-efce-4698-8049-1e9c5adb81e4 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:50.492601 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663e92b-efce-4698-8049-1e9c5adb81e4 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:50.497765 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b240a41-2626-4df6-b4b1-2e5605dcbe63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:50.498604 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b240a41-2626-4df6-b4b1-2e5605dcbe63 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:50.498883 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b240a41-2626-4df6-b4b1-2e5605dcbe63 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:50.499155 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b240a41-2626-4df6-b4b1-2e5605dcbe63 admin admin] PATH_INFO: `/v3/projects/c34432677fed4984bbce7291bad96cc8` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:50.500307 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b240a41-2626-4df6-b4b1-2e5605dcbe63 admin admin] RBAC: Authorizing `identity:get_project(project_id=c34432677fed4984bbce7291bad96cc8)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:50.502116 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b240a41-2626-4df6-b4b1-2e5605dcbe63 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:50.503744 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 670/1338] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 03:06:50 2021] GET /identity/v3/projects/c34432677fed4984bbce7291bad96cc8 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:06:50.510630 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220acae1-d107-4934-bb1e-743cf8b137f8 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:50.519576 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220acae1-d107-4934-bb1e-743cf8b137f8 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:50.524061 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558bde4-d101-405f-a861-5225f7352b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:50.524744 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558bde4-d101-405f-a861-5225f7352b55 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:50.525024 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558bde4-d101-405f-a861-5225f7352b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:50.525295 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558bde4-d101-405f-a861-5225f7352b55 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:50.526051 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558bde4-d101-405f-a861-5225f7352b55 admin admin] RBAC: Adding query filter params (scope.project.id=c34432677fed4984bbce7291bad96cc8) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:06:50.526352 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558bde4-d101-405f-a861-5225f7352b55 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:50.528199 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558bde4-d101-405f-a861-5225f7352b55 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:50.533817 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 669/1339] 10.222.0.23 () {56 vars in 1232 bytes} [Thu Sep 23 03:06:50 2021] GET /identity/v3/role_assignments?scope.project.id=c34432677fed4984bbce7291bad96cc8 => generated 879 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:06:50.539786 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b240a41-2626-4df6-b4b1-2e5605dcbe63 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:50.549802 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b240a41-2626-4df6-b4b1-2e5605dcbe63 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:50.554305 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd1849-64c3-4c47-ad55-1679976dfd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:50.555142 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd1849-64c3-4c47-ad55-1679976dfd83 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:50.555427 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd1849-64c3-4c47-ad55-1679976dfd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:50.555707 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd1849-64c3-4c47-ad55-1679976dfd83 admin admin] PATH_INFO: `/v3/users/2a7711e2d0394daf9335168cae6f091d` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:50.557528 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd1849-64c3-4c47-ad55-1679976dfd83 admin admin] RBAC: Authorizing `identity:get_user(user_id=2a7711e2d0394daf9335168cae6f091d)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:50.559300 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd1849-64c3-4c47-ad55-1679976dfd83 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:50.560902 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 671/1340] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 03:06:50 2021] GET /identity/v3/users/2a7711e2d0394daf9335168cae6f091d => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:06:52.697263 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c4a4a-3e1a-42d1-a7c8-12934e66a084 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:52.698409 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c4a4a-3e1a-42d1-a7c8-12934e66a084 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:52.698409 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c4a4a-3e1a-42d1-a7c8-12934e66a084 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:52.700126 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 670/1341] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:06:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:06:52.707161 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da2091-5e4f-4940-ad6f-e6cbb185fbb7 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:52.707573 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da2091-5e4f-4940-ad6f-e6cbb185fbb7 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:52.707748 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da2091-5e4f-4940-ad6f-e6cbb185fbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:52.725196 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-c1da2091-5e4f-4940-ad6f-e6cbb185fbb7 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:06:52.726395 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-c1da2091-5e4f-4940-ad6f-e6cbb185fbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:06:52.734131 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 672/1342] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:06:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:06:52.758600 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c4a4a-3e1a-42d1-a7c8-12934e66a084 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:52.771201 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c4a4a-3e1a-42d1-a7c8-12934e66a084 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:52.775567 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0ed7f-3ffe-44a0-a649-695aa0ac7e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:52.776399 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0ed7f-3ffe-44a0-a649-695aa0ac7e8b admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:52.776716 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0ed7f-3ffe-44a0-a649-695aa0ac7e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:52.776988 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0ed7f-3ffe-44a0-a649-695aa0ac7e8b admin admin] PATH_INFO: `/v3/projects/edbaae8686104e0483eccd80dd7b042d` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:52.787637 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0ed7f-3ffe-44a0-a649-695aa0ac7e8b admin admin] RBAC: Authorizing `identity:get_project(project_id=edbaae8686104e0483eccd80dd7b042d)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:52.789722 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0ed7f-3ffe-44a0-a649-695aa0ac7e8b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:52.791968 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 671/1343] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 03:06:52 2021] GET /identity/v3/projects/edbaae8686104e0483eccd80dd7b042d => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:06:52.798390 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da2091-5e4f-4940-ad6f-e6cbb185fbb7 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:52.807941 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da2091-5e4f-4940-ad6f-e6cbb185fbb7 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:52.812462 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12203e30-4ba4-4524-808a-51f90575ccc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:52.813145 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12203e30-4ba4-4524-808a-51f90575ccc1 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:52.813422 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12203e30-4ba4-4524-808a-51f90575ccc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:52.813695 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12203e30-4ba4-4524-808a-51f90575ccc1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:52.814467 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12203e30-4ba4-4524-808a-51f90575ccc1 admin admin] RBAC: Adding query filter params (scope.project.id=edbaae8686104e0483eccd80dd7b042d) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:06:52.814770 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12203e30-4ba4-4524-808a-51f90575ccc1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:52.816672 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12203e30-4ba4-4524-808a-51f90575ccc1 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:52.823487 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 673/1344] 10.222.0.23 () {56 vars in 1232 bytes} [Thu Sep 23 03:06:52 2021] GET /identity/v3/role_assignments?scope.project.id=edbaae8686104e0483eccd80dd7b042d => generated 1934 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:06:52.829900 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0ed7f-3ffe-44a0-a649-695aa0ac7e8b admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:52.839470 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0ed7f-3ffe-44a0-a649-695aa0ac7e8b admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:52.843953 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffd249-a349-44ee-8607-7a4673b333f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:52.844846 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffd249-a349-44ee-8607-7a4673b333f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:52.845126 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffd249-a349-44ee-8607-7a4673b333f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:52.845397 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffd249-a349-44ee-8607-7a4673b333f4 admin admin] PATH_INFO: `/v3/users/2dab58951d01463b8f6d621dcf653d30` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:52.846577 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffd249-a349-44ee-8607-7a4673b333f4 admin admin] RBAC: Authorizing `identity:get_user(user_id=2dab58951d01463b8f6d621dcf653d30)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:52.848708 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffd249-a349-44ee-8607-7a4673b333f4 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:52.850266 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 672/1345] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 03:06:52 2021] GET /identity/v3/users/2dab58951d01463b8f6d621dcf653d30 => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:06:52.856473 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12203e30-4ba4-4524-808a-51f90575ccc1 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:52.866042 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12203e30-4ba4-4524-808a-51f90575ccc1 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:52.870671 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2dfa5-c018-46a5-ade4-a4c2798669c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:52.871516 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2dfa5-c018-46a5-ade4-a4c2798669c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:52.871809 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2dfa5-c018-46a5-ade4-a4c2798669c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:52.872087 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2dfa5-c018-46a5-ade4-a4c2798669c3 admin admin] PATH_INFO: `/v3/users/2a7711e2d0394daf9335168cae6f091d` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:52.873563 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2dfa5-c018-46a5-ade4-a4c2798669c3 admin admin] RBAC: Authorizing `identity:get_user(user_id=2a7711e2d0394daf9335168cae6f091d)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:52.875332 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2dfa5-c018-46a5-ade4-a4c2798669c3 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:52.876933 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 674/1346] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 03:06:52 2021] GET /identity/v3/users/2a7711e2d0394daf9335168cae6f091d => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 03:06:55.127547 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb1b58-e8d8-4628-befd-a9f09a444ce2 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:55.128148 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb1b58-e8d8-4628-befd-a9f09a444ce2 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:55.128148 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb1b58-e8d8-4628-befd-a9f09a444ce2 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:55.129937 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 673/1347] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:06:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:06:55.137799 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315b283-f745-4057-b04d-daae357da24a None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:55.138256 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315b283-f745-4057-b04d-daae357da24a None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:55.138375 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315b283-f745-4057-b04d-daae357da24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:55.156310 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-f315b283-f745-4057-b04d-daae357da24a None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:06:55.157532 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-f315b283-f745-4057-b04d-daae357da24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:06:55.165685 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 675/1348] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:06:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:06:55.190369 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb1b58-e8d8-4628-befd-a9f09a444ce2 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:55.202993 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb1b58-e8d8-4628-befd-a9f09a444ce2 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:55.207344 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf087ca-fcbb-46f1-8d5d-12e813c48854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:55.208187 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf087ca-fcbb-46f1-8d5d-12e813c48854 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:55.208463 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf087ca-fcbb-46f1-8d5d-12e813c48854 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:55.208837 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf087ca-fcbb-46f1-8d5d-12e813c48854 admin admin] PATH_INFO: `/v3/projects/fc55a3bab8cf46219f282e51c510171b` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:55.219636 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf087ca-fcbb-46f1-8d5d-12e813c48854 admin admin] RBAC: Authorizing `identity:get_project(project_id=fc55a3bab8cf46219f282e51c510171b)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:55.221720 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf087ca-fcbb-46f1-8d5d-12e813c48854 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:55.223381 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 674/1349] 10.222.0.23 () {56 vars in 1208 bytes} [Thu Sep 23 03:06:55 2021] GET /identity/v3/projects/fc55a3bab8cf46219f282e51c510171b => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:06:55.229941 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315b283-f745-4057-b04d-daae357da24a None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:55.238728 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315b283-f745-4057-b04d-daae357da24a None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:55.243226 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f67dc-47a2-4f26-9b11-d2b121ddff4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:55.243893 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f67dc-47a2-4f26-9b11-d2b121ddff4e admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:55.244172 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f67dc-47a2-4f26-9b11-d2b121ddff4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:55.244442 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f67dc-47a2-4f26-9b11-d2b121ddff4e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:55.245238 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f67dc-47a2-4f26-9b11-d2b121ddff4e admin admin] RBAC: Adding query filter params (scope.project.id=fc55a3bab8cf46219f282e51c510171b) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:06:55.245542 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f67dc-47a2-4f26-9b11-d2b121ddff4e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:55.247613 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f67dc-47a2-4f26-9b11-d2b121ddff4e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:55.254003 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 676/1350] 10.222.0.23 () {56 vars in 1232 bytes} [Thu Sep 23 03:06:55 2021] GET /identity/v3/role_assignments?scope.project.id=fc55a3bab8cf46219f282e51c510171b => generated 1934 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:06:55.260529 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf087ca-fcbb-46f1-8d5d-12e813c48854 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:55.270052 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf087ca-fcbb-46f1-8d5d-12e813c48854 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:55.274695 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989f32a-5909-4f7f-9606-e3115e3c1005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:55.276140 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989f32a-5909-4f7f-9606-e3115e3c1005 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:55.276419 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989f32a-5909-4f7f-9606-e3115e3c1005 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:55.276726 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989f32a-5909-4f7f-9606-e3115e3c1005 admin admin] PATH_INFO: `/v3/users/16d1a714a7ba40a2997ccaedc5163b95` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:55.289764 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989f32a-5909-4f7f-9606-e3115e3c1005 admin admin] RBAC: Authorizing `identity:get_user(user_id=16d1a714a7ba40a2997ccaedc5163b95)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:55.291874 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989f32a-5909-4f7f-9606-e3115e3c1005 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:55.293507 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 675/1351] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 03:06:55 2021] GET /identity/v3/users/16d1a714a7ba40a2997ccaedc5163b95 => generated 283 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:06:55.299757 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f67dc-47a2-4f26-9b11-d2b121ddff4e admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:06:55.309329 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f67dc-47a2-4f26-9b11-d2b121ddff4e admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:06:55.313811 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e3468-ea96-4087-be6f-65b1f70b8c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:06:55.314657 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e3468-ea96-4087-be6f-65b1f70b8c6c admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:06:55.314934 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e3468-ea96-4087-be6f-65b1f70b8c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:06:55.315208 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e3468-ea96-4087-be6f-65b1f70b8c6c admin admin] PATH_INFO: `/v3/users/2a7711e2d0394daf9335168cae6f091d` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:06:55.316367 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e3468-ea96-4087-be6f-65b1f70b8c6c admin admin] RBAC: Authorizing `identity:get_user(user_id=2a7711e2d0394daf9335168cae6f091d)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:06:55.318185 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e3468-ea96-4087-be6f-65b1f70b8c6c admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:06:55.319731 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 677/1352] 10.222.0.23 () {56 vars in 1199 bytes} [Thu Sep 23 03:06:55 2021] GET /identity/v3/users/2a7711e2d0394daf9335168cae6f091d => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:07:00.595696 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2aaec-4528-47d2-9cea-15a1bba98eb5 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:00.596345 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2aaec-4528-47d2-9cea-15a1bba98eb5 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:00.596345 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2aaec-4528-47d2-9cea-15a1bba98eb5 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:00.598061 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 676/1353] 10.222.0.23 () {54 vars in 918 bytes} [Thu Sep 23 03:07:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:07:00.604059 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b9558-2571-4ad5-827d-468110dd0086 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:00.604477 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b9558-2571-4ad5-827d-468110dd0086 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:00.604642 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b9558-2571-4ad5-827d-468110dd0086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:00.622438 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-161b9558-2571-4ad5-827d-468110dd0086 None None] MFA Rules not processed for user `58b7e780a23e4ee499cb7820a85feccb`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:07:00.623636 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-161b9558-2571-4ad5-827d-468110dd0086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:07:00.632094 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 678/1354] 10.222.0.23 () {58 vars in 1016 bytes} [Thu Sep 23 03:07:00 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:07:00.647293 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0e99c-c7be-4bfb-b820-1f18373d6356 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:00.647582 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0e99c-c7be-4bfb-b820-1f18373d6356 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:00.647909 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0e99c-c7be-4bfb-b820-1f18373d6356 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:00.649775 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 677/1355] 10.222.0.23 () {54 vars in 918 bytes} [Thu Sep 23 03:07:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:07:00.655350 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8de64-7d3e-43d9-8281-ab9f27b0f858 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:00.655636 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8de64-7d3e-43d9-8281-ab9f27b0f858 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:00.655916 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8de64-7d3e-43d9-8281-ab9f27b0f858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:00.674273 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-7cb8de64-7d3e-43d9-8281-ab9f27b0f858 None None] MFA Rules not processed for user `83aa47f723434143b22aac1b96b6a610`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:07:00.675764 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-7cb8de64-7d3e-43d9-8281-ab9f27b0f858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:07:00.685312 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 679/1356] 10.222.0.23 () {58 vars in 1016 bytes} [Thu Sep 23 03:07:00 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:07:03.483246 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf74b3-4a1a-4af3-97a0-b3ba3a3a348d None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:03.483810 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf74b3-4a1a-4af3-97a0-b3ba3a3a348d None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:03.483810 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf74b3-4a1a-4af3-97a0-b3ba3a3a348d None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:03.485619 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 678/1357] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:07:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:07:03.492519 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79bfcd-fc74-450f-b26d-56f4f74e5aaf None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:03.492935 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79bfcd-fc74-450f-b26d-56f4f74e5aaf None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:03.493095 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79bfcd-fc74-450f-b26d-56f4f74e5aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:03.511151 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-7c79bfcd-fc74-450f-b26d-56f4f74e5aaf None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:07:03.512341 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-7c79bfcd-fc74-450f-b26d-56f4f74e5aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:07:03.520000 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 680/1358] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:07:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:07:03.562622 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf74b3-4a1a-4af3-97a0-b3ba3a3a348d None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:07:03.577157 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf74b3-4a1a-4af3-97a0-b3ba3a3a348d None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:07:03.582570 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe0131-2f5a-4de8-9767-5f2064aa9809 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:07:03.583210 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe0131-2f5a-4de8-9767-5f2064aa9809 service nova] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:03.583493 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe0131-2f5a-4de8-9767-5f2064aa9809 service nova] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:03.583773 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe0131-2f5a-4de8-9767-5f2064aa9809 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:03.592436 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe0131-2f5a-4de8-9767-5f2064aa9809 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:07:03.594044 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe0131-2f5a-4de8-9767-5f2064aa9809 service nova] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:07:03.603255 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 679/1359] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:07:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:07:05.002087 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101ef5a-6188-4619-b28b-6b330cd6d698 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:05.002627 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101ef5a-6188-4619-b28b-6b330cd6d698 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:05.002716 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101ef5a-6188-4619-b28b-6b330cd6d698 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:05.004452 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 681/1360] 10.222.0.23 () {54 vars in 911 bytes} [Thu Sep 23 03:07:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:07:05.009947 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4328924-16bf-41be-b31e-21db8ae3e3b5 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:05.010394 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4328924-16bf-41be-b31e-21db8ae3e3b5 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:05.010499 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4328924-16bf-41be-b31e-21db8ae3e3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:05.027574 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-c4328924-16bf-41be-b31e-21db8ae3e3b5 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:07:05.028776 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-c4328924-16bf-41be-b31e-21db8ae3e3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:07:05.036544 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 680/1361] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Sep 23 03:07:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:07:05.185624 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101ef5a-6188-4619-b28b-6b330cd6d698 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:07:05.200315 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101ef5a-6188-4619-b28b-6b330cd6d698 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:07:05.205884 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34599f-0d3f-41ab-aed7-690d8f2b6dd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:07:05.206523 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34599f-0d3f-41ab-aed7-690d8f2b6dd7 service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:05.206806 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34599f-0d3f-41ab-aed7-690d8f2b6dd7 service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:05.207084 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34599f-0d3f-41ab-aed7-690d8f2b6dd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:05.214925 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34599f-0d3f-41ab-aed7-690d8f2b6dd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:07:05.216555 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34599f-0d3f-41ab-aed7-690d8f2b6dd7 service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:07:05.225593 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 682/1362] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:07:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:07:06.604270 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3be8f-6fb5-421b-b2c1-99f3c10b7609 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:06.605039 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3be8f-6fb5-421b-b2c1-99f3c10b7609 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:06.605039 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3be8f-6fb5-421b-b2c1-99f3c10b7609 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:06.606610 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 681/1363] 10.222.0.23 () {54 vars in 911 bytes} [Thu Sep 23 03:07:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:07:06.612090 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf52b2c-fd6e-4622-b662-20fc0a1e0c78 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:06.612602 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf52b2c-fd6e-4622-b662-20fc0a1e0c78 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:06.612710 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf52b2c-fd6e-4622-b662-20fc0a1e0c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:06.630960 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-1cf52b2c-fd6e-4622-b662-20fc0a1e0c78 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:07:06.632208 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-1cf52b2c-fd6e-4622-b662-20fc0a1e0c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:07:06.640415 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 683/1364] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Sep 23 03:07:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:07:06.793674 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3be8f-6fb5-421b-b2c1-99f3c10b7609 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:07:06.808107 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3be8f-6fb5-421b-b2c1-99f3c10b7609 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:07:06.813583 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567afc56-14de-4c93-a3b0-4f4a45da949f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:07:06.814226 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567afc56-14de-4c93-a3b0-4f4a45da949f service nova] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:06.814511 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567afc56-14de-4c93-a3b0-4f4a45da949f service nova] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:06.814790 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567afc56-14de-4c93-a3b0-4f4a45da949f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:06.823066 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567afc56-14de-4c93-a3b0-4f4a45da949f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:07:06.824687 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567afc56-14de-4c93-a3b0-4f4a45da949f service nova] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:07:06.833874 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 682/1365] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:07:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:07:08.225778 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac5620-622d-4563-a056-0e5eddb5af34 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:08.226314 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac5620-622d-4563-a056-0e5eddb5af34 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:08.226314 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac5620-622d-4563-a056-0e5eddb5af34 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:08.228149 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 684/1366] 10.222.0.23 () {54 vars in 911 bytes} [Thu Sep 23 03:07:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:07:08.233792 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a2307-6ddb-43b5-b107-9bd200ee21d7 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:08.234219 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a2307-6ddb-43b5-b107-9bd200ee21d7 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:08.234347 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a2307-6ddb-43b5-b107-9bd200ee21d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:08.252092 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-5b3a2307-6ddb-43b5-b107-9bd200ee21d7 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:07:08.253304 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-5b3a2307-6ddb-43b5-b107-9bd200ee21d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:07:08.261558 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 683/1367] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Sep 23 03:07:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:07:08.411144 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac5620-622d-4563-a056-0e5eddb5af34 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:07:08.425299 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac5620-622d-4563-a056-0e5eddb5af34 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:07:08.430869 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447ae05-6954-4852-a38a-b3dbcc4addd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:07:08.432009 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447ae05-6954-4852-a38a-b3dbcc4addd3 service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:08.432298 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447ae05-6954-4852-a38a-b3dbcc4addd3 service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:08.432611 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447ae05-6954-4852-a38a-b3dbcc4addd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:08.440690 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447ae05-6954-4852-a38a-b3dbcc4addd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:07:08.442267 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447ae05-6954-4852-a38a-b3dbcc4addd3 service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:07:08.452074 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 685/1368] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:07:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:07:09.837318 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57f4eb-8f1d-4c09-a7b7-32cdb4112e98 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:09.837798 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57f4eb-8f1d-4c09-a7b7-32cdb4112e98 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:09.837893 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57f4eb-8f1d-4c09-a7b7-32cdb4112e98 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:09.839630 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 684/1369] 10.222.0.23 () {54 vars in 911 bytes} [Thu Sep 23 03:07:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:07:09.845095 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a0aaf-2586-4a8c-b216-f00b9378833b None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:09.845480 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a0aaf-2586-4a8c-b216-f00b9378833b None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:09.845651 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a0aaf-2586-4a8c-b216-f00b9378833b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:09.862895 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-136a0aaf-2586-4a8c-b216-f00b9378833b None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:07:09.864089 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-136a0aaf-2586-4a8c-b216-f00b9378833b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:07:09.872557 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 686/1370] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Sep 23 03:07:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:07:10.031855 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57f4eb-8f1d-4c09-a7b7-32cdb4112e98 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:07:10.046522 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57f4eb-8f1d-4c09-a7b7-32cdb4112e98 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:07:10.052124 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38f368-ded1-47df-9a68-eb30a5b92be3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:07:10.052806 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38f368-ded1-47df-9a68-eb30a5b92be3 service nova] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:10.053091 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38f368-ded1-47df-9a68-eb30a5b92be3 service nova] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:10.053371 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38f368-ded1-47df-9a68-eb30a5b92be3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:10.061893 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38f368-ded1-47df-9a68-eb30a5b92be3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:07:10.063464 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38f368-ded1-47df-9a68-eb30a5b92be3 service nova] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:07:10.072612 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 685/1371] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:07:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:07:11.482587 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf3a0a-f7f0-4d92-9e53-b35ee08c7953 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:11.483204 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf3a0a-f7f0-4d92-9e53-b35ee08c7953 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:11.483204 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf3a0a-f7f0-4d92-9e53-b35ee08c7953 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:11.486287 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 687/1372] 10.222.0.23 () {54 vars in 911 bytes} [Thu Sep 23 03:07:11 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:07:11.495607 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46abfc8-e5f6-4777-ac4f-9f528769bb2f None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:11.496309 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46abfc8-e5f6-4777-ac4f-9f528769bb2f None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:11.496309 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46abfc8-e5f6-4777-ac4f-9f528769bb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:11.514462 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-f46abfc8-e5f6-4777-ac4f-9f528769bb2f None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:07:11.515652 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-f46abfc8-e5f6-4777-ac4f-9f528769bb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:07:11.523345 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 686/1373] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Sep 23 03:07:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:07:11.676458 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf3a0a-f7f0-4d92-9e53-b35ee08c7953 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:07:11.691242 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf3a0a-f7f0-4d92-9e53-b35ee08c7953 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:07:11.696585 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b49f34-9bf4-4701-ae92-eb0f8c544af1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:07:11.697221 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b49f34-9bf4-4701-ae92-eb0f8c544af1 service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:11.697501 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b49f34-9bf4-4701-ae92-eb0f8c544af1 service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:11.697771 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b49f34-9bf4-4701-ae92-eb0f8c544af1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:11.705549 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b49f34-9bf4-4701-ae92-eb0f8c544af1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:07:11.707116 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b49f34-9bf4-4701-ae92-eb0f8c544af1 service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:07:11.717071 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 688/1374] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:07:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:07:13.123799 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e961d0-dc43-43b2-9319-60a3c85b5552 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:13.124340 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e961d0-dc43-43b2-9319-60a3c85b5552 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:13.124340 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e961d0-dc43-43b2-9319-60a3c85b5552 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:13.126064 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 687/1375] 10.222.0.23 () {54 vars in 911 bytes} [Thu Sep 23 03:07:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:07:13.131599 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422a9fd-feba-4f36-b4c0-5a61f0efc065 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:13.132031 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422a9fd-feba-4f36-b4c0-5a61f0efc065 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:13.132276 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422a9fd-feba-4f36-b4c0-5a61f0efc065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:13.159516 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-6422a9fd-feba-4f36-b4c0-5a61f0efc065 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:07:13.160779 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-6422a9fd-feba-4f36-b4c0-5a61f0efc065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:07:13.172372 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 689/1376] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Sep 23 03:07:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:07:13.324162 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e961d0-dc43-43b2-9319-60a3c85b5552 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:07:13.338808 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e961d0-dc43-43b2-9319-60a3c85b5552 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:07:13.344107 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdbbc2-bcc9-4be5-9b28-947b2f4b6591 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:07:13.344784 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdbbc2-bcc9-4be5-9b28-947b2f4b6591 service nova] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:13.345069 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdbbc2-bcc9-4be5-9b28-947b2f4b6591 service nova] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:13.345347 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdbbc2-bcc9-4be5-9b28-947b2f4b6591 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:13.353254 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cdbbc2-bcc9-4be5-9b28-947b2f4b6591 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:07:13.354826 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cdbbc2-bcc9-4be5-9b28-947b2f4b6591 service nova] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:07:13.363949 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 688/1377] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:07:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:07:14.832257 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67878fe6-0caa-4b24-b20d-a31f3d9b2152 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:14.832763 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67878fe6-0caa-4b24-b20d-a31f3d9b2152 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:14.832883 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67878fe6-0caa-4b24-b20d-a31f3d9b2152 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:14.834742 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 690/1378] 10.222.0.23 () {54 vars in 911 bytes} [Thu Sep 23 03:07:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:07:14.840938 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31663b90-bba1-4fe2-ada7-374bb08250fd None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:14.841321 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31663b90-bba1-4fe2-ada7-374bb08250fd None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:14.841498 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31663b90-bba1-4fe2-ada7-374bb08250fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:14.864407 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-31663b90-bba1-4fe2-ada7-374bb08250fd None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:07:14.865660 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-31663b90-bba1-4fe2-ada7-374bb08250fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:07:14.881967 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 689/1379] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Sep 23 03:07:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:07:15.036013 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67878fe6-0caa-4b24-b20d-a31f3d9b2152 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:07:15.051290 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67878fe6-0caa-4b24-b20d-a31f3d9b2152 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:07:15.056766 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367ddb0-31bf-408d-82bd-5a8fd75a92ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:07:15.057408 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367ddb0-31bf-408d-82bd-5a8fd75a92ba service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:15.057692 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367ddb0-31bf-408d-82bd-5a8fd75a92ba service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:15.057968 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367ddb0-31bf-408d-82bd-5a8fd75a92ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:15.065799 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367ddb0-31bf-408d-82bd-5a8fd75a92ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:07:15.067365 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367ddb0-31bf-408d-82bd-5a8fd75a92ba service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:07:15.076517 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 691/1380] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:07:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:07:16.501280 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663defb3-b86f-4b75-aee4-4a241c1218fa None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:16.501813 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663defb3-b86f-4b75-aee4-4a241c1218fa None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:16.501813 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663defb3-b86f-4b75-aee4-4a241c1218fa None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:16.503527 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 690/1381] 10.222.0.23 () {54 vars in 911 bytes} [Thu Sep 23 03:07:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:07:16.509575 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1aa2e-6865-4eef-92e9-40136ba0a04d None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:16.509975 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1aa2e-6865-4eef-92e9-40136ba0a04d None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:16.510122 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1aa2e-6865-4eef-92e9-40136ba0a04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:16.527274 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-01b1aa2e-6865-4eef-92e9-40136ba0a04d None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:07:16.528449 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-01b1aa2e-6865-4eef-92e9-40136ba0a04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:07:16.536045 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 692/1382] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Sep 23 03:07:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:07:16.685950 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663defb3-b86f-4b75-aee4-4a241c1218fa None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:07:16.700740 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663defb3-b86f-4b75-aee4-4a241c1218fa None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:07:16.706285 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a56673-28f6-4801-a192-f69632156e99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:07:16.706917 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a56673-28f6-4801-a192-f69632156e99 service nova] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:16.707201 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a56673-28f6-4801-a192-f69632156e99 service nova] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:16.707480 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a56673-28f6-4801-a192-f69632156e99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:16.715420 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a56673-28f6-4801-a192-f69632156e99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:07:16.717023 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a56673-28f6-4801-a192-f69632156e99 service nova] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:07:16.726100 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 691/1383] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:07:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:07:18.796182 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ce423-70bf-4f92-802d-f4d62b029d4b None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:18.796803 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ce423-70bf-4f92-802d-f4d62b029d4b None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:18.796803 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ce423-70bf-4f92-802d-f4d62b029d4b None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:18.798544 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 693/1384] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:07:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:07:18.805944 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842b00c-4222-47e6-a8f4-80caf38fc176 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:18.806377 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842b00c-4222-47e6-a8f4-80caf38fc176 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:18.806547 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842b00c-4222-47e6-a8f4-80caf38fc176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:18.824477 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-c842b00c-4222-47e6-a8f4-80caf38fc176 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:07:18.825706 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-c842b00c-4222-47e6-a8f4-80caf38fc176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:07:18.833445 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 692/1385] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:07:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:07:18.878940 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ce423-70bf-4f92-802d-f4d62b029d4b None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:07:18.889495 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ce423-70bf-4f92-802d-f4d62b029d4b None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:07:18.893004 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7176fe-1586-4caf-9120-c162ef283525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:07:18.893645 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7176fe-1586-4caf-9120-c162ef283525 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:18.893927 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7176fe-1586-4caf-9120-c162ef283525 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:18.894205 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7176fe-1586-4caf-9120-c162ef283525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:18.903373 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7176fe-1586-4caf-9120-c162ef283525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:07:18.904852 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7176fe-1586-4caf-9120-c162ef283525 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:07:18.913927 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 694/1386] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:07:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:07:21.220291 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69969b2a-4b3f-4ada-9f22-b9a73c431178 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:21.220873 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69969b2a-4b3f-4ada-9f22-b9a73c431178 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:21.220873 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69969b2a-4b3f-4ada-9f22-b9a73c431178 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:21.222622 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 693/1387] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:07:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:07:21.229906 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44807f1-fd46-4659-baa3-4c3ca15dd9ba None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:21.230400 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44807f1-fd46-4659-baa3-4c3ca15dd9ba None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:21.230508 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44807f1-fd46-4659-baa3-4c3ca15dd9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:21.248545 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-e44807f1-fd46-4659-baa3-4c3ca15dd9ba None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:07:21.249718 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-e44807f1-fd46-4659-baa3-4c3ca15dd9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:07:21.257428 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 695/1388] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:07:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:07:21.296134 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69969b2a-4b3f-4ada-9f22-b9a73c431178 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:07:21.307043 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69969b2a-4b3f-4ada-9f22-b9a73c431178 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:07:21.310534 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ff85a-3e5c-4f01-9cdf-17103f164491 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:07:21.311167 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ff85a-3e5c-4f01-9cdf-17103f164491 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:21.311445 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ff85a-3e5c-4f01-9cdf-17103f164491 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:21.311716 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ff85a-3e5c-4f01-9cdf-17103f164491 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:21.320410 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ff85a-3e5c-4f01-9cdf-17103f164491 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:07:21.322646 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ff85a-3e5c-4f01-9cdf-17103f164491 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:07:21.331644 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 694/1389] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:07:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:07:23.858777 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3c325-431c-4809-9e3d-768cbb92da22 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:23.859331 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3c325-431c-4809-9e3d-768cbb92da22 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:23.859331 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3c325-431c-4809-9e3d-768cbb92da22 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:23.861145 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 696/1390] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:07:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:07:23.868821 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f7651-71f5-41e0-a80c-fa790a068a0a None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:23.869229 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f7651-71f5-41e0-a80c-fa790a068a0a None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:23.869452 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f7651-71f5-41e0-a80c-fa790a068a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:23.887300 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-5c7f7651-71f5-41e0-a80c-fa790a068a0a None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:07:23.888470 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-5c7f7651-71f5-41e0-a80c-fa790a068a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:07:23.896080 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 695/1391] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:07:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:07:23.935257 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3c325-431c-4809-9e3d-768cbb92da22 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:07:23.947048 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3c325-431c-4809-9e3d-768cbb92da22 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:07:23.951488 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3910d3-2581-4a49-a1dd-1c82fa933610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:07:23.952202 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3910d3-2581-4a49-a1dd-1c82fa933610 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:23.952481 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3910d3-2581-4a49-a1dd-1c82fa933610 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:23.952798 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3910d3-2581-4a49-a1dd-1c82fa933610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:23.962689 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3910d3-2581-4a49-a1dd-1c82fa933610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:07:23.964389 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3910d3-2581-4a49-a1dd-1c82fa933610 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:07:23.974789 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 697/1392] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:07:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:07:26.290856 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b6e99-9a5f-4353-bf5b-9598dc7bb20c None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:26.291453 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b6e99-9a5f-4353-bf5b-9598dc7bb20c None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:26.291453 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b6e99-9a5f-4353-bf5b-9598dc7bb20c None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:26.293294 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 696/1393] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:07:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:07:26.300299 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3cace-0d03-4d07-984c-3b722684d6fe None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:26.300767 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3cace-0d03-4d07-984c-3b722684d6fe None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:26.300912 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3cace-0d03-4d07-984c-3b722684d6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:26.320643 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-42c3cace-0d03-4d07-984c-3b722684d6fe None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:07:26.322394 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-42c3cace-0d03-4d07-984c-3b722684d6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:07:26.330303 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 698/1394] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:07:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:07:26.369346 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b6e99-9a5f-4353-bf5b-9598dc7bb20c None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:07:26.379982 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b6e99-9a5f-4353-bf5b-9598dc7bb20c None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:07:26.383944 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabce54-9cb1-4d87-bfc5-297531cbf638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:07:26.384607 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabce54-9cb1-4d87-bfc5-297531cbf638 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:26.384888 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabce54-9cb1-4d87-bfc5-297531cbf638 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:26.385158 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabce54-9cb1-4d87-bfc5-297531cbf638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:26.394054 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eabce54-9cb1-4d87-bfc5-297531cbf638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:07:26.395482 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eabce54-9cb1-4d87-bfc5-297531cbf638 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:07:26.404666 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 697/1395] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:07:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:07:28.658969 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ee4df-ac69-468a-bf2f-72f46f3af541 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:28.659514 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ee4df-ac69-468a-bf2f-72f46f3af541 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:28.659635 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ee4df-ac69-468a-bf2f-72f46f3af541 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:28.661374 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 699/1396] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:07:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:07:28.668772 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1250f-cf44-4c19-9dd8-223b4229b670 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:28.669198 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1250f-cf44-4c19-9dd8-223b4229b670 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:28.669302 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1250f-cf44-4c19-9dd8-223b4229b670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:28.688017 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-6ad1250f-cf44-4c19-9dd8-223b4229b670 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:07:28.689229 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-6ad1250f-cf44-4c19-9dd8-223b4229b670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:07:28.697495 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 698/1397] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:07:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:07:28.735982 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ee4df-ac69-468a-bf2f-72f46f3af541 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:07:28.747256 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ee4df-ac69-468a-bf2f-72f46f3af541 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:07:28.750795 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9331b3-3cff-4cd0-ab4a-a58961a1b42b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:07:28.751429 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9331b3-3cff-4cd0-ab4a-a58961a1b42b service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:28.751714 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9331b3-3cff-4cd0-ab4a-a58961a1b42b service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:28.751986 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9331b3-3cff-4cd0-ab4a-a58961a1b42b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:28.761191 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9331b3-3cff-4cd0-ab4a-a58961a1b42b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:07:28.762614 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9331b3-3cff-4cd0-ab4a-a58961a1b42b service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:07:28.771742 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 700/1398] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:07:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:07:30.999528 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a32a6a-e881-41f2-b72f-8f551e64b793 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:31.000105 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a32a6a-e881-41f2-b72f-8f551e64b793 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:31.000105 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a32a6a-e881-41f2-b72f-8f551e64b793 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:31.001896 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 699/1399] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:07:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:07:31.009543 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed014c15-6a33-4d70-bc36-55491ae8acb8 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:31.010029 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed014c15-6a33-4d70-bc36-55491ae8acb8 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:31.010128 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed014c15-6a33-4d70-bc36-55491ae8acb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:31.027503 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-ed014c15-6a33-4d70-bc36-55491ae8acb8 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:07:31.028734 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-ed014c15-6a33-4d70-bc36-55491ae8acb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:07:31.036449 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 701/1400] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:07:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:07:31.077895 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a32a6a-e881-41f2-b72f-8f551e64b793 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:07:31.089822 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a32a6a-e881-41f2-b72f-8f551e64b793 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:07:31.093390 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62ae99-12c5-4c89-9733-33ecacd6dc88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:07:31.096946 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62ae99-12c5-4c89-9733-33ecacd6dc88 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:31.096946 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62ae99-12c5-4c89-9733-33ecacd6dc88 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:31.096946 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62ae99-12c5-4c89-9733-33ecacd6dc88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:31.110885 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62ae99-12c5-4c89-9733-33ecacd6dc88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:07:31.112368 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62ae99-12c5-4c89-9733-33ecacd6dc88 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:07:31.129969 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 700/1401] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:07:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:07:33.317371 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4271f91-a8e0-47fe-b0e6-5105cb44225f None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:33.317912 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4271f91-a8e0-47fe-b0e6-5105cb44225f None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:33.317912 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4271f91-a8e0-47fe-b0e6-5105cb44225f None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:33.319740 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 702/1402] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:07:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:07:33.327421 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d63fd-a4b2-427f-a5af-48e79f687767 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:33.327853 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d63fd-a4b2-427f-a5af-48e79f687767 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:33.327962 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d63fd-a4b2-427f-a5af-48e79f687767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:33.345993 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-2e6d63fd-a4b2-427f-a5af-48e79f687767 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:07:33.347182 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-2e6d63fd-a4b2-427f-a5af-48e79f687767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:07:33.354974 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 701/1403] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:07:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:07:33.392794 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4271f91-a8e0-47fe-b0e6-5105cb44225f None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:07:33.403631 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4271f91-a8e0-47fe-b0e6-5105cb44225f None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:07:33.407043 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01aca05-3ec3-414c-906f-59560253812e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:07:33.407676 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aca05-3ec3-414c-906f-59560253812e service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:33.407956 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aca05-3ec3-414c-906f-59560253812e service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:33.408240 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aca05-3ec3-414c-906f-59560253812e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:33.416734 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01aca05-3ec3-414c-906f-59560253812e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:07:33.418156 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01aca05-3ec3-414c-906f-59560253812e service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:07:33.427151 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 703/1404] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:07:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:07:35.634746 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26992d-5360-4439-bf18-72b5c0244db0 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:35.635292 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26992d-5360-4439-bf18-72b5c0244db0 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:35.635292 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26992d-5360-4439-bf18-72b5c0244db0 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:35.637290 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 702/1405] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:07:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:07:35.644167 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d64638-4b47-47be-b020-689a1b15c364 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:35.644651 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d64638-4b47-47be-b020-689a1b15c364 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:35.644758 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d64638-4b47-47be-b020-689a1b15c364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:35.662697 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-e9d64638-4b47-47be-b020-689a1b15c364 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:07:35.663887 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-e9d64638-4b47-47be-b020-689a1b15c364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:07:35.671606 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 704/1406] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:07:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:07:35.709776 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26992d-5360-4439-bf18-72b5c0244db0 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:07:35.720808 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26992d-5360-4439-bf18-72b5c0244db0 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:07:35.724378 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3c0f1-ac50-4aa0-b8b5-740222f43132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:07:35.726197 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3c0f1-ac50-4aa0-b8b5-740222f43132 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:35.726488 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3c0f1-ac50-4aa0-b8b5-740222f43132 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:35.726784 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3c0f1-ac50-4aa0-b8b5-740222f43132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:35.735714 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3c0f1-ac50-4aa0-b8b5-740222f43132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:07:35.737172 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3c0f1-ac50-4aa0-b8b5-740222f43132 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:07:35.746567 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 703/1407] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:07:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:07:37.923284 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10efb3-8cbc-4463-b41d-3ec2f5b23a02 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:37.923811 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10efb3-8cbc-4463-b41d-3ec2f5b23a02 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:37.923925 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10efb3-8cbc-4463-b41d-3ec2f5b23a02 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:37.925654 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 705/1408] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:07:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:07:37.932705 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce89d7f-aae7-40af-8060-d5c6149a09ba None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:37.933096 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce89d7f-aae7-40af-8060-d5c6149a09ba None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:37.933272 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce89d7f-aae7-40af-8060-d5c6149a09ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:37.951061 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-2ce89d7f-aae7-40af-8060-d5c6149a09ba None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:07:37.952247 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-2ce89d7f-aae7-40af-8060-d5c6149a09ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:07:37.960095 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 704/1409] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:07:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:07:37.997409 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10efb3-8cbc-4463-b41d-3ec2f5b23a02 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:07:38.008624 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10efb3-8cbc-4463-b41d-3ec2f5b23a02 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:07:38.012227 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076ab66-e2b7-4a14-b712-e6fcb99d48f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:07:38.012904 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076ab66-e2b7-4a14-b712-e6fcb99d48f8 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:38.013190 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076ab66-e2b7-4a14-b712-e6fcb99d48f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:38.013467 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076ab66-e2b7-4a14-b712-e6fcb99d48f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:38.022050 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076ab66-e2b7-4a14-b712-e6fcb99d48f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:07:38.023997 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076ab66-e2b7-4a14-b712-e6fcb99d48f8 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:07:38.033237 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 706/1410] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:07:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:07:40.197256 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927e35c-33f8-450b-82ca-e8f469835564 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:40.197810 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927e35c-33f8-450b-82ca-e8f469835564 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:40.197810 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927e35c-33f8-450b-82ca-e8f469835564 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:40.199575 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 705/1411] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:07:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:07:40.206879 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f31d39-ff9c-48c5-aa29-98d6d2eb81cb None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:40.207280 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f31d39-ff9c-48c5-aa29-98d6d2eb81cb None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:40.207431 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f31d39-ff9c-48c5-aa29-98d6d2eb81cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:40.225246 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-90f31d39-ff9c-48c5-aa29-98d6d2eb81cb None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:07:40.227231 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-90f31d39-ff9c-48c5-aa29-98d6d2eb81cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:07:40.234866 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 707/1412] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:07:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:07:40.272354 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927e35c-33f8-450b-82ca-e8f469835564 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:07:40.282731 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927e35c-33f8-450b-82ca-e8f469835564 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:07:40.286249 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba4534-753b-411c-8dde-bf2c8a141e23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:07:40.286885 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba4534-753b-411c-8dde-bf2c8a141e23 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:40.287165 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba4534-753b-411c-8dde-bf2c8a141e23 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:40.287443 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba4534-753b-411c-8dde-bf2c8a141e23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:40.296584 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba4534-753b-411c-8dde-bf2c8a141e23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:07:40.298009 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba4534-753b-411c-8dde-bf2c8a141e23 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:07:40.307642 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 706/1413] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:07:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:07:57.153920 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0565b5-54e1-446f-b47a-ce1821673480 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:57.154474 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0565b5-54e1-446f-b47a-ce1821673480 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:57.154474 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0565b5-54e1-446f-b47a-ce1821673480 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:57.156150 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 708/1414] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:07:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:07:57.162129 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050e76f-d291-4b23-9c2b-3d8ede403b8a None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:57.162590 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050e76f-d291-4b23-9c2b-3d8ede403b8a None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:57.162717 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050e76f-d291-4b23-9c2b-3d8ede403b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:57.180669 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-2050e76f-d291-4b23-9c2b-3d8ede403b8a None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:07:57.181851 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-2050e76f-d291-4b23-9c2b-3d8ede403b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:07:57.189520 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 707/1415] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:07:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:07:57.238442 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574b916-8dc2-48f8-923e-6e57ae8c61f0 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:57.238727 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574b916-8dc2-48f8-923e-6e57ae8c61f0 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:57.239002 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574b916-8dc2-48f8-923e-6e57ae8c61f0 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:57.240817 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 709/1416] 10.222.0.23 () {54 vars in 961 bytes} [Thu Sep 23 03:07:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:07:57.246300 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b1057-098a-4da1-9ec3-774d89709439 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:57.246588 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b1057-098a-4da1-9ec3-774d89709439 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:57.246863 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b1057-098a-4da1-9ec3-774d89709439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:57.264807 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-ba7b1057-098a-4da1-9ec3-774d89709439 None None] MFA Rules not processed for user `83242c1ef12d4a5b800e67346f4ad963`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:07:57.266013 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-ba7b1057-098a-4da1-9ec3-774d89709439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:07:57.272404 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 708/1417] 10.222.0.23 () {58 vars in 1059 bytes} [Thu Sep 23 03:07:57 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:07:57.280125 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574b916-8dc2-48f8-923e-6e57ae8c61f0 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:07:57.291068 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574b916-8dc2-48f8-923e-6e57ae8c61f0 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:07:57.294602 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff011fec-4fa8-498f-949f-4b3776502ca9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83242c1ef12d4a5b800e67346f4ad963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:07:57.295258 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff011fec-4fa8-498f-949f-4b3776502ca9 service glance] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:57.295541 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff011fec-4fa8-498f-949f-4b3776502ca9 service glance] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:57.295816 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff011fec-4fa8-498f-949f-4b3776502ca9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:57.304456 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff011fec-4fa8-498f-949f-4b3776502ca9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:07:57.305895 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff011fec-4fa8-498f-949f-4b3776502ca9 service glance] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:07:57.314945 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 710/1418] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:07:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:07:59.560564 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfae4d-eb3e-4b84-b743-5ca63155e652 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:59.561131 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfae4d-eb3e-4b84-b743-5ca63155e652 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:59.561131 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfae4d-eb3e-4b84-b743-5ca63155e652 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:59.562874 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 709/1419] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:07:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:07:59.570682 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593bb17-dcf3-4a54-8c8a-e5a7db61b616 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:59.571133 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593bb17-dcf3-4a54-8c8a-e5a7db61b616 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:59.571234 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593bb17-dcf3-4a54-8c8a-e5a7db61b616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:59.590473 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-4593bb17-dcf3-4a54-8c8a-e5a7db61b616 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:07:59.591696 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-4593bb17-dcf3-4a54-8c8a-e5a7db61b616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:07:59.600193 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 711/1420] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:07:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:07:59.630842 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfae4d-eb3e-4b84-b743-5ca63155e652 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:07:59.643507 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfae4d-eb3e-4b84-b743-5ca63155e652 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:07:59.648545 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b47161-83e4-4b8a-80fc-d343d7703c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:07:59.649197 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b47161-83e4-4b8a-80fc-d343d7703c08 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:07:59.649476 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b47161-83e4-4b8a-80fc-d343d7703c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:07:59.649749 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b47161-83e4-4b8a-80fc-d343d7703c08 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:07:59.650473 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b47161-83e4-4b8a-80fc-d343d7703c08 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:07:59.652299 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b47161-83e4-4b8a-80fc-d343d7703c08 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:07:59.666064 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 710/1421] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 23 03:07:59 2021] GET /identity/v3/projects => generated 2553 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:08:01.855390 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8a74b-da25-44c1-a246-bb3442592ddb None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:08:01.855832 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8a74b-da25-44c1-a246-bb3442592ddb None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:08:01.855972 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8a74b-da25-44c1-a246-bb3442592ddb None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:08:01.857836 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 712/1422] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:08:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:08:01.866301 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e289832-4d23-4366-9cd7-26351b345bd0 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:08:01.866829 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e289832-4d23-4366-9cd7-26351b345bd0 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:08:01.866966 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e289832-4d23-4366-9cd7-26351b345bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:08:01.886846 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-4e289832-4d23-4366-9cd7-26351b345bd0 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:08:01.888036 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-4e289832-4d23-4366-9cd7-26351b345bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:08:01.895708 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 711/1423] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:08:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:08:01.939097 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8a74b-da25-44c1-a246-bb3442592ddb None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:08:01.953630 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8a74b-da25-44c1-a246-bb3442592ddb None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:08:01.959065 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01202428-59c2-4cd7-af44-841a3f5200ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:08:01.959729 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01202428-59c2-4cd7-af44-841a3f5200ae service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:08:01.960683 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01202428-59c2-4cd7-af44-841a3f5200ae service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:08:01.960963 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01202428-59c2-4cd7-af44-841a3f5200ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:08:01.968926 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01202428-59c2-4cd7-af44-841a3f5200ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:08:01.970518 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01202428-59c2-4cd7-af44-841a3f5200ae service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:08:01.979694 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 713/1424] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:08:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:08:04.309186 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f3a63-80ef-4f09-ab9b-b81647925fda None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:08:04.309722 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f3a63-80ef-4f09-ab9b-b81647925fda None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:08:04.309722 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f3a63-80ef-4f09-ab9b-b81647925fda None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:08:04.311513 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 712/1425] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:08:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:08:04.318483 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecd188-070b-4f35-b725-02c20df86c8d None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:08:04.318893 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecd188-070b-4f35-b725-02c20df86c8d None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:08:04.319563 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecd188-070b-4f35-b725-02c20df86c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:08:04.338030 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-fbecd188-070b-4f35-b725-02c20df86c8d None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:08:04.339219 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-fbecd188-070b-4f35-b725-02c20df86c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:08:04.346915 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 714/1426] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:08:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:08:04.384258 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f3a63-80ef-4f09-ab9b-b81647925fda None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:08:04.394840 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f3a63-80ef-4f09-ab9b-b81647925fda None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:08:04.398905 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc5e26-5635-40d8-a506-96977329c0a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:08:04.399544 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc5e26-5635-40d8-a506-96977329c0a1 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:08:04.399826 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc5e26-5635-40d8-a506-96977329c0a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:08:04.400101 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc5e26-5635-40d8-a506-96977329c0a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:08:04.408678 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc5e26-5635-40d8-a506-96977329c0a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:08:04.410096 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc5e26-5635-40d8-a506-96977329c0a1 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:08:04.419185 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 713/1427] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:08:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:08:06.775717 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71068a5-37b3-4acd-b5ce-8fae13478d2c None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:08:06.776261 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71068a5-37b3-4acd-b5ce-8fae13478d2c None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:08:06.776261 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71068a5-37b3-4acd-b5ce-8fae13478d2c None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:08:06.778056 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 715/1428] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:08:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:08:06.785420 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be289ac-1f4c-4e0e-baa4-c0302cdb6c45 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:08:06.785836 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be289ac-1f4c-4e0e-baa4-c0302cdb6c45 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:08:06.786014 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be289ac-1f4c-4e0e-baa4-c0302cdb6c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:08:06.805005 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-4be289ac-1f4c-4e0e-baa4-c0302cdb6c45 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:08:06.806229 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-4be289ac-1f4c-4e0e-baa4-c0302cdb6c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:08:06.814241 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 714/1429] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:08:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:08:06.854146 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71068a5-37b3-4acd-b5ce-8fae13478d2c None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:08:06.864815 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71068a5-37b3-4acd-b5ce-8fae13478d2c None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:08:06.868360 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee24b6d-40e5-4937-9c87-7fbc487e0dd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:08:06.869034 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee24b6d-40e5-4937-9c87-7fbc487e0dd0 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:08:06.869321 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee24b6d-40e5-4937-9c87-7fbc487e0dd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:08:06.871655 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee24b6d-40e5-4937-9c87-7fbc487e0dd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:08:06.878648 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee24b6d-40e5-4937-9c87-7fbc487e0dd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:08:06.880077 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee24b6d-40e5-4937-9c87-7fbc487e0dd0 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:08:06.889191 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 716/1430] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:08:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:08:09.160564 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8501bc-2a6b-477d-a69c-8846b98fb416 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:08:09.161078 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8501bc-2a6b-477d-a69c-8846b98fb416 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:08:09.161078 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8501bc-2a6b-477d-a69c-8846b98fb416 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:08:09.163469 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 715/1431] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:08:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:08:09.170671 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e35689-7051-44c6-a470-528db7fc218e None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:08:09.171084 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e35689-7051-44c6-a470-528db7fc218e None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:08:09.171238 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e35689-7051-44c6-a470-528db7fc218e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:08:09.188615 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-35e35689-7051-44c6-a470-528db7fc218e None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:08:09.189814 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-35e35689-7051-44c6-a470-528db7fc218e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:08:09.197522 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 717/1432] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:08:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:08:09.238714 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8501bc-2a6b-477d-a69c-8846b98fb416 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:08:09.249509 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8501bc-2a6b-477d-a69c-8846b98fb416 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:08:09.253035 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec439e7-ebff-4807-b541-432f26735e77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:08:09.253677 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec439e7-ebff-4807-b541-432f26735e77 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:08:09.253962 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec439e7-ebff-4807-b541-432f26735e77 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:08:09.254242 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec439e7-ebff-4807-b541-432f26735e77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:08:09.262947 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec439e7-ebff-4807-b541-432f26735e77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:08:09.264377 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec439e7-ebff-4807-b541-432f26735e77 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:08:09.276552 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 716/1433] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:08:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:08:11.898658 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e765484-e7a0-404c-b018-78f542d8ddac None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:08:11.899211 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e765484-e7a0-404c-b018-78f542d8ddac None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:08:11.899211 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e765484-e7a0-404c-b018-78f542d8ddac None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:08:11.901002 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 718/1434] 10.222.0.23 () {54 vars in 926 bytes} [Thu Sep 23 03:08:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:08:11.908054 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be625f-ad96-43f4-955d-a471b2cf8c45 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:08:11.908514 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be625f-ad96-43f4-955d-a471b2cf8c45 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:08:11.908644 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be625f-ad96-43f4-955d-a471b2cf8c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:08:11.925974 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-d5be625f-ad96-43f4-955d-a471b2cf8c45 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:08:11.927166 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-d5be625f-ad96-43f4-955d-a471b2cf8c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:08:11.935635 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 717/1435] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 23 03:08:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:08:11.979167 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e765484-e7a0-404c-b018-78f542d8ddac None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:08:11.989613 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e765484-e7a0-404c-b018-78f542d8ddac None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:08:11.993751 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6834c5a-6caf-4152-8c64-0428642f19ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:08:11.994425 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6834c5a-6caf-4152-8c64-0428642f19ab service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:08:11.994705 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6834c5a-6caf-4152-8c64-0428642f19ab service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:08:11.995261 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6834c5a-6caf-4152-8c64-0428642f19ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:08:12.004084 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6834c5a-6caf-4152-8c64-0428642f19ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:08:12.005554 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6834c5a-6caf-4152-8c64-0428642f19ab service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:08:12.015349 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 719/1436] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:08:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:09:30.996238 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defdc6d-4307-4a93-9644-61f91e779a3c None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:09:30.996887 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defdc6d-4307-4a93-9644-61f91e779a3c None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:09:30.996887 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defdc6d-4307-4a93-9644-61f91e779a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:09:31.014919 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-9defdc6d-4307-4a93-9644-61f91e779a3c None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:09:31.016109 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-9defdc6d-4307-4a93-9644-61f91e779a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:09:31.023859 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 718/1437] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:09:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:09:31.031756 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fd03c-365b-4efd-8951-6241da575321 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:09:31.032240 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fd03c-365b-4efd-8951-6241da575321 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:09:31.032347 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fd03c-365b-4efd-8951-6241da575321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:09:31.050948 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-6c3fd03c-365b-4efd-8951-6241da575321 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:09:31.052101 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-6c3fd03c-365b-4efd-8951-6241da575321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:09:31.059672 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 720/1438] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:09:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:09:31.064047 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defdc6d-4307-4a93-9644-61f91e779a3c None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:09:31.073334 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defdc6d-4307-4a93-9644-61f91e779a3c None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:09:31.077690 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb88f3-d3d5-4f67-8228-280ff828f847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:09:31.078337 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb88f3-d3d5-4f67-8228-280ff828f847 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:09:31.078620 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb88f3-d3d5-4f67-8228-280ff828f847 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:09:31.078895 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb88f3-d3d5-4f67-8228-280ff828f847 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:09:31.079602 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb88f3-d3d5-4f67-8228-280ff828f847 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:09:31.079905 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb88f3-d3d5-4f67-8228-280ff828f847 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:09:31.081514 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb88f3-d3d5-4f67-8228-280ff828f847 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:09:31.092399 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 719/1439] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:09:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:09:31.100513 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3fd03c-365b-4efd-8951-6241da575321 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:09:31.109189 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3fd03c-365b-4efd-8951-6241da575321 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:09:31.113804 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad8bf3-5b16-4b22-8d73-a93b67b40d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:09:31.114443 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad8bf3-5b16-4b22-8d73-a93b67b40d8e admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:09:31.114724 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad8bf3-5b16-4b22-8d73-a93b67b40d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:09:31.115000 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad8bf3-5b16-4b22-8d73-a93b67b40d8e admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:09:31.115682 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad8bf3-5b16-4b22-8d73-a93b67b40d8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:09:31.117847 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad8bf3-5b16-4b22-8d73-a93b67b40d8e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:09:31.224821 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 721/1440] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:09:31 2021] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:09:31.229006 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb88f3-d3d5-4f67-8228-280ff828f847 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:09:31.238692 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb88f3-d3d5-4f67-8228-280ff828f847 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:09:31.292297 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e6897-3805-4828-aefe-e0be93c2a5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:09:31.293059 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e6897-3805-4828-aefe-e0be93c2a5e2 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:09:31.293346 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e6897-3805-4828-aefe-e0be93c2a5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:09:31.293632 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e6897-3805-4828-aefe-e0be93c2a5e2 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:09:31.294312 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e6897-3805-4828-aefe-e0be93c2a5e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:09:31.296216 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e6897-3805-4828-aefe-e0be93c2a5e2 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:09:31.366263 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 720/1441] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:09:31 2021] POST /identity/v3/users => generated 290 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:09:31.370544 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad8bf3-5b16-4b22-8d73-a93b67b40d8e admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:09:31.381324 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad8bf3-5b16-4b22-8d73-a93b67b40d8e admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:09:31.385928 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5795b-876f-4ac4-ace9-49dd06cd922d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:09:31.386595 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5795b-876f-4ac4-ace9-49dd06cd922d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:09:31.386880 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5795b-876f-4ac4-ace9-49dd06cd922d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:09:31.387159 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5795b-876f-4ac4-ace9-49dd06cd922d admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:09:31.387885 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5795b-876f-4ac4-ace9-49dd06cd922d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:09:31.389535 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5795b-876f-4ac4-ace9-49dd06cd922d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:09:31.406345 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 722/1442] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:09:31 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:09:31.410324 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e6897-3805-4828-aefe-e0be93c2a5e2 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:09:31.420183 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e6897-3805-4828-aefe-e0be93c2a5e2 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:09:31.425213 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790531f-ac63-402f-931d-1f6266bc361d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:09:31.425877 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790531f-ac63-402f-931d-1f6266bc361d admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:09:31.426166 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790531f-ac63-402f-931d-1f6266bc361d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:09:31.426445 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790531f-ac63-402f-931d-1f6266bc361d admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:09:31.427166 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790531f-ac63-402f-931d-1f6266bc361d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:09:31.428806 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790531f-ac63-402f-931d-1f6266bc361d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:09:31.442196 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 721/1443] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:09:31 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:09:31.446029 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5795b-876f-4ac4-ace9-49dd06cd922d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:09:31.456021 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5795b-876f-4ac4-ace9-49dd06cd922d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:09:31.460645 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4b945-e085-4db7-918b-3fc598090eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:09:31.461546 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4b945-e085-4db7-918b-3fc598090eb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:09:31.461830 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4b945-e085-4db7-918b-3fc598090eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:09:31.462108 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4b945-e085-4db7-918b-3fc598090eb0 admin admin] PATH_INFO: `/v3/projects/7240bb50a9c14cba9b73a80e31d75bb3/users/3359f21761234a739443a917d160226c/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:09:31.475953 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e4b945-e085-4db7-918b-3fc598090eb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7240bb50a9c14cba9b73a80e31d75bb3, user_id=3359f21761234a739443a917d160226c, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:09:31.478611 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e4b945-e085-4db7-918b-3fc598090eb0 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:09:31.548721 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 723/1444] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:09:31 2021] PUT /identity/v3/projects/7240bb50a9c14cba9b73a80e31d75bb3/users/3359f21761234a739443a917d160226c/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:09:31.561247 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db531031-3e2c-4304-8ec6-c195bb9b5dd6 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:09:31.561536 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db531031-3e2c-4304-8ec6-c195bb9b5dd6 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:09:31.561815 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db531031-3e2c-4304-8ec6-c195bb9b5dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:09:31.587120 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-db531031-3e2c-4304-8ec6-c195bb9b5dd6 None None] MFA Rules not processed for user `3359f21761234a739443a917d160226c`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:09:31.588304 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-db531031-3e2c-4304-8ec6-c195bb9b5dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:09:31.649828 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 722/1445] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:09:31 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:09:31.663137 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4b945-e085-4db7-918b-3fc598090eb0 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:09:31.729046 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4b945-e085-4db7-918b-3fc598090eb0 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:09:31.734644 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee10bd7-b16c-43f4-8e56-7b949edde023 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:09:31.735299 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee10bd7-b16c-43f4-8e56-7b949edde023 service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:09:31.735599 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee10bd7-b16c-43f4-8e56-7b949edde023 service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:09:31.735874 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee10bd7-b16c-43f4-8e56-7b949edde023 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:09:31.744162 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee10bd7-b16c-43f4-8e56-7b949edde023 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:09:31.745774 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee10bd7-b16c-43f4-8e56-7b949edde023 service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:09:31.754742 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 724/1446] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:09:31 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:09:31.821887 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13141f-fc41-4227-9c4f-15ead8cfe7a7 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:09:31.822173 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13141f-fc41-4227-9c4f-15ead8cfe7a7 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:09:31.822451 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13141f-fc41-4227-9c4f-15ead8cfe7a7 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:09:31.824123 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 723/1447] 10.222.0.23 () {52 vars in 829 bytes} [Thu Sep 23 03:09:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:09:31.827618 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee10bd7-b16c-43f4-8e56-7b949edde023 service nova] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:09:31.890389 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee10bd7-b16c-43f4-8e56-7b949edde023 service nova] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:09:31.894965 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401c34b-22b5-4724-984a-8448b0005149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:09:31.895832 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401c34b-22b5-4724-984a-8448b0005149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:09:31.896116 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401c34b-22b5-4724-984a-8448b0005149 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:09:31.896393 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401c34b-22b5-4724-984a-8448b0005149 admin admin] PATH_INFO: `/v3/users/3359f21761234a739443a917d160226c` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:09:31.897605 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401c34b-22b5-4724-984a-8448b0005149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3359f21761234a739443a917d160226c)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:09:31.898676 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING py.warnings [None req-5401c34b-22b5-4724-984a-8448b0005149 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:09:31.898676 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: warnings.warn(msg) Sep 23 03:09:31.898676 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: Sep 23 03:09:31.899923 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401c34b-22b5-4724-984a-8448b0005149 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:09:32.094496 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-5401c34b-22b5-4724-984a-8448b0005149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3359f21761234a739443a917d160226c'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:09:32.095145 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-5401c34b-22b5-4724-984a-8448b0005149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3359f21761234a739443a917d160226c'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:09:32.095905 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-5401c34b-22b5-4724-984a-8448b0005149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3359f21761234a739443a917d160226c'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:09:32.108332 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-5401c34b-22b5-4724-984a-8448b0005149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3359f21761234a739443a917d160226c'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:09:32.177954 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-5401c34b-22b5-4724-984a-8448b0005149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3359f21761234a739443a917d160226c'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:09:32.202750 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 725/1448] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:09:31 2021] DELETE /identity/v3/users/3359f21761234a739443a917d160226c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:09:32.207823 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765c9f0-2ba1-4b44-9dd7-07d225259d57 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:09:32.208390 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765c9f0-2ba1-4b44-9dd7-07d225259d57 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:09:32.208390 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765c9f0-2ba1-4b44-9dd7-07d225259d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:09:32.227692 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-3765c9f0-2ba1-4b44-9dd7-07d225259d57 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:09:32.229150 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-3765c9f0-2ba1-4b44-9dd7-07d225259d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:09:32.284853 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 724/1449] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:09:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:09:32.294748 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401c34b-22b5-4724-984a-8448b0005149 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:09:32.296139 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-5401c34b-22b5-4724-984a-8448b0005149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:09:32.352966 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401c34b-22b5-4724-984a-8448b0005149 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:09:32.356516 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c6794-abf9-4091-b1d5-8a8ab8b7b2ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:09:32.357162 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c6794-abf9-4091-b1d5-8a8ab8b7b2ea service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:09:32.357441 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c6794-abf9-4091-b1d5-8a8ab8b7b2ea service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:09:32.357714 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c6794-abf9-4091-b1d5-8a8ab8b7b2ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:09:32.366321 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c6794-abf9-4091-b1d5-8a8ab8b7b2ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:09:32.368005 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c6794-abf9-4091-b1d5-8a8ab8b7b2ea service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:09:32.377750 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 726/1450] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:09:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:09:32.869344 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765c9f0-2ba1-4b44-9dd7-07d225259d57 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:09:32.870771 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-3765c9f0-2ba1-4b44-9dd7-07d225259d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:09:32.884424 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765c9f0-2ba1-4b44-9dd7-07d225259d57 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:09:32.890679 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51d5b7-6c7b-4fac-a39f-a77cc8ea0e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:09:32.891697 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51d5b7-6c7b-4fac-a39f-a77cc8ea0e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:09:32.892166 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51d5b7-6c7b-4fac-a39f-a77cc8ea0e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:09:32.892686 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51d5b7-6c7b-4fac-a39f-a77cc8ea0e71 admin admin] PATH_INFO: `/v3/projects/7240bb50a9c14cba9b73a80e31d75bb3` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:09:32.895606 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51d5b7-6c7b-4fac-a39f-a77cc8ea0e71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7240bb50a9c14cba9b73a80e31d75bb3)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:09:32.897221 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING py.warnings [None req-de51d5b7-6c7b-4fac-a39f-a77cc8ea0e71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:09:32.897221 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: warnings.warn(msg) Sep 23 03:09:32.897221 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: Sep 23 03:09:32.898882 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51d5b7-6c7b-4fac-a39f-a77cc8ea0e71 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:09:33.021283 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-de51d5b7-6c7b-4fac-a39f-a77cc8ea0e71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7240bb50a9c14cba9b73a80e31d75bb3', 'request_id': 'req-de51d5b7-6c7b-4fac-a39f-a77cc8ea0e71'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:09:33.115000 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-de51d5b7-6c7b-4fac-a39f-a77cc8ea0e71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7240bb50a9c14cba9b73a80e31d75bb3', 'request_id': 'req-de51d5b7-6c7b-4fac-a39f-a77cc8ea0e71'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:09:33.121125 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-de51d5b7-6c7b-4fac-a39f-a77cc8ea0e71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7240bb50a9c14cba9b73a80e31d75bb3', 'request_id': 'req-de51d5b7-6c7b-4fac-a39f-a77cc8ea0e71'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:09:33.139076 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-de51d5b7-6c7b-4fac-a39f-a77cc8ea0e71 admin admin] The token cache is being invalidate because project 7240bb50a9c14cba9b73a80e31d75bb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:09:33.139414 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-de51d5b7-6c7b-4fac-a39f-a77cc8ea0e71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:09:33.140049 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-de51d5b7-6c7b-4fac-a39f-a77cc8ea0e71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:09:33.141675 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 725/1451] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:09:32 2021] DELETE /identity/v3/projects/7240bb50a9c14cba9b73a80e31d75bb3 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:10:58.494295 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38428ae-ad4a-4804-8b8a-f9dd7d281dc1 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:10:58.494849 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38428ae-ad4a-4804-8b8a-f9dd7d281dc1 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:10:58.494849 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38428ae-ad4a-4804-8b8a-f9dd7d281dc1 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:10:58.496649 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 727/1452] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 23 03:10:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:10:58.501870 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979f7f5-4631-4119-8d3f-af2e17142bd4 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:10:58.502300 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979f7f5-4631-4119-8d3f-af2e17142bd4 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:10:58.502427 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979f7f5-4631-4119-8d3f-af2e17142bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:10:58.520403 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-b979f7f5-4631-4119-8d3f-af2e17142bd4 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:10:58.521629 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-b979f7f5-4631-4119-8d3f-af2e17142bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:10:58.587688 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 726/1453] 127.0.0.1 () {58 vars in 999 bytes} [Thu Sep 23 03:10:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:10:58.737428 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38428ae-ad4a-4804-8b8a-f9dd7d281dc1 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:10:58.739088 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-d38428ae-ad4a-4804-8b8a-f9dd7d281dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:10:58.811700 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38428ae-ad4a-4804-8b8a-f9dd7d281dc1 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:10:58.820437 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee551ff-5b34-4ae5-8a11-8661d8d9dad9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:10:58.821163 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee551ff-5b34-4ae5-8a11-8661d8d9dad9 service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:10:58.821442 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee551ff-5b34-4ae5-8a11-8661d8d9dad9 service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:10:58.821741 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee551ff-5b34-4ae5-8a11-8661d8d9dad9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:10:58.832583 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee551ff-5b34-4ae5-8a11-8661d8d9dad9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:10:58.834172 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee551ff-5b34-4ae5-8a11-8661d8d9dad9 service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:10:58.843896 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 728/1454] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:10:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:10:58.919417 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f52e2d-0c4d-4e01-af2f-bd0609dd94f6 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:10:58.919822 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f52e2d-0c4d-4e01-af2f-bd0609dd94f6 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:10:58.920028 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f52e2d-0c4d-4e01-af2f-bd0609dd94f6 None None] PATH_INFO: `/v3` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:10:58.921427 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 727/1455] 10.222.0.13 () {54 vars in 926 bytes} [Thu Sep 23 03:10:58 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:10:58.930391 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7dfb0e-967c-495f-8ae4-032ed86e47af None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:10:58.930688 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7dfb0e-967c-495f-8ae4-032ed86e47af None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:10:58.930974 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7dfb0e-967c-495f-8ae4-032ed86e47af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:10:58.950363 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-4e7dfb0e-967c-495f-8ae4-032ed86e47af None None] MFA Rules not processed for user `58b7e780a23e4ee499cb7820a85feccb`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:10:58.951614 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-4e7dfb0e-967c-495f-8ae4-032ed86e47af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:10:59.014072 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 729/1456] 10.222.0.13 () {58 vars in 1016 bytes} [Thu Sep 23 03:10:58 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:11:00.261494 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dec78-1211-4c5b-a2ac-63c18c0d1689 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:11:00.262072 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dec78-1211-4c5b-a2ac-63c18c0d1689 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:11:00.262072 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dec78-1211-4c5b-a2ac-63c18c0d1689 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:11:00.263769 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 728/1457] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 23 03:11:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:11:00.269214 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a792f2d-8be1-4c43-b301-db3df5cf083b None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:11:00.269654 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a792f2d-8be1-4c43-b301-db3df5cf083b None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:11:00.269762 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a792f2d-8be1-4c43-b301-db3df5cf083b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:11:00.288058 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-1a792f2d-8be1-4c43-b301-db3df5cf083b None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:11:00.289276 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-1a792f2d-8be1-4c43-b301-db3df5cf083b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:11:00.297628 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 730/1458] 127.0.0.1 () {58 vars in 999 bytes} [Thu Sep 23 03:11:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:11:00.451495 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dec78-1211-4c5b-a2ac-63c18c0d1689 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:11:00.465650 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dec78-1211-4c5b-a2ac-63c18c0d1689 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:11:00.471563 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00989da1-6816-4811-9228-5651c6594835 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:11:00.472202 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00989da1-6816-4811-9228-5651c6594835 service nova] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:11:00.472496 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00989da1-6816-4811-9228-5651c6594835 service nova] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:11:00.472791 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00989da1-6816-4811-9228-5651c6594835 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:11:00.480712 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00989da1-6816-4811-9228-5651c6594835 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:11:00.482301 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00989da1-6816-4811-9228-5651c6594835 service nova] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:11:00.492225 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 729/1459] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:11:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:11:07.958750 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ba68d-41de-4b4a-899e-4892847b30ae None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:11:07.959213 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ba68d-41de-4b4a-899e-4892847b30ae None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:11:07.959315 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ba68d-41de-4b4a-899e-4892847b30ae None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:11:07.961134 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 731/1460] 10.222.0.23 () {54 vars in 960 bytes} [Thu Sep 23 03:11:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:11:07.966809 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202efef-487e-431b-a685-59852485d10f None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:11:07.967267 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202efef-487e-431b-a685-59852485d10f None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:11:07.967400 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202efef-487e-431b-a685-59852485d10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:11:07.986408 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-5202efef-487e-431b-a685-59852485d10f None None] MFA Rules not processed for user `58b7e780a23e4ee499cb7820a85feccb`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:11:07.987635 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-5202efef-487e-431b-a685-59852485d10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:11:07.996647 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 730/1461] 10.222.0.23 () {58 vars in 1058 bytes} [Thu Sep 23 03:11:07 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:11:08.004516 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ba68d-41de-4b4a-899e-4892847b30ae None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:11:08.017877 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ba68d-41de-4b4a-899e-4892847b30ae None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:11:08.022924 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627142fe-da7b-4cad-9cb2-37fa7f6d1195 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b7e780a23e4ee499cb7820a85feccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:11:08.023569 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627142fe-da7b-4cad-9cb2-37fa7f6d1195 service placement] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:11:08.023852 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627142fe-da7b-4cad-9cb2-37fa7f6d1195 service placement] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:11:08.024129 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627142fe-da7b-4cad-9cb2-37fa7f6d1195 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:11:08.032798 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627142fe-da7b-4cad-9cb2-37fa7f6d1195 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:11:08.034374 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627142fe-da7b-4cad-9cb2-37fa7f6d1195 service placement] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:11:08.043870 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 732/1462] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:11:08 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:11:12.247492 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97563895-7cf1-4b2f-8f70-c040e46e235a None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:11:12.248111 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97563895-7cf1-4b2f-8f70-c040e46e235a None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:11:12.248111 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97563895-7cf1-4b2f-8f70-c040e46e235a None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:11:12.250382 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 731/1463] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 23 03:11:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:11:12.255830 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c6e11-0f08-4330-adcc-a014a754cb8e None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:11:12.262258 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c6e11-0f08-4330-adcc-a014a754cb8e None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:11:12.262258 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c6e11-0f08-4330-adcc-a014a754cb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:11:12.274720 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-533c6e11-0f08-4330-adcc-a014a754cb8e None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:11:12.275909 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-533c6e11-0f08-4330-adcc-a014a754cb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:11:12.283696 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 733/1464] 127.0.0.1 () {58 vars in 999 bytes} [Thu Sep 23 03:11:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:11:12.436359 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97563895-7cf1-4b2f-8f70-c040e46e235a None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:11:12.450946 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97563895-7cf1-4b2f-8f70-c040e46e235a None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:11:12.457116 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa6424-dd49-44d4-82e2-7bedf1ec1bb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:11:12.457754 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa6424-dd49-44d4-82e2-7bedf1ec1bb5 service nova] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:11:12.458037 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa6424-dd49-44d4-82e2-7bedf1ec1bb5 service nova] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:11:12.458312 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa6424-dd49-44d4-82e2-7bedf1ec1bb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:11:12.466308 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa6424-dd49-44d4-82e2-7bedf1ec1bb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:11:12.467918 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa6424-dd49-44d4-82e2-7bedf1ec1bb5 service nova] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:11:12.476974 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 732/1465] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:11:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:11:13.828645 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2450cd3-57d6-4ad2-b2d4-67c4ed37fdd8 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:11:13.829134 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2450cd3-57d6-4ad2-b2d4-67c4ed37fdd8 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:11:13.829269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2450cd3-57d6-4ad2-b2d4-67c4ed37fdd8 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:11:13.830971 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 734/1466] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 23 03:11:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:11:13.836312 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb1eff-886c-4e9b-ad6e-ae6874291acf None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:11:13.836804 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb1eff-886c-4e9b-ad6e-ae6874291acf None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:11:13.836933 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb1eff-886c-4e9b-ad6e-ae6874291acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:11:13.855033 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-f3fb1eff-886c-4e9b-ad6e-ae6874291acf None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:11:13.856227 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-f3fb1eff-886c-4e9b-ad6e-ae6874291acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:11:13.865247 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 733/1467] 127.0.0.1 () {58 vars in 999 bytes} [Thu Sep 23 03:11:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:11:14.020705 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2450cd3-57d6-4ad2-b2d4-67c4ed37fdd8 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:11:14.035475 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2450cd3-57d6-4ad2-b2d4-67c4ed37fdd8 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:11:14.040926 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1a545-f2fd-4afb-aad5-7278fa0ee8fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:11:14.041564 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1a545-f2fd-4afb-aad5-7278fa0ee8fe service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:11:14.041847 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1a545-f2fd-4afb-aad5-7278fa0ee8fe service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:11:14.042127 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1a545-f2fd-4afb-aad5-7278fa0ee8fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:11:14.050581 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1a545-f2fd-4afb-aad5-7278fa0ee8fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:11:14.052150 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1a545-f2fd-4afb-aad5-7278fa0ee8fe service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:11:14.061354 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 735/1468] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:11:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:11:18.322260 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a7c00-17d3-4a96-9bd1-c6e75797f4ff None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:11:18.322718 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a7c00-17d3-4a96-9bd1-c6e75797f4ff None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:11:18.322836 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a7c00-17d3-4a96-9bd1-c6e75797f4ff None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:11:18.324626 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 734/1469] 127.0.0.1 () {54 vars in 916 bytes} [Thu Sep 23 03:11:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:11:18.333868 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82083e05-0d34-40f7-8847-18ea4d2e20b6 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:11:18.334285 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82083e05-0d34-40f7-8847-18ea4d2e20b6 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:11:18.334426 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82083e05-0d34-40f7-8847-18ea4d2e20b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:11:18.355164 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-82083e05-0d34-40f7-8847-18ea4d2e20b6 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:11:18.356365 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-82083e05-0d34-40f7-8847-18ea4d2e20b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:11:18.367737 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 736/1470] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 23 03:11:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:11:18.407611 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a7c00-17d3-4a96-9bd1-c6e75797f4ff None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:11:18.410014 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-cf2a7c00-17d3-4a96-9bd1-c6e75797f4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:11:18.468764 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a7c00-17d3-4a96-9bd1-c6e75797f4ff None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:11:18.472311 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f961a5-32a3-485e-980e-1969a7083b1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:11:18.472995 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f961a5-32a3-485e-980e-1969a7083b1c service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:11:18.473278 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f961a5-32a3-485e-980e-1969a7083b1c service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:11:18.473555 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f961a5-32a3-485e-980e-1969a7083b1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:11:18.482616 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f961a5-32a3-485e-980e-1969a7083b1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:11:18.484070 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f961a5-32a3-485e-980e-1969a7083b1c service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:11:18.493539 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 735/1471] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:11:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:11:20.660018 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d34c58-3062-4453-9265-3327c61ca55c None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:11:20.660569 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d34c58-3062-4453-9265-3327c61ca55c None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:11:20.660569 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d34c58-3062-4453-9265-3327c61ca55c None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:11:20.662315 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 737/1472] 127.0.0.1 () {54 vars in 916 bytes} [Thu Sep 23 03:11:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:11:20.669325 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1790c94-5fd9-445f-b719-18310e643965 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:11:20.669757 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1790c94-5fd9-445f-b719-18310e643965 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:11:20.669912 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1790c94-5fd9-445f-b719-18310e643965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:11:20.689632 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-c1790c94-5fd9-445f-b719-18310e643965 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:11:20.691759 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-c1790c94-5fd9-445f-b719-18310e643965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:11:20.702968 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 736/1473] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 23 03:11:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:11:20.740293 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d34c58-3062-4453-9265-3327c61ca55c None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:11:20.751075 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d34c58-3062-4453-9265-3327c61ca55c None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:11:20.754769 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e279dbc-c360-4503-a5ad-e6d1cae0cc01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:11:20.755405 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e279dbc-c360-4503-a5ad-e6d1cae0cc01 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:11:20.755684 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e279dbc-c360-4503-a5ad-e6d1cae0cc01 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:11:20.755958 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e279dbc-c360-4503-a5ad-e6d1cae0cc01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:11:20.764678 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e279dbc-c360-4503-a5ad-e6d1cae0cc01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:11:20.766103 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e279dbc-c360-4503-a5ad-e6d1cae0cc01 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:11:20.775133 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 738/1474] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:11:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:11:24.365791 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa250b1a-fb0b-401b-93c2-0d284d44f7a9 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:11:24.366312 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa250b1a-fb0b-401b-93c2-0d284d44f7a9 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:11:24.366418 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa250b1a-fb0b-401b-93c2-0d284d44f7a9 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:11:24.368105 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 737/1475] 127.0.0.1 () {54 vars in 916 bytes} [Thu Sep 23 03:11:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:11:24.375323 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d51b2-61ad-4eb8-ba06-4dc60bea2ff2 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:11:24.375752 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d51b2-61ad-4eb8-ba06-4dc60bea2ff2 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:11:24.375880 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d51b2-61ad-4eb8-ba06-4dc60bea2ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:11:24.393876 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-068d51b2-61ad-4eb8-ba06-4dc60bea2ff2 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:11:24.395080 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-068d51b2-61ad-4eb8-ba06-4dc60bea2ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:11:24.402937 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 739/1476] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 23 03:11:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:11:24.453474 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa250b1a-fb0b-401b-93c2-0d284d44f7a9 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:11:24.455150 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-fa250b1a-fb0b-401b-93c2-0d284d44f7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:11:24.511349 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa250b1a-fb0b-401b-93c2-0d284d44f7a9 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:11:24.515452 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d756d43-d4ab-4260-88bc-9c222ab8b014 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:11:24.516095 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d756d43-d4ab-4260-88bc-9c222ab8b014 service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:11:24.516378 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d756d43-d4ab-4260-88bc-9c222ab8b014 service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:11:24.516686 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d756d43-d4ab-4260-88bc-9c222ab8b014 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:11:24.525291 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d756d43-d4ab-4260-88bc-9c222ab8b014 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:11:24.526716 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d756d43-d4ab-4260-88bc-9c222ab8b014 service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:11:24.535754 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 738/1477] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:11:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:11:26.714834 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be10d00-9bb7-4ddf-9fa9-73b5313f86e2 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:11:26.715361 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be10d00-9bb7-4ddf-9fa9-73b5313f86e2 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:11:26.715361 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be10d00-9bb7-4ddf-9fa9-73b5313f86e2 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:11:26.717589 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 740/1478] 127.0.0.1 () {54 vars in 916 bytes} [Thu Sep 23 03:11:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:11:26.724411 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29797809-9c1e-484b-b1b1-ca9150d9cb72 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:11:26.724838 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29797809-9c1e-484b-b1b1-ca9150d9cb72 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:11:26.725007 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29797809-9c1e-484b-b1b1-ca9150d9cb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:11:26.742860 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-29797809-9c1e-484b-b1b1-ca9150d9cb72 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:11:26.744079 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-29797809-9c1e-484b-b1b1-ca9150d9cb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:11:26.752161 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 739/1479] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 23 03:11:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:11:26.803061 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab97b8-857a-41dd-b0f4-fde5eae66f0a None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:11:26.803353 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab97b8-857a-41dd-b0f4-fde5eae66f0a None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:11:26.803637 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab97b8-857a-41dd-b0f4-fde5eae66f0a None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:11:26.805659 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 741/1480] 10.222.0.23 () {54 vars in 962 bytes} [Thu Sep 23 03:11:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:11:26.811355 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2e52d-3e5e-41c5-b7ea-93abcc9f2009 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:11:26.811660 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2e52d-3e5e-41c5-b7ea-93abcc9f2009 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:11:26.812850 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2e52d-3e5e-41c5-b7ea-93abcc9f2009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:11:26.831268 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-05d2e52d-3e5e-41c5-b7ea-93abcc9f2009 None None] MFA Rules not processed for user `5a435fd22fdc4160888f942e634c0a08`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:11:26.832457 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-05d2e52d-3e5e-41c5-b7ea-93abcc9f2009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:11:26.839044 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 740/1481] 10.222.0.23 () {58 vars in 1060 bytes} [Thu Sep 23 03:11:26 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:11:26.847615 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab97b8-857a-41dd-b0f4-fde5eae66f0a None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:11:26.858600 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab97b8-857a-41dd-b0f4-fde5eae66f0a None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:11:26.862070 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb87136-445d-4038-917f-d7fe92398685 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:11:26.862698 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb87136-445d-4038-917f-d7fe92398685 service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:11:26.862979 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb87136-445d-4038-917f-d7fe92398685 service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:11:26.863250 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb87136-445d-4038-917f-d7fe92398685 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:11:26.872214 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb87136-445d-4038-917f-d7fe92398685 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:11:26.873725 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb87136-445d-4038-917f-d7fe92398685 service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:11:26.882860 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 742/1482] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:11:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:12:49.019587 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac91248-2c7c-4ffa-948a-fe32c0312184 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.020179 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac91248-2c7c-4ffa-948a-fe32c0312184 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.020179 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac91248-2c7c-4ffa-948a-fe32c0312184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.044585 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-2ac91248-2c7c-4ffa-948a-fe32c0312184 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:49.046147 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-2ac91248-2c7c-4ffa-948a-fe32c0312184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:49.061052 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 741/1483] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:49.071308 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95535be5-cb32-4c0f-89e6-94c24c6e556b None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.071825 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95535be5-cb32-4c0f-89e6-94c24c6e556b None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.071825 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95535be5-cb32-4c0f-89e6-94c24c6e556b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.097830 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-95535be5-cb32-4c0f-89e6-94c24c6e556b None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:49.099212 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-95535be5-cb32-4c0f-89e6-94c24c6e556b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:49.113080 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 743/1484] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:49.117449 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac91248-2c7c-4ffa-948a-fe32c0312184 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:49.132993 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac91248-2c7c-4ffa-948a-fe32c0312184 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:49.137924 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced58d44-2965-4a0c-a0f3-ef2da1c54bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:49.138623 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced58d44-2965-4a0c-a0f3-ef2da1c54bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.138895 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced58d44-2965-4a0c-a0f3-ef2da1c54bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.139177 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced58d44-2965-4a0c-a0f3-ef2da1c54bd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.140025 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced58d44-2965-4a0c-a0f3-ef2da1c54bd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:12:49.140340 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced58d44-2965-4a0c-a0f3-ef2da1c54bd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:49.141984 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced58d44-2965-4a0c-a0f3-ef2da1c54bd8 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:49.161546 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 742/1485] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:12:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:12:49.170396 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95535be5-cb32-4c0f-89e6-94c24c6e556b None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:49.180605 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95535be5-cb32-4c0f-89e6-94c24c6e556b None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:49.184522 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ead7cf-e262-49ab-8be3-b852afb1c12a None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.184522 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ead7cf-e262-49ab-8be3-b852afb1c12a None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.184522 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ead7cf-e262-49ab-8be3-b852afb1c12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.190551 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551356f-c1ff-491c-a333-ecf4ea225147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:49.191497 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551356f-c1ff-491c-a333-ecf4ea225147 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.191999 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551356f-c1ff-491c-a333-ecf4ea225147 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.192517 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551356f-c1ff-491c-a333-ecf4ea225147 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.193418 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551356f-c1ff-491c-a333-ecf4ea225147 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:49.195574 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551356f-c1ff-491c-a333-ecf4ea225147 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:49.213615 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-b4ead7cf-e262-49ab-8be3-b852afb1c12a None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:49.214837 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-b4ead7cf-e262-49ab-8be3-b852afb1c12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:49.229863 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 743/1486] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:12:49.247471 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49647a32-8234-4e1a-a7b1-c8a89e2e86c4 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.247764 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49647a32-8234-4e1a-a7b1-c8a89e2e86c4 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.248032 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49647a32-8234-4e1a-a7b1-c8a89e2e86c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.268896 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-49647a32-8234-4e1a-a7b1-c8a89e2e86c4 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:49.270792 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-49647a32-8234-4e1a-a7b1-c8a89e2e86c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:49.293742 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 744/1487] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:49.295945 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 744/1488] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:12:49 2021] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:12:49.297631 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cbd2a-4a68-40fb-b68b-5e22b975b58a None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.298168 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cbd2a-4a68-40fb-b68b-5e22b975b58a None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.298670 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cbd2a-4a68-40fb-b68b-5e22b975b58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.301510 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49647a32-8234-4e1a-a7b1-c8a89e2e86c4 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:49.321985 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49647a32-8234-4e1a-a7b1-c8a89e2e86c4 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:49.340518 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-604cbd2a-4a68-40fb-b68b-5e22b975b58a None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:49.340518 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-604cbd2a-4a68-40fb-b68b-5e22b975b58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:49.393643 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52476230-d9ca-410e-b47b-81a7e18e8c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:49.394320 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52476230-d9ca-410e-b47b-81a7e18e8c75 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.394601 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52476230-d9ca-410e-b47b-81a7e18e8c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.394878 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52476230-d9ca-410e-b47b-81a7e18e8c75 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.395598 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52476230-d9ca-410e-b47b-81a7e18e8c75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:12:49.395906 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52476230-d9ca-410e-b47b-81a7e18e8c75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:49.397540 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52476230-d9ca-410e-b47b-81a7e18e8c75 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:49.409347 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 745/1489] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:12:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:12:49.410132 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52476230-d9ca-410e-b47b-81a7e18e8c75 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:49.414085 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 745/1490] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:49.420896 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cdcd1-aa95-44cf-afcb-2bfe1688451f None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.421238 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cdcd1-aa95-44cf-afcb-2bfe1688451f None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.421470 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cdcd1-aa95-44cf-afcb-2bfe1688451f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.424330 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52476230-d9ca-410e-b47b-81a7e18e8c75 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:49.428893 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516b806-4ada-4b96-b520-851b96ee473d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:49.429551 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516b806-4ada-4b96-b520-851b96ee473d admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.429834 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516b806-4ada-4b96-b520-851b96ee473d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.430110 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516b806-4ada-4b96-b520-851b96ee473d admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.430784 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516b806-4ada-4b96-b520-851b96ee473d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:49.432738 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516b806-4ada-4b96-b520-851b96ee473d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:49.439437 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-eb9cdcd1-aa95-44cf-afcb-2bfe1688451f None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:49.440658 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-eb9cdcd1-aa95-44cf-afcb-2bfe1688451f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:49.448959 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 746/1491] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:49.450245 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d96057-9e9d-4ee4-82b5-e07f67d48960 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.455710 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d96057-9e9d-4ee4-82b5-e07f67d48960 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.455710 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d96057-9e9d-4ee4-82b5-e07f67d48960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.468178 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-a2d96057-9e9d-4ee4-82b5-e07f67d48960 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:49.469365 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-a2d96057-9e9d-4ee4-82b5-e07f67d48960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:49.476966 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 747/1492] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:49.478266 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28044946-f8bd-4e73-ba62-034c1a5ebf41 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.478549 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28044946-f8bd-4e73-ba62-034c1a5ebf41 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.478870 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28044946-f8bd-4e73-ba62-034c1a5ebf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.501163 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-28044946-f8bd-4e73-ba62-034c1a5ebf41 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:49.502399 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-28044946-f8bd-4e73-ba62-034c1a5ebf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:49.510698 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 748/1493] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:49.513101 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057a8a2-b8f0-4aa3-a60d-07ec46d0429d None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.513101 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057a8a2-b8f0-4aa3-a60d-07ec46d0429d None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.513101 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057a8a2-b8f0-4aa3-a60d-07ec46d0429d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.529783 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-5057a8a2-b8f0-4aa3-a60d-07ec46d0429d None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:49.530959 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-5057a8a2-b8f0-4aa3-a60d-07ec46d0429d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:49.538728 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 749/1494] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:49.540093 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ee7f7-07ee-4e62-a21f-9190b0fbf5ed None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.540388 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ee7f7-07ee-4e62-a21f-9190b0fbf5ed None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.540695 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ee7f7-07ee-4e62-a21f-9190b0fbf5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.544761 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 746/1495] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:12:49 2021] POST /identity/v3/users => generated 291 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:12:49.545793 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516b806-4ada-4b96-b520-851b96ee473d admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:49.556333 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516b806-4ada-4b96-b520-851b96ee473d admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:49.561609 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f828a-7ab6-4b2a-9078-9bb7ebb408a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:49.561901 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-1e7ee7f7-07ee-4e62-a21f-9190b0fbf5ed None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:49.562271 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f828a-7ab6-4b2a-9078-9bb7ebb408a8 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.562564 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f828a-7ab6-4b2a-9078-9bb7ebb408a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.562868 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f828a-7ab6-4b2a-9078-9bb7ebb408a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.563087 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-1e7ee7f7-07ee-4e62-a21f-9190b0fbf5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:49.563557 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f828a-7ab6-4b2a-9078-9bb7ebb408a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:49.565650 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f828a-7ab6-4b2a-9078-9bb7ebb408a8 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:49.571052 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 750/1496] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:49.572337 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec725250-5409-4aa8-b74d-5176eef85cbd None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.572622 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec725250-5409-4aa8-b74d-5176eef85cbd None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.572905 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec725250-5409-4aa8-b74d-5176eef85cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.590979 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-ec725250-5409-4aa8-b74d-5176eef85cbd None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:49.592326 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-ec725250-5409-4aa8-b74d-5176eef85cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:49.599991 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 751/1497] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:49.601369 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b5e4b-45e3-432d-a2ce-ad7019bcc67e None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.601692 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b5e4b-45e3-432d-a2ce-ad7019bcc67e None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.601973 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b5e4b-45e3-432d-a2ce-ad7019bcc67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.620341 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-7f1b5e4b-45e3-432d-a2ce-ad7019bcc67e None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:49.621584 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-7f1b5e4b-45e3-432d-a2ce-ad7019bcc67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:49.629376 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 752/1498] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:49.630580 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb67cd8-8bb8-407d-8084-c2e020182405 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.630868 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb67cd8-8bb8-407d-8084-c2e020182405 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.631151 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb67cd8-8bb8-407d-8084-c2e020182405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.647909 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-0eb67cd8-8bb8-407d-8084-c2e020182405 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:49.650784 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-0eb67cd8-8bb8-407d-8084-c2e020182405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:49.657001 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 753/1499] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:49.658228 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd6d2c-4675-4fd8-b9d0-154c4c7d75ab None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.658526 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd6d2c-4675-4fd8-b9d0-154c4c7d75ab None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.658808 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd6d2c-4675-4fd8-b9d0-154c4c7d75ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.676036 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-68cd6d2c-4675-4fd8-b9d0-154c4c7d75ab None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:49.679921 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 747/1500] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:12:49 2021] POST /identity/v3/projects => generated 387 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:12:49.680072 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-68cd6d2c-4675-4fd8-b9d0-154c4c7d75ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:49.680175 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc50ce2-2d1c-43f5-ad7d-94c08bb831b5 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.680175 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc50ce2-2d1c-43f5-ad7d-94c08bb831b5 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.680175 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc50ce2-2d1c-43f5-ad7d-94c08bb831b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.695594 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-8fc50ce2-2d1c-43f5-ad7d-94c08bb831b5 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:49.696988 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-8fc50ce2-2d1c-43f5-ad7d-94c08bb831b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:49.735448 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 754/1501] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:49.736652 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd6d2c-4675-4fd8-b9d0-154c4c7d75ab None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:49.746297 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd6d2c-4675-4fd8-b9d0-154c4c7d75ab None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:49.750879 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd70eb-21fe-4ea1-928c-3049e6f7c096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:49.751537 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd70eb-21fe-4ea1-928c-3049e6f7c096 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.751824 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd70eb-21fe-4ea1-928c-3049e6f7c096 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.752102 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd70eb-21fe-4ea1-928c-3049e6f7c096 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.752877 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd70eb-21fe-4ea1-928c-3049e6f7c096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:49.754372 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 748/1502] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:49.754495 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd70eb-21fe-4ea1-928c-3049e6f7c096 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:49.755739 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681898d1-c55f-4ab6-a7b9-b46c02640205 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.756037 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681898d1-c55f-4ab6-a7b9-b46c02640205 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.756327 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681898d1-c55f-4ab6-a7b9-b46c02640205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.764721 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 755/1503] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:12:49 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:12:49.765720 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd70eb-21fe-4ea1-928c-3049e6f7c096 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:49.774218 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-681898d1-c55f-4ab6-a7b9-b46c02640205 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:49.775176 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd70eb-21fe-4ea1-928c-3049e6f7c096 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:49.775416 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-681898d1-c55f-4ab6-a7b9-b46c02640205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:49.780510 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff22a3-bda6-4c68-9e45-c470a53a3b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:49.781166 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff22a3-bda6-4c68-9e45-c470a53a3b78 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.781453 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff22a3-bda6-4c68-9e45-c470a53a3b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.781779 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff22a3-bda6-4c68-9e45-c470a53a3b78 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.782495 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff22a3-bda6-4c68-9e45-c470a53a3b78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:12:49.782809 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff22a3-bda6-4c68-9e45-c470a53a3b78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:49.783921 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 749/1504] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:49.787900 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff22a3-bda6-4c68-9e45-c470a53a3b78 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:49.788027 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681898d1-c55f-4ab6-a7b9-b46c02640205 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:49.794064 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681898d1-c55f-4ab6-a7b9-b46c02640205 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:49.796567 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 756/1505] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:12:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:12:49.797432 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff22a3-bda6-4c68-9e45-c470a53a3b78 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:49.803959 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b0909-54fa-4921-8de3-b5ea03e9e09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:49.804702 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b0909-54fa-4921-8de3-b5ea03e9e09b admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.805112 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b0909-54fa-4921-8de3-b5ea03e9e09b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.805394 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b0909-54fa-4921-8de3-b5ea03e9e09b admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.806116 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b0909-54fa-4921-8de3-b5ea03e9e09b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:12:49.806420 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b0909-54fa-4921-8de3-b5ea03e9e09b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:49.808850 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b0909-54fa-4921-8de3-b5ea03e9e09b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:49.813460 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff22a3-bda6-4c68-9e45-c470a53a3b78 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:49.819276 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df13461-995e-43f7-b036-ce1dba5122b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:49.819276 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df13461-995e-43f7-b036-ce1dba5122b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.819276 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df13461-995e-43f7-b036-ce1dba5122b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.819661 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df13461-995e-43f7-b036-ce1dba5122b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.820425 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df13461-995e-43f7-b036-ce1dba5122b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:12:49.820771 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df13461-995e-43f7-b036-ce1dba5122b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:49.821896 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 750/1506] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:12:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:12:49.822455 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df13461-995e-43f7-b036-ce1dba5122b6 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:49.823166 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b0909-54fa-4921-8de3-b5ea03e9e09b admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:49.835600 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 757/1507] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:12:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:12:49.836281 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df13461-995e-43f7-b036-ce1dba5122b6 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:49.843349 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b0909-54fa-4921-8de3-b5ea03e9e09b admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:49.849514 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924c814-1850-4803-b8b6-ea8ef5d5de04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:49.855057 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df13461-995e-43f7-b036-ce1dba5122b6 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:49.855192 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924c814-1850-4803-b8b6-ea8ef5d5de04 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.855192 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924c814-1850-4803-b8b6-ea8ef5d5de04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.855192 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924c814-1850-4803-b8b6-ea8ef5d5de04 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.855192 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924c814-1850-4803-b8b6-ea8ef5d5de04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:49.855192 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924c814-1850-4803-b8b6-ea8ef5d5de04 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:49.856025 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b3edf-c726-491b-b2af-150647860c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:49.856727 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b3edf-c726-491b-b2af-150647860c81 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.857016 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b3edf-c726-491b-b2af-150647860c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.857298 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b3edf-c726-491b-b2af-150647860c81 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.858024 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b3edf-c726-491b-b2af-150647860c81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:12:49.858335 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b3edf-c726-491b-b2af-150647860c81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:49.859927 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b3edf-c726-491b-b2af-150647860c81 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:49.873770 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 758/1508] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:12:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:12:49.874647 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b3edf-c726-491b-b2af-150647860c81 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:49.884033 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b3edf-c726-491b-b2af-150647860c81 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:49.888969 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c10be-f1a1-4ea3-8c21-53ccc4cfcab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:49.891374 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c10be-f1a1-4ea3-8c21-53ccc4cfcab0 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.891374 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c10be-f1a1-4ea3-8c21-53ccc4cfcab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.891374 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c10be-f1a1-4ea3-8c21-53ccc4cfcab0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.891374 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c10be-f1a1-4ea3-8c21-53ccc4cfcab0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:12:49.891374 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c10be-f1a1-4ea3-8c21-53ccc4cfcab0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:49.892729 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c10be-f1a1-4ea3-8c21-53ccc4cfcab0 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:49.904641 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 759/1509] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:12:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:12:49.905442 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c10be-f1a1-4ea3-8c21-53ccc4cfcab0 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:49.915154 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c10be-f1a1-4ea3-8c21-53ccc4cfcab0 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:49.920430 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416afe9-aa5f-4d8f-9d97-8418580eaf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:49.921110 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416afe9-aa5f-4d8f-9d97-8418580eaf5d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.921396 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416afe9-aa5f-4d8f-9d97-8418580eaf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.921705 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416afe9-aa5f-4d8f-9d97-8418580eaf5d admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.922426 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416afe9-aa5f-4d8f-9d97-8418580eaf5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:49.924015 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416afe9-aa5f-4d8f-9d97-8418580eaf5d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:49.934990 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 760/1510] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:12:49 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:12:49.938499 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416afe9-aa5f-4d8f-9d97-8418580eaf5d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:49.944915 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416afe9-aa5f-4d8f-9d97-8418580eaf5d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:49.949582 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f822905-ee29-4b59-a737-2f82771bdebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:49.950189 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f822905-ee29-4b59-a737-2f82771bdebd admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.950473 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f822905-ee29-4b59-a737-2f82771bdebd admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.950752 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f822905-ee29-4b59-a737-2f82771bdebd admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.951441 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f822905-ee29-4b59-a737-2f82771bdebd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:12:49.951744 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f822905-ee29-4b59-a737-2f82771bdebd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:49.953304 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f822905-ee29-4b59-a737-2f82771bdebd admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:49.965071 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 761/1511] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:12:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:12:49.965817 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f822905-ee29-4b59-a737-2f82771bdebd admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:49.975190 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f822905-ee29-4b59-a737-2f82771bdebd admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:49.979806 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45513e8-05b3-4c77-8250-94537759cf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:49.980420 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45513e8-05b3-4c77-8250-94537759cf2e admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:49.980736 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45513e8-05b3-4c77-8250-94537759cf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:49.981016 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45513e8-05b3-4c77-8250-94537759cf2e admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:49.981678 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45513e8-05b3-4c77-8250-94537759cf2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:49.983509 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45513e8-05b3-4c77-8250-94537759cf2e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:50.109876 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 751/1512] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:12:49 2021] POST /identity/v3/users => generated 294 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:12:50.110610 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924c814-1850-4803-b8b6-ea8ef5d5de04 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:50.120704 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924c814-1850-4803-b8b6-ea8ef5d5de04 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:50.123580 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 762/1513] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:12:49 2021] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:12:50.123580 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45513e8-05b3-4c77-8250-94537759cf2e admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:50.179581 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22707791-b75d-4e9a-bf9f-d17d30390853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:50.180257 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22707791-b75d-4e9a-bf9f-d17d30390853 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:50.180571 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22707791-b75d-4e9a-bf9f-d17d30390853 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:50.180852 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22707791-b75d-4e9a-bf9f-d17d30390853 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:50.181551 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22707791-b75d-4e9a-bf9f-d17d30390853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:50.183026 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45513e8-05b3-4c77-8250-94537759cf2e admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:50.184062 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22707791-b75d-4e9a-bf9f-d17d30390853 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:50.187980 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8561d-541d-4cc8-81c6-1c744b5bfbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:50.188681 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8561d-541d-4cc8-81c6-1c744b5bfbff admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:50.188986 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8561d-541d-4cc8-81c6-1c744b5bfbff admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:50.189261 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8561d-541d-4cc8-81c6-1c744b5bfbff admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:50.189940 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8561d-541d-4cc8-81c6-1c744b5bfbff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:50.191840 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8561d-541d-4cc8-81c6-1c744b5bfbff admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:50.258553 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 752/1514] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:12:50 2021] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:12:50.259579 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22707791-b75d-4e9a-bf9f-d17d30390853 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:50.282727 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 763/1515] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:12:50 2021] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:12:50.282727 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8561d-541d-4cc8-81c6-1c744b5bfbff admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:50.319785 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22707791-b75d-4e9a-bf9f-d17d30390853 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:50.346610 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8561d-541d-4cc8-81c6-1c744b5bfbff admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:50.351334 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b439af-4a89-459a-97df-109688a9e23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:50.352024 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b439af-4a89-459a-97df-109688a9e23a admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:50.352305 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b439af-4a89-459a-97df-109688a9e23a admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:50.352623 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b439af-4a89-459a-97df-109688a9e23a admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:50.353314 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b439af-4a89-459a-97df-109688a9e23a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:50.355353 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b439af-4a89-459a-97df-109688a9e23a admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:50.386835 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f27e5-ac57-4b6a-babc-bb92b6541bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:50.386835 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f27e5-ac57-4b6a-babc-bb92b6541bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:50.386835 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f27e5-ac57-4b6a-babc-bb92b6541bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:50.386835 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f27e5-ac57-4b6a-babc-bb92b6541bd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:50.387242 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f27e5-ac57-4b6a-babc-bb92b6541bd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:50.387242 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f27e5-ac57-4b6a-babc-bb92b6541bd5 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:50.439555 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 764/1516] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:12:50 2021] POST /identity/v3/projects => generated 393 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:12:50.440481 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b439af-4a89-459a-97df-109688a9e23a admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:50.469043 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 753/1517] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:12:50 2021] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:12:50.469857 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f27e5-ac57-4b6a-babc-bb92b6541bd5 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:50.501737 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b439af-4a89-459a-97df-109688a9e23a admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:50.531656 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f27e5-ac57-4b6a-babc-bb92b6541bd5 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:50.536629 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1568aa-05c4-4315-aa29-cc58118f08cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:50.537310 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1568aa-05c4-4315-aa29-cc58118f08cc admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:50.537597 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1568aa-05c4-4315-aa29-cc58118f08cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:50.537901 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1568aa-05c4-4315-aa29-cc58118f08cc admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:50.538593 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1568aa-05c4-4315-aa29-cc58118f08cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:50.540714 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1568aa-05c4-4315-aa29-cc58118f08cc admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:50.559572 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea8791-c346-48fd-a786-1738b9cf1d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:50.560466 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea8791-c346-48fd-a786-1738b9cf1d79 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:50.560786 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea8791-c346-48fd-a786-1738b9cf1d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:50.561063 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea8791-c346-48fd-a786-1738b9cf1d79 admin admin] PATH_INFO: `/v3/projects/ba8109328f0749ce9e888b91da7331b9/users/bfdb8f7b5d0d4c0b932d0d94afe3e7cf/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:50.575745 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea8791-c346-48fd-a786-1738b9cf1d79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba8109328f0749ce9e888b91da7331b9, user_id=bfdb8f7b5d0d4c0b932d0d94afe3e7cf, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:50.578528 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea8791-c346-48fd-a786-1738b9cf1d79 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:50.616914 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 754/1518] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:12:50 2021] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:12:50.617741 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1568aa-05c4-4315-aa29-cc58118f08cc admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:50.646091 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 765/1519] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:12:50 2021] PUT /identity/v3/projects/ba8109328f0749ce9e888b91da7331b9/users/bfdb8f7b5d0d4c0b932d0d94afe3e7cf/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:12:50.646824 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea8791-c346-48fd-a786-1738b9cf1d79 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:50.682870 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1568aa-05c4-4315-aa29-cc58118f08cc admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:50.704400 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea8791-c346-48fd-a786-1738b9cf1d79 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:50.709399 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3bdfa-4201-429e-85fc-adb14af1b2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:50.710066 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3bdfa-4201-429e-85fc-adb14af1b2a0 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:50.710344 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3bdfa-4201-429e-85fc-adb14af1b2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:50.710616 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3bdfa-4201-429e-85fc-adb14af1b2a0 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:50.711329 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3bdfa-4201-429e-85fc-adb14af1b2a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:50.713790 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3bdfa-4201-429e-85fc-adb14af1b2a0 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:50.736732 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bd2c9-0497-4035-8cb0-6df7031ff9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:50.737404 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bd2c9-0497-4035-8cb0-6df7031ff9bd admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:50.737686 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bd2c9-0497-4035-8cb0-6df7031ff9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:50.737961 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bd2c9-0497-4035-8cb0-6df7031ff9bd admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:50.738678 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5bd2c9-0497-4035-8cb0-6df7031ff9bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:50.740253 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5bd2c9-0497-4035-8cb0-6df7031ff9bd admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:50.749849 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 755/1520] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:12:50 2021] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:12:50.750652 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bd2c9-0497-4035-8cb0-6df7031ff9bd admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:50.759580 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bd2c9-0497-4035-8cb0-6df7031ff9bd admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:50.764166 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af801fc-40ca-467d-8149-faea31dcddac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:50.765188 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af801fc-40ca-467d-8149-faea31dcddac admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:50.765188 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af801fc-40ca-467d-8149-faea31dcddac admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:50.765420 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af801fc-40ca-467d-8149-faea31dcddac admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:50.766088 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af801fc-40ca-467d-8149-faea31dcddac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:50.767924 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af801fc-40ca-467d-8149-faea31dcddac admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:50.792454 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 766/1521] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:12:50 2021] POST /identity/v3/users => generated 291 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:12:50.792454 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3bdfa-4201-429e-85fc-adb14af1b2a0 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:50.799413 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3bdfa-4201-429e-85fc-adb14af1b2a0 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:50.804064 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c6807-b8e8-464a-83f2-3f4909015099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:50.804727 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c6807-b8e8-464a-83f2-3f4909015099 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:50.805008 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c6807-b8e8-464a-83f2-3f4909015099 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:50.805283 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c6807-b8e8-464a-83f2-3f4909015099 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:50.805948 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c6807-b8e8-464a-83f2-3f4909015099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:50.807924 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c6807-b8e8-464a-83f2-3f4909015099 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:50.845062 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 756/1522] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:12:50 2021] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:12:50.845874 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af801fc-40ca-467d-8149-faea31dcddac admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:50.855038 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af801fc-40ca-467d-8149-faea31dcddac admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:50.859679 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e60aa4-cd6b-4888-b5be-12a0df3c6004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:50.860328 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e60aa4-cd6b-4888-b5be-12a0df3c6004 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:50.860651 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e60aa4-cd6b-4888-b5be-12a0df3c6004 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:50.860935 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e60aa4-cd6b-4888-b5be-12a0df3c6004 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:50.861863 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e60aa4-cd6b-4888-b5be-12a0df3c6004 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:50.863744 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e60aa4-cd6b-4888-b5be-12a0df3c6004 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:50.903473 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 767/1523] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:12:50 2021] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:12:50.903473 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c6807-b8e8-464a-83f2-3f4909015099 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:50.912185 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c6807-b8e8-464a-83f2-3f4909015099 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:50.916924 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc01c62-6fca-4d59-8cf6-4e1891ecf2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:50.917585 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc01c62-6fca-4d59-8cf6-4e1891ecf2a2 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:50.917872 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc01c62-6fca-4d59-8cf6-4e1891ecf2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:50.918146 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc01c62-6fca-4d59-8cf6-4e1891ecf2a2 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:50.918825 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc01c62-6fca-4d59-8cf6-4e1891ecf2a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:50.920782 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc01c62-6fca-4d59-8cf6-4e1891ecf2a2 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:50.954976 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 757/1524] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:12:50 2021] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:12:50.955780 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e60aa4-cd6b-4888-b5be-12a0df3c6004 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:50.965618 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e60aa4-cd6b-4888-b5be-12a0df3c6004 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:50.970431 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f154b-1893-4488-9d06-793fe92f56ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:50.971074 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f154b-1893-4488-9d06-793fe92f56ab admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:50.971357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f154b-1893-4488-9d06-793fe92f56ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:50.971633 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f154b-1893-4488-9d06-793fe92f56ab admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:50.972301 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f154b-1893-4488-9d06-793fe92f56ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:50.974266 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f154b-1893-4488-9d06-793fe92f56ab admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:51.009111 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 768/1525] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:12:50 2021] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:12:51.009111 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156787a2-2205-4353-9e84-f62a19a87dae None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:51.009111 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156787a2-2205-4353-9e84-f62a19a87dae None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:51.009111 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156787a2-2205-4353-9e84-f62a19a87dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:51.034209 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-156787a2-2205-4353-9e84-f62a19a87dae None None] MFA Rules not processed for user `bfdb8f7b5d0d4c0b932d0d94afe3e7cf`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:51.035428 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-156787a2-2205-4353-9e84-f62a19a87dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:51.055472 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 758/1526] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:12:50 2021] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:12:51.055472 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f154b-1893-4488-9d06-793fe92f56ab admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:51.062779 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f154b-1893-4488-9d06-793fe92f56ab admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:51.067337 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf60bb-0f84-4cc7-a134-0312e2513885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:51.067981 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf60bb-0f84-4cc7-a134-0312e2513885 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:51.068258 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf60bb-0f84-4cc7-a134-0312e2513885 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:51.068553 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf60bb-0f84-4cc7-a134-0312e2513885 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:51.069287 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf60bb-0f84-4cc7-a134-0312e2513885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:51.070827 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf60bb-0f84-4cc7-a134-0312e2513885 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:51.084148 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 759/1527] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:12:51 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:12:51.084148 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf60bb-0f84-4cc7-a134-0312e2513885 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:51.091984 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf60bb-0f84-4cc7-a134-0312e2513885 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:51.096661 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88907dde-19b3-4398-bbda-0bdebf76a59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:51.097296 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88907dde-19b3-4398-bbda-0bdebf76a59a admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:51.097577 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88907dde-19b3-4398-bbda-0bdebf76a59a admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:51.097861 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88907dde-19b3-4398-bbda-0bdebf76a59a admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:51.098558 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88907dde-19b3-4398-bbda-0bdebf76a59a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:51.100120 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88907dde-19b3-4398-bbda-0bdebf76a59a admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:51.102792 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 769/1528] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:51 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:51.103660 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156787a2-2205-4353-9e84-f62a19a87dae None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:51.113008 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 760/1529] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:12:51 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:12:51.113008 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88907dde-19b3-4398-bbda-0bdebf76a59a admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:51.114420 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156787a2-2205-4353-9e84-f62a19a87dae None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:51.118947 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9aab0-ed20-4fd6-98d1-9ce0512633ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:51.119634 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9aab0-ed20-4fd6-98d1-9ce0512633ea admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:51.119917 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9aab0-ed20-4fd6-98d1-9ce0512633ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:51.120190 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9aab0-ed20-4fd6-98d1-9ce0512633ea admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:51.120939 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b9aab0-ed20-4fd6-98d1-9ce0512633ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:51.122272 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88907dde-19b3-4398-bbda-0bdebf76a59a admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:51.122540 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b9aab0-ed20-4fd6-98d1-9ce0512633ea admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:51.127038 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3b9fd-482a-4ee5-970c-d2f40eeedc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:51.127715 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3b9fd-482a-4ee5-970c-d2f40eeedc2c admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:51.128000 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3b9fd-482a-4ee5-970c-d2f40eeedc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:51.128281 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3b9fd-482a-4ee5-970c-d2f40eeedc2c admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:51.129266 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3b9fd-482a-4ee5-970c-d2f40eeedc2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:51.130886 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3b9fd-482a-4ee5-970c-d2f40eeedc2c admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:51.135954 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 770/1530] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:12:51 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:12:51.135954 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9aab0-ed20-4fd6-98d1-9ce0512633ea admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:51.143595 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9aab0-ed20-4fd6-98d1-9ce0512633ea admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:51.145296 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 761/1531] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:12:51 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:12:51.146380 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3b9fd-482a-4ee5-970c-d2f40eeedc2c admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:51.149062 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1e3fb-fba8-42d4-8162-fe3ad4b7044a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:51.149737 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1e3fb-fba8-42d4-8162-fe3ad4b7044a admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:51.151411 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1e3fb-fba8-42d4-8162-fe3ad4b7044a admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:51.151691 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1e3fb-fba8-42d4-8162-fe3ad4b7044a admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:51.152425 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1e3fb-fba8-42d4-8162-fe3ad4b7044a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:51.154470 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1e3fb-fba8-42d4-8162-fe3ad4b7044a admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:51.159162 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3b9fd-482a-4ee5-970c-d2f40eeedc2c admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:51.163875 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6dc8c2-7072-4d36-b464-86bb26f666b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:51.167442 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 771/1532] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:12:51 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:12:51.167601 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6dc8c2-7072-4d36-b464-86bb26f666b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:51.167601 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6dc8c2-7072-4d36-b464-86bb26f666b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:51.167601 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6dc8c2-7072-4d36-b464-86bb26f666b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:51.167826 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1e3fb-fba8-42d4-8162-fe3ad4b7044a admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:51.167918 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6dc8c2-7072-4d36-b464-86bb26f666b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:51.167918 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6dc8c2-7072-4d36-b464-86bb26f666b0 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:51.176127 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1e3fb-fba8-42d4-8162-fe3ad4b7044a admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:51.177460 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 762/1533] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:12:51 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:12:51.178243 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6dc8c2-7072-4d36-b464-86bb26f666b0 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:51.181013 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c550e2b-ccfd-441b-adaf-ce015bbf0f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:51.181686 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c550e2b-ccfd-441b-adaf-ce015bbf0f9c admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:51.181966 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c550e2b-ccfd-441b-adaf-ce015bbf0f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:51.182244 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c550e2b-ccfd-441b-adaf-ce015bbf0f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:51.182969 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c550e2b-ccfd-441b-adaf-ce015bbf0f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:51.184587 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c550e2b-ccfd-441b-adaf-ce015bbf0f9c admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:51.187660 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6dc8c2-7072-4d36-b464-86bb26f666b0 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:51.192374 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb2942-67b8-4a23-a22c-349ab544bcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:51.193296 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb2942-67b8-4a23-a22c-349ab544bcd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:51.193582 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb2942-67b8-4a23-a22c-349ab544bcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:51.193858 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb2942-67b8-4a23-a22c-349ab544bcd3 admin admin] PATH_INFO: `/v3/projects/dbfca1e34b884266a4b529b2813872ba/users/bea2a7d9c3724d8b947a0a6363d2f5bd/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:51.198397 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 772/1534] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:12:51 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:12:51.198397 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c550e2b-ccfd-441b-adaf-ce015bbf0f9c admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:51.205525 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c550e2b-ccfd-441b-adaf-ce015bbf0f9c admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:51.208953 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb2942-67b8-4a23-a22c-349ab544bcd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbfca1e34b884266a4b529b2813872ba, user_id=bea2a7d9c3724d8b947a0a6363d2f5bd, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:51.210195 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739d6da-d875-4411-9f8e-d046601ae5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:51.210839 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739d6da-d875-4411-9f8e-d046601ae5ad admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:51.211127 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739d6da-d875-4411-9f8e-d046601ae5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:51.211408 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739d6da-d875-4411-9f8e-d046601ae5ad admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:51.211754 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb2942-67b8-4a23-a22c-349ab544bcd3 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:51.212088 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739d6da-d875-4411-9f8e-d046601ae5ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:51.214582 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739d6da-d875-4411-9f8e-d046601ae5ad admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:51.297992 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 763/1535] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:12:51 2021] PUT /identity/v3/projects/dbfca1e34b884266a4b529b2813872ba/users/bea2a7d9c3724d8b947a0a6363d2f5bd/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:12:51.298983 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb2942-67b8-4a23-a22c-349ab544bcd3 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:51.316836 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 773/1536] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:12:51 2021] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:12:51.317678 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739d6da-d875-4411-9f8e-d046601ae5ad admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:51.358225 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb2942-67b8-4a23-a22c-349ab544bcd3 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:51.378341 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739d6da-d875-4411-9f8e-d046601ae5ad admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:51.382978 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb108fb-163a-4512-936b-3b57cbf8dc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:51.383641 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb108fb-163a-4512-936b-3b57cbf8dc89 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:51.383932 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb108fb-163a-4512-936b-3b57cbf8dc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:51.384198 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb108fb-163a-4512-936b-3b57cbf8dc89 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:51.384990 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb108fb-163a-4512-936b-3b57cbf8dc89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:51.386592 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb108fb-163a-4512-936b-3b57cbf8dc89 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:51.396063 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 774/1537] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:12:51 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:12:51.396884 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb108fb-163a-4512-936b-3b57cbf8dc89 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:51.406679 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb108fb-163a-4512-936b-3b57cbf8dc89 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:51.411050 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c78b03-2c0b-4277-bdea-23558674d134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:51.411338 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32630b57-6c09-4dce-8f72-879a6a2a0df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:51.411828 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c78b03-2c0b-4277-bdea-23558674d134 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:51.411991 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32630b57-6c09-4dce-8f72-879a6a2a0df3 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:51.412113 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c78b03-2c0b-4277-bdea-23558674d134 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:51.412352 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32630b57-6c09-4dce-8f72-879a6a2a0df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:51.412463 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c78b03-2c0b-4277-bdea-23558674d134 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:51.412679 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32630b57-6c09-4dce-8f72-879a6a2a0df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:51.413109 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c78b03-2c0b-4277-bdea-23558674d134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:51.413388 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32630b57-6c09-4dce-8f72-879a6a2a0df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:51.414692 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c78b03-2c0b-4277-bdea-23558674d134 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:51.414937 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32630b57-6c09-4dce-8f72-879a6a2a0df3 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:51.424334 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 764/1538] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:12:51 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:12:51.428386 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 775/1539] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:12:51 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:12:51.428572 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c78b03-2c0b-4277-bdea-23558674d134 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:51.428668 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32630b57-6c09-4dce-8f72-879a6a2a0df3 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:51.436072 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32630b57-6c09-4dce-8f72-879a6a2a0df3 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:51.437550 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c78b03-2c0b-4277-bdea-23558674d134 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:51.440907 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df210a9f-a4e0-4e00-8cef-d93b939691f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:51.441559 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df210a9f-a4e0-4e00-8cef-d93b939691f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:51.441845 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df210a9f-a4e0-4e00-8cef-d93b939691f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:51.442124 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df210a9f-a4e0-4e00-8cef-d93b939691f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:51.442249 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a6ffc-42f8-4603-87d0-476302e2c682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:51.442784 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a6ffc-42f8-4603-87d0-476302e2c682 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:51.442904 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df210a9f-a4e0-4e00-8cef-d93b939691f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:51.443063 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a6ffc-42f8-4603-87d0-476302e2c682 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:51.443337 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a6ffc-42f8-4603-87d0-476302e2c682 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:51.444046 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a6ffc-42f8-4603-87d0-476302e2c682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:51.444424 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df210a9f-a4e0-4e00-8cef-d93b939691f1 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:51.445633 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a6ffc-42f8-4603-87d0-476302e2c682 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:51.454743 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 776/1540] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:12:51 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:12:51.455467 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 765/1541] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:12:51 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:12:51.456821 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72fefd-1172-45f6-97f8-1fedcadb312f None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:51.457114 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72fefd-1172-45f6-97f8-1fedcadb312f None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:51.457395 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72fefd-1172-45f6-97f8-1fedcadb312f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:51.457823 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df210a9f-a4e0-4e00-8cef-d93b939691f1 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:51.468244 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df210a9f-a4e0-4e00-8cef-d93b939691f1 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:51.472871 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431fd90-57b3-4532-9f8e-a065f61b3097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:51.473648 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431fd90-57b3-4532-9f8e-a065f61b3097 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:51.473944 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431fd90-57b3-4532-9f8e-a065f61b3097 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:51.474211 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431fd90-57b3-4532-9f8e-a065f61b3097 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:51.475042 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431fd90-57b3-4532-9f8e-a065f61b3097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:51.476671 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431fd90-57b3-4532-9f8e-a065f61b3097 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:51.480172 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-3d72fefd-1172-45f6-97f8-1fedcadb312f None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:51.481418 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-3d72fefd-1172-45f6-97f8-1fedcadb312f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:51.487739 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 777/1542] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:12:51 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:12:51.488549 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431fd90-57b3-4532-9f8e-a065f61b3097 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:51.489577 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 766/1543] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:51.490313 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72fefd-1172-45f6-97f8-1fedcadb312f None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:51.502800 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431fd90-57b3-4532-9f8e-a065f61b3097 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:51.504040 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72fefd-1172-45f6-97f8-1fedcadb312f None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:51.512617 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8aca7c-2525-42db-b72e-cedc06b16c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:51.512836 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc68249-0a5c-41a0-b656-783a3d7180e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:51.512934 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8aca7c-2525-42db-b72e-cedc06b16c2a admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:51.513038 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc68249-0a5c-41a0-b656-783a3d7180e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:51.513117 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8aca7c-2525-42db-b72e-cedc06b16c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:51.513193 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc68249-0a5c-41a0-b656-783a3d7180e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:51.513277 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8aca7c-2525-42db-b72e-cedc06b16c2a admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:51.513362 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc68249-0a5c-41a0-b656-783a3d7180e4 admin admin] PATH_INFO: `/v3/projects/3a0db8b321a54de5ae011d51e6e69a58/users/36893da01a1845f5af4921a298abb9eb/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:51.513447 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8aca7c-2525-42db-b72e-cedc06b16c2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:51.514899 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8aca7c-2525-42db-b72e-cedc06b16c2a admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:51.529912 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc68249-0a5c-41a0-b656-783a3d7180e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0db8b321a54de5ae011d51e6e69a58, user_id=36893da01a1845f5af4921a298abb9eb, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:51.532811 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc68249-0a5c-41a0-b656-783a3d7180e4 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:51.627471 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 778/1544] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:12:51 2021] POST /identity/v3/users => generated 296 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:12:51.628471 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8aca7c-2525-42db-b72e-cedc06b16c2a admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:51.638503 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8aca7c-2525-42db-b72e-cedc06b16c2a admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:51.643197 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c61a2-1938-4109-8068-ee9e2ece7883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:51.644058 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c61a2-1938-4109-8068-ee9e2ece7883 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:51.644349 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c61a2-1938-4109-8068-ee9e2ece7883 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:51.644971 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c61a2-1938-4109-8068-ee9e2ece7883 admin admin] PATH_INFO: `/v3/projects/d84ced7fa8d04191af5ae1d758fccbb7/users/015a9aafb9774863b7ffdd809a06f1d9/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:51.652318 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 767/1545] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:12:51 2021] PUT /identity/v3/projects/3a0db8b321a54de5ae011d51e6e69a58/users/36893da01a1845f5af4921a298abb9eb/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:12:51.655718 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc68249-0a5c-41a0-b656-783a3d7180e4 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:51.660261 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c61a2-1938-4109-8068-ee9e2ece7883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84ced7fa8d04191af5ae1d758fccbb7, user_id=015a9aafb9774863b7ffdd809a06f1d9, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:51.662986 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c61a2-1938-4109-8068-ee9e2ece7883 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:51.711572 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc68249-0a5c-41a0-b656-783a3d7180e4 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:51.717113 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286bdb0-e454-449d-9459-3aa4aff1a3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:51.718024 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286bdb0-e454-449d-9459-3aa4aff1a3cc admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:51.718306 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286bdb0-e454-449d-9459-3aa4aff1a3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:51.718583 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286bdb0-e454-449d-9459-3aa4aff1a3cc admin admin] PATH_INFO: `/v3/projects/2ef7451816ff4a379f892f267d88d3e4/users/7f33f8201ff842cc9ee6ab60c16a4280/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:51.731846 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286bdb0-e454-449d-9459-3aa4aff1a3cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ef7451816ff4a379f892f267d88d3e4, user_id=7f33f8201ff842cc9ee6ab60c16a4280, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:51.734518 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286bdb0-e454-449d-9459-3aa4aff1a3cc admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:51.743500 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 779/1546] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:12:51 2021] PUT /identity/v3/projects/d84ced7fa8d04191af5ae1d758fccbb7/users/015a9aafb9774863b7ffdd809a06f1d9/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:12:51.744331 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c61a2-1938-4109-8068-ee9e2ece7883 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:51.801855 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c61a2-1938-4109-8068-ee9e2ece7883 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:51.806604 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa46d21-00b9-455e-be43-4e1a9017eb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:51.808051 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa46d21-00b9-455e-be43-4e1a9017eb53 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:51.808331 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa46d21-00b9-455e-be43-4e1a9017eb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:51.808642 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa46d21-00b9-455e-be43-4e1a9017eb53 admin admin] PATH_INFO: `/v3/projects/a580adcc8b084ba2b1b657bd1b2a9a1a/users/415880421b3f4b7896e49188e8d1395c/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:51.823800 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa46d21-00b9-455e-be43-4e1a9017eb53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a580adcc8b084ba2b1b657bd1b2a9a1a, user_id=415880421b3f4b7896e49188e8d1395c, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:51.824836 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 768/1547] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:12:51 2021] PUT /identity/v3/projects/2ef7451816ff4a379f892f267d88d3e4/users/7f33f8201ff842cc9ee6ab60c16a4280/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:12:51.825821 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286bdb0-e454-449d-9459-3aa4aff1a3cc admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:51.827681 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa46d21-00b9-455e-be43-4e1a9017eb53 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:51.895128 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286bdb0-e454-449d-9459-3aa4aff1a3cc admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:51.899972 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f39f2-243c-4dfe-9a7a-30bd6df5c46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:51.900914 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f39f2-243c-4dfe-9a7a-30bd6df5c46a admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:51.901209 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f39f2-243c-4dfe-9a7a-30bd6df5c46a admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:51.901487 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f39f2-243c-4dfe-9a7a-30bd6df5c46a admin admin] PATH_INFO: `/v3/projects/a28d49e25ce7449f8ae6c33149e67246/users/dbd9a5404ac747d4964d215c96918625/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:51.909409 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 780/1548] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:12:51 2021] PUT /identity/v3/projects/a580adcc8b084ba2b1b657bd1b2a9a1a/users/415880421b3f4b7896e49188e8d1395c/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:12:51.910214 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa46d21-00b9-455e-be43-4e1a9017eb53 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:51.915520 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f39f2-243c-4dfe-9a7a-30bd6df5c46a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a28d49e25ce7449f8ae6c33149e67246, user_id=dbd9a5404ac747d4964d215c96918625, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:51.918799 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f39f2-243c-4dfe-9a7a-30bd6df5c46a admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:51.970759 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa46d21-00b9-455e-be43-4e1a9017eb53 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:51.975381 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3be9f-24bb-451a-a3ed-1af2b9062c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:51.976274 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3be9f-24bb-451a-a3ed-1af2b9062c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:51.976661 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3be9f-24bb-451a-a3ed-1af2b9062c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:51.976944 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3be9f-24bb-451a-a3ed-1af2b9062c1a admin admin] PATH_INFO: `/v3/projects/fb475808abab43e79f172a96ab5982fd/users/ba6c83813eac480891cfd5b04b32b06c/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:51.991402 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3be9f-24bb-451a-a3ed-1af2b9062c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb475808abab43e79f172a96ab5982fd, user_id=ba6c83813eac480891cfd5b04b32b06c, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:51.994955 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3be9f-24bb-451a-a3ed-1af2b9062c1a admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:51.999265 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 769/1549] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:12:51 2021] PUT /identity/v3/projects/a28d49e25ce7449f8ae6c33149e67246/users/dbd9a5404ac747d4964d215c96918625/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:12:52.000200 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f39f2-243c-4dfe-9a7a-30bd6df5c46a admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:52.050877 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f39f2-243c-4dfe-9a7a-30bd6df5c46a admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:52.054526 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6561d4-2108-4056-8707-8c72fedcce41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:52.055166 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6561d4-2108-4056-8707-8c72fedcce41 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:52.055447 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6561d4-2108-4056-8707-8c72fedcce41 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:52.055725 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6561d4-2108-4056-8707-8c72fedcce41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:52.062130 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 781/1550] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:12:51 2021] PUT /identity/v3/projects/fb475808abab43e79f172a96ab5982fd/users/ba6c83813eac480891cfd5b04b32b06c/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:12:52.062990 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3be9f-24bb-451a-a3ed-1af2b9062c1a admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:52.113752 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6561d4-2108-4056-8707-8c72fedcce41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:52.115182 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6561d4-2108-4056-8707-8c72fedcce41 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:52.121474 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3be9f-24bb-451a-a3ed-1af2b9062c1a admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:52.125057 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 770/1551] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:12:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:12:52.126137 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc3b78-508e-4205-98c1-145870300826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:52.126488 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23e20f-5bb6-40d9-acd3-b00497ecd170 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:52.126790 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23e20f-5bb6-40d9-acd3-b00497ecd170 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:52.126924 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc3b78-508e-4205-98c1-145870300826 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:52.127084 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23e20f-5bb6-40d9-acd3-b00497ecd170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:52.127192 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc3b78-508e-4205-98c1-145870300826 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:52.127342 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc3b78-508e-4205-98c1-145870300826 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:52.128075 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc3b78-508e-4205-98c1-145870300826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:52.129895 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc3b78-508e-4205-98c1-145870300826 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:52.146796 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 782/1552] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:12:52 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:12:52.146796 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748d564-e5bc-401e-b3e1-0d373ebc9367 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:52.146796 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748d564-e5bc-401e-b3e1-0d373ebc9367 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:52.146796 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748d564-e5bc-401e-b3e1-0d373ebc9367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:52.158145 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-7e23e20f-5bb6-40d9-acd3-b00497ecd170 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:52.159830 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-7e23e20f-5bb6-40d9-acd3-b00497ecd170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:52.173447 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 771/1553] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:52.173447 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85595cbe-1a81-48cf-9593-5083c5e953a9 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:52.173447 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85595cbe-1a81-48cf-9593-5083c5e953a9 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:52.173447 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85595cbe-1a81-48cf-9593-5083c5e953a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:52.181161 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-4748d564-e5bc-401e-b3e1-0d373ebc9367 None None] MFA Rules not processed for user `015a9aafb9774863b7ffdd809a06f1d9`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:52.182655 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-4748d564-e5bc-401e-b3e1-0d373ebc9367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:52.200377 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-85595cbe-1a81-48cf-9593-5083c5e953a9 None None] MFA Rules not processed for user `7f33f8201ff842cc9ee6ab60c16a4280`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:52.220902 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-85595cbe-1a81-48cf-9593-5083c5e953a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:52.253837 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 783/1554] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:52 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:52.255358 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfebf6f-a90d-4ba0-a5f2-1eda6efbadc8 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:52.255656 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfebf6f-a90d-4ba0-a5f2-1eda6efbadc8 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:52.255938 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfebf6f-a90d-4ba0-a5f2-1eda6efbadc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:52.266539 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 772/1555] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:52 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:52.268376 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8487d29-0d16-494d-9acd-3bf4525e0558 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:52.268718 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8487d29-0d16-494d-9acd-3bf4525e0558 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:52.269004 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8487d29-0d16-494d-9acd-3bf4525e0558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:52.275846 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-5bfebf6f-a90d-4ba0-a5f2-1eda6efbadc8 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:52.277156 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-5bfebf6f-a90d-4ba0-a5f2-1eda6efbadc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:52.284898 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 784/1556] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:52.286155 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2aea5-3c1f-4038-9c4f-9ddc17836604 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:52.286440 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2aea5-3c1f-4038-9c4f-9ddc17836604 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:52.286720 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2aea5-3c1f-4038-9c4f-9ddc17836604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:52.289106 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-f8487d29-0d16-494d-9acd-3bf4525e0558 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:52.290362 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-f8487d29-0d16-494d-9acd-3bf4525e0558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:52.298980 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 773/1557] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:52.299540 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8487d29-0d16-494d-9acd-3bf4525e0558 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:52.311600 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8487d29-0d16-494d-9acd-3bf4525e0558 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:52.313794 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-9cd2aea5-3c1f-4038-9c4f-9ddc17836604 None None] MFA Rules not processed for user `ba6c83813eac480891cfd5b04b32b06c`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:52.314986 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-9cd2aea5-3c1f-4038-9c4f-9ddc17836604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:52.316332 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287834db-f14e-4cae-b99b-baa9ced157a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:52.317249 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287834db-f14e-4cae-b99b-baa9ced157a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:52.317669 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287834db-f14e-4cae-b99b-baa9ced157a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:52.317942 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287834db-f14e-4cae-b99b-baa9ced157a6 admin admin] PATH_INFO: `/v3/projects/45b6b8bf43fe4fb396ce1f429cd7a9d3/users/5048f89a0a654978a9d261abc9e3c512/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:52.334387 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287834db-f14e-4cae-b99b-baa9ced157a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45b6b8bf43fe4fb396ce1f429cd7a9d3, user_id=5048f89a0a654978a9d261abc9e3c512, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:52.340001 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287834db-f14e-4cae-b99b-baa9ced157a6 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:52.383617 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 785/1558] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:52 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:52.385402 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2aea5-3c1f-4038-9c4f-9ddc17836604 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:52.438600 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2aea5-3c1f-4038-9c4f-9ddc17836604 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:52.442531 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 774/1559] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:12:52 2021] PUT /identity/v3/projects/45b6b8bf43fe4fb396ce1f429cd7a9d3/users/5048f89a0a654978a9d261abc9e3c512/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:12:52.442531 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287834db-f14e-4cae-b99b-baa9ced157a6 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:52.496115 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c761874-a920-44d4-b567-543e22f807b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:52.496816 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c761874-a920-44d4-b567-543e22f807b1 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:52.497103 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c761874-a920-44d4-b567-543e22f807b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:52.497382 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c761874-a920-44d4-b567-543e22f807b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:52.512006 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287834db-f14e-4cae-b99b-baa9ced157a6 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:52.517083 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab85e8f-40b1-4371-8f8c-e9e8f1fe3015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:52.518141 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab85e8f-40b1-4371-8f8c-e9e8f1fe3015 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:52.518141 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab85e8f-40b1-4371-8f8c-e9e8f1fe3015 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:52.518384 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab85e8f-40b1-4371-8f8c-e9e8f1fe3015 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:52.519046 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab85e8f-40b1-4371-8f8c-e9e8f1fe3015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:52.521066 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab85e8f-40b1-4371-8f8c-e9e8f1fe3015 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:52.564339 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c761874-a920-44d4-b567-543e22f807b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:52.564339 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c761874-a920-44d4-b567-543e22f807b1 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:52.573641 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 786/1560] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:12:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:12:52.575045 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b79909-2767-4464-81c5-a2a8bb3b2d1e None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:52.575331 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b79909-2767-4464-81c5-a2a8bb3b2d1e None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:52.575613 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b79909-2767-4464-81c5-a2a8bb3b2d1e None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:52.577363 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 787/1561] 10.222.0.23 () {54 vars in 959 bytes} [Thu Sep 23 03:12:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:12:52.578234 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b79909-2767-4464-81c5-a2a8bb3b2d1e None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:52.594565 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b79909-2767-4464-81c5-a2a8bb3b2d1e None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:52.594565 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f88970-25b5-40b9-b50d-3bd4e1dd15c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:52.594565 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f88970-25b5-40b9-b50d-3bd4e1dd15c4 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:52.594565 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f88970-25b5-40b9-b50d-3bd4e1dd15c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:52.594897 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f88970-25b5-40b9-b50d-3bd4e1dd15c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:52.603302 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f88970-25b5-40b9-b50d-3bd4e1dd15c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:52.605267 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f88970-25b5-40b9-b50d-3bd4e1dd15c4 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:52.615658 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 788/1562] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:12:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:12:52.616608 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f88970-25b5-40b9-b50d-3bd4e1dd15c4 service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:52.629203 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f88970-25b5-40b9-b50d-3bd4e1dd15c4 service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:52.629775 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 775/1563] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:12:52 2021] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:12:52.630672 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab85e8f-40b1-4371-8f8c-e9e8f1fe3015 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:52.680464 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379eee1-8def-40c0-b7b7-f5701b132699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:52.681168 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379eee1-8def-40c0-b7b7-f5701b132699 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:52.681448 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379eee1-8def-40c0-b7b7-f5701b132699 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:52.681781 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379eee1-8def-40c0-b7b7-f5701b132699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:52.700732 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab85e8f-40b1-4371-8f8c-e9e8f1fe3015 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:52.705642 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5f211-d9b2-4905-8878-4dba2988227a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:52.706317 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5f211-d9b2-4905-8878-4dba2988227a admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:52.706635 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5f211-d9b2-4905-8878-4dba2988227a admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:52.706915 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5f211-d9b2-4905-8878-4dba2988227a admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:52.707615 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5f211-d9b2-4905-8878-4dba2988227a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:52.709704 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5f211-d9b2-4905-8878-4dba2988227a admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:52.743564 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379eee1-8def-40c0-b7b7-f5701b132699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:52.745685 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379eee1-8def-40c0-b7b7-f5701b132699 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:52.755295 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 789/1564] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:12:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:12:52.756173 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379eee1-8def-40c0-b7b7-f5701b132699 service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:52.769812 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379eee1-8def-40c0-b7b7-f5701b132699 service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:52.770621 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b4325-a568-45e9-a5b4-7398cad26c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:52.771268 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b4325-a568-45e9-a5b4-7398cad26c1c admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:52.771546 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b4325-a568-45e9-a5b4-7398cad26c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:52.771820 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b4325-a568-45e9-a5b4-7398cad26c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:52.772562 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b4325-a568-45e9-a5b4-7398cad26c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:52.774136 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b4325-a568-45e9-a5b4-7398cad26c1c admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:52.784178 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 790/1565] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:12:52 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:12:52.786329 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35308654-4fa8-4f34-8ff7-c206ee0b6cb0 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:52.786830 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35308654-4fa8-4f34-8ff7-c206ee0b6cb0 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:52.787626 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35308654-4fa8-4f34-8ff7-c206ee0b6cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:52.811531 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-35308654-4fa8-4f34-8ff7-c206ee0b6cb0 None None] MFA Rules not processed for user `83aa47f723434143b22aac1b96b6a610`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:52.812812 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-35308654-4fa8-4f34-8ff7-c206ee0b6cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:52.832201 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 776/1566] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:12:52 2021] POST /identity/v3/projects => generated 371 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:12:52.832201 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5f211-d9b2-4905-8878-4dba2988227a admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:52.886958 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 791/1567] 10.222.0.23 () {58 vars in 1057 bytes} [Thu Sep 23 03:12:52 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:52.888233 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35308654-4fa8-4f34-8ff7-c206ee0b6cb0 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:52.896480 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5f211-d9b2-4905-8878-4dba2988227a admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:52.900323 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35308654-4fa8-4f34-8ff7-c206ee0b6cb0 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:52.901785 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478fbfb-1aef-4177-8c1a-575ef9fb5ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:52.902500 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478fbfb-1aef-4177-8c1a-575ef9fb5ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:52.902784 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478fbfb-1aef-4177-8c1a-575ef9fb5ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:52.903079 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478fbfb-1aef-4177-8c1a-575ef9fb5ec7 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:52.903753 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478fbfb-1aef-4177-8c1a-575ef9fb5ec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:52.905748 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478fbfb-1aef-4177-8c1a-575ef9fb5ec7 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:52.908152 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac70d27-5a0d-4eb2-920c-7da234767e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:52.909364 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac70d27-5a0d-4eb2-920c-7da234767e43 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:52.909837 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac70d27-5a0d-4eb2-920c-7da234767e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:52.910433 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac70d27-5a0d-4eb2-920c-7da234767e43 admin admin] PATH_INFO: `/v3/projects/45b6b8bf43fe4fb396ce1f429cd7a9d3/users/5048f89a0a654978a9d261abc9e3c512/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:52.912653 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac70d27-5a0d-4eb2-920c-7da234767e43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45b6b8bf43fe4fb396ce1f429cd7a9d3, user_id=5048f89a0a654978a9d261abc9e3c512, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:52.915923 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac70d27-5a0d-4eb2-920c-7da234767e43 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:52.927302 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 792/1568] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:12:52 2021] PUT /identity/v3/projects/45b6b8bf43fe4fb396ce1f429cd7a9d3/users/5048f89a0a654978a9d261abc9e3c512/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:12:52.928172 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac70d27-5a0d-4eb2-920c-7da234767e43 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:52.972434 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 777/1569] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:12:52 2021] POST /identity/v3/users => generated 296 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:12:52.973685 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478fbfb-1aef-4177-8c1a-575ef9fb5ec7 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:52.992377 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac70d27-5a0d-4eb2-920c-7da234767e43 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:52.998017 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefe8e6-78ca-400f-8e7b-ba87598ea26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:52.998696 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefe8e6-78ca-400f-8e7b-ba87598ea26d admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:52.999053 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefe8e6-78ca-400f-8e7b-ba87598ea26d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:52.999242 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefe8e6-78ca-400f-8e7b-ba87598ea26d admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:52.999937 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefe8e6-78ca-400f-8e7b-ba87598ea26d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:53.001927 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefe8e6-78ca-400f-8e7b-ba87598ea26d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:53.052883 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478fbfb-1aef-4177-8c1a-575ef9fb5ec7 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:53.084578 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 793/1570] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:12:52 2021] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:12:53.084578 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f7ccb-e41a-4519-b0b6-49efbe235c9c None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:53.084578 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f7ccb-e41a-4519-b0b6-49efbe235c9c None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:53.084578 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f7ccb-e41a-4519-b0b6-49efbe235c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:53.112799 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-879f7ccb-e41a-4519-b0b6-49efbe235c9c None None] MFA Rules not processed for user `5048f89a0a654978a9d261abc9e3c512`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:53.114008 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-879f7ccb-e41a-4519-b0b6-49efbe235c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:53.122052 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51d748-27e2-4e8f-830c-e31ff9ac3c2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:53.122714 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51d748-27e2-4e8f-830c-e31ff9ac3c2f service nova] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:53.123006 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51d748-27e2-4e8f-830c-e31ff9ac3c2f service nova] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:53.123317 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51d748-27e2-4e8f-830c-e31ff9ac3c2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:53.176674 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51d748-27e2-4e8f-830c-e31ff9ac3c2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:53.178273 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51d748-27e2-4e8f-830c-e31ff9ac3c2f service nova] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:53.186868 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 794/1571] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:53 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:53.186868 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f7ccb-e41a-4519-b0b6-49efbe235c9c None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:53.188648 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 778/1572] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:12:52 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:12:53.189745 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51d748-27e2-4e8f-830c-e31ff9ac3c2f service nova] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:53.192126 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f7ccb-e41a-4519-b0b6-49efbe235c9c None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:53.198718 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c8f6f-e8cb-40b3-a50a-d441cc5f5029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:53.199908 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c8f6f-e8cb-40b3-a50a-d441cc5f5029 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:53.200374 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c8f6f-e8cb-40b3-a50a-d441cc5f5029 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:53.200617 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51d748-27e2-4e8f-830c-e31ff9ac3c2f service nova] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:53.201320 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c8f6f-e8cb-40b3-a50a-d441cc5f5029 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:53.202342 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c8f6f-e8cb-40b3-a50a-d441cc5f5029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:53.204393 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c8f6f-e8cb-40b3-a50a-d441cc5f5029 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:53.205990 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e7593-56f1-43f5-a4b8-6b6515c69103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:53.206689 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e7593-56f1-43f5-a4b8-6b6515c69103 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:53.207050 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e7593-56f1-43f5-a4b8-6b6515c69103 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:53.207328 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e7593-56f1-43f5-a4b8-6b6515c69103 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:53.208051 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e7593-56f1-43f5-a4b8-6b6515c69103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:53.209863 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e7593-56f1-43f5-a4b8-6b6515c69103 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:53.217550 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 795/1573] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:12:53 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:12:53.218881 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c8f6f-e8cb-40b3-a50a-d441cc5f5029 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:53.226895 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 779/1574] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:12:53 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:12:53.227450 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e7593-56f1-43f5-a4b8-6b6515c69103 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:53.242551 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e7593-56f1-43f5-a4b8-6b6515c69103 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:53.247564 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c8f6f-e8cb-40b3-a50a-d441cc5f5029 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:53.248223 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0af44e-a6e3-43ea-bf17-e9a75750ceab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:53.249226 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0af44e-a6e3-43ea-bf17-e9a75750ceab admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:53.254513 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0af44e-a6e3-43ea-bf17-e9a75750ceab admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:53.254513 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0af44e-a6e3-43ea-bf17-e9a75750ceab admin admin] PATH_INFO: `/v3/projects/ebf1152f30df45409e750acf945eddc2/users/30f219ba9b7f4a8ab2619b7725b6af2b/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:53.254723 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85d433-f7ba-485d-bd6a-21a1b40bf6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:53.254723 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85d433-f7ba-485d-bd6a-21a1b40bf6cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:53.255296 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85d433-f7ba-485d-bd6a-21a1b40bf6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:53.255797 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85d433-f7ba-485d-bd6a-21a1b40bf6cd admin admin] PATH_INFO: `/v3/users/bfdb8f7b5d0d4c0b932d0d94afe3e7cf` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:53.257312 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85d433-f7ba-485d-bd6a-21a1b40bf6cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfdb8f7b5d0d4c0b932d0d94afe3e7cf)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:53.260587 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85d433-f7ba-485d-bd6a-21a1b40bf6cd admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:53.271315 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0af44e-a6e3-43ea-bf17-e9a75750ceab admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebf1152f30df45409e750acf945eddc2, user_id=30f219ba9b7f4a8ab2619b7725b6af2b, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:53.275415 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0af44e-a6e3-43ea-bf17-e9a75750ceab admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:53.360565 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 780/1575] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:12:53 2021] PUT /identity/v3/projects/ebf1152f30df45409e750acf945eddc2/users/30f219ba9b7f4a8ab2619b7725b6af2b/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:12:53.362065 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0af44e-a6e3-43ea-bf17-e9a75750ceab admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:53.421550 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0af44e-a6e3-43ea-bf17-e9a75750ceab admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:53.427107 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad3a88f-6259-4dfc-855e-d5a87350f446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:53.427879 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3a88f-6259-4dfc-855e-d5a87350f446 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:53.428670 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3a88f-6259-4dfc-855e-d5a87350f446 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:53.428965 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3a88f-6259-4dfc-855e-d5a87350f446 admin admin] PATH_INFO: `/v3/projects/f3af3e9c0afd405db0a5bef07dd610e6/users/bdf53bf7236549a7a4bd6724169b71e1/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:53.449105 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad3a88f-6259-4dfc-855e-d5a87350f446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3af3e9c0afd405db0a5bef07dd610e6, user_id=bdf53bf7236549a7a4bd6724169b71e1, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:53.449105 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad3a88f-6259-4dfc-855e-d5a87350f446 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:53.460129 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-cf85d433-f7ba-485d-bd6a-21a1b40bf6cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfdb8f7b5d0d4c0b932d0d94afe3e7cf'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:12:53.460947 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-cf85d433-f7ba-485d-bd6a-21a1b40bf6cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfdb8f7b5d0d4c0b932d0d94afe3e7cf'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:12:53.461760 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-cf85d433-f7ba-485d-bd6a-21a1b40bf6cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfdb8f7b5d0d4c0b932d0d94afe3e7cf'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:12:53.469403 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-cf85d433-f7ba-485d-bd6a-21a1b40bf6cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfdb8f7b5d0d4c0b932d0d94afe3e7cf'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:12:53.560873 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-cf85d433-f7ba-485d-bd6a-21a1b40bf6cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfdb8f7b5d0d4c0b932d0d94afe3e7cf'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:12:53.570601 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 781/1576] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:12:53 2021] PUT /identity/v3/projects/f3af3e9c0afd405db0a5bef07dd610e6/users/bdf53bf7236549a7a4bd6724169b71e1/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:12:53.571888 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad3a88f-6259-4dfc-855e-d5a87350f446 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:53.574442 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-fad3a88f-6259-4dfc-855e-d5a87350f446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:53.586808 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 796/1577] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:12:53 2021] DELETE /identity/v3/users/bfdb8f7b5d0d4c0b932d0d94afe3e7cf => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:12:53.588537 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5ac46-6520-4002-a521-c738617bcd09 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:53.588838 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5ac46-6520-4002-a521-c738617bcd09 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:53.589122 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5ac46-6520-4002-a521-c738617bcd09 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:53.596247 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 797/1578] 10.222.0.23 () {54 vars in 912 bytes} [Thu Sep 23 03:12:53 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:12:53.597791 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5ac46-6520-4002-a521-c738617bcd09 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:53.599556 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-6ca5ac46-6520-4002-a521-c738617bcd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:53.657416 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad3a88f-6259-4dfc-855e-d5a87350f446 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:53.673966 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5ac46-6520-4002-a521-c738617bcd09 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:53.678627 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be819aee-a527-46b7-8341-1eb02a5e04c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:53.679304 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be819aee-a527-46b7-8341-1eb02a5e04c7 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:53.679587 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be819aee-a527-46b7-8341-1eb02a5e04c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:53.679895 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be819aee-a527-46b7-8341-1eb02a5e04c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:53.680656 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be819aee-a527-46b7-8341-1eb02a5e04c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:53.682812 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be819aee-a527-46b7-8341-1eb02a5e04c7 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:53.692550 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 798/1579] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:12:53 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:12:53.693782 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81445b-6971-4e4d-bc0a-d1e04191a9a4 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:53.694073 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81445b-6971-4e4d-bc0a-d1e04191a9a4 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:53.694355 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81445b-6971-4e4d-bc0a-d1e04191a9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:53.713718 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-9e81445b-6971-4e4d-bc0a-d1e04191a9a4 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:53.716026 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-9e81445b-6971-4e4d-bc0a-d1e04191a9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:53.721345 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c7d39-a9fb-47bd-97ed-0faa9b667269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:53.722034 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c7d39-a9fb-47bd-97ed-0faa9b667269 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:53.725730 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c7d39-a9fb-47bd-97ed-0faa9b667269 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:53.725730 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c7d39-a9fb-47bd-97ed-0faa9b667269 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:53.725730 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c7d39-a9fb-47bd-97ed-0faa9b667269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:53.725730 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c7d39-a9fb-47bd-97ed-0faa9b667269 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:53.731870 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 799/1580] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:53.731870 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed6185-47d8-4ac8-9c8c-27895aab7ae8 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:53.731870 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed6185-47d8-4ac8-9c8c-27895aab7ae8 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:53.731870 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed6185-47d8-4ac8-9c8c-27895aab7ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:53.735339 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 782/1581] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:12:53 2021] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:12:53.736480 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c7d39-a9fb-47bd-97ed-0faa9b667269 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:53.749195 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c7d39-a9fb-47bd-97ed-0faa9b667269 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:53.754453 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-9bed6185-47d8-4ac8-9c8c-27895aab7ae8 None None] MFA Rules not processed for user `83aa47f723434143b22aac1b96b6a610`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:53.755290 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e4be0-a073-44ea-aaec-d29e60d1e1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:53.755762 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-9bed6185-47d8-4ac8-9c8c-27895aab7ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:53.757009 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e4be0-a073-44ea-aaec-d29e60d1e1c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:53.758101 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e4be0-a073-44ea-aaec-d29e60d1e1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:53.758101 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e4be0-a073-44ea-aaec-d29e60d1e1c3 admin admin] PATH_INFO: `/v3/projects/f3af3e9c0afd405db0a5bef07dd610e6/users/bdf53bf7236549a7a4bd6724169b71e1/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:53.760330 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e4be0-a073-44ea-aaec-d29e60d1e1c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3af3e9c0afd405db0a5bef07dd610e6, user_id=bdf53bf7236549a7a4bd6724169b71e1, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:53.763670 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e4be0-a073-44ea-aaec-d29e60d1e1c3 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:53.777657 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 783/1582] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:12:53 2021] PUT /identity/v3/projects/f3af3e9c0afd405db0a5bef07dd610e6/users/bdf53bf7236549a7a4bd6724169b71e1/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:12:53.778852 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e4be0-a073-44ea-aaec-d29e60d1e1c3 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:53.855759 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 800/1583] 10.222.0.23 () {58 vars in 1010 bytes} [Thu Sep 23 03:12:53 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:53.856744 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed6185-47d8-4ac8-9c8c-27895aab7ae8 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:53.858240 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-9bed6185-47d8-4ac8-9c8c-27895aab7ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:53.874969 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e4be0-a073-44ea-aaec-d29e60d1e1c3 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:53.882586 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad09eb-2f4f-4ecb-ae99-1f0e5a461567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:53.883499 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad09eb-2f4f-4ecb-ae99-1f0e5a461567 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:53.883785 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad09eb-2f4f-4ecb-ae99-1f0e5a461567 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:53.884063 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad09eb-2f4f-4ecb-ae99-1f0e5a461567 admin admin] PATH_INFO: `/v3/projects/ebf1152f30df45409e750acf945eddc2/users/30f219ba9b7f4a8ab2619b7725b6af2b/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:53.886626 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad09eb-2f4f-4ecb-ae99-1f0e5a461567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebf1152f30df45409e750acf945eddc2, user_id=30f219ba9b7f4a8ab2619b7725b6af2b, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:53.889672 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad09eb-2f4f-4ecb-ae99-1f0e5a461567 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:53.901396 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 784/1584] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:12:53 2021] PUT /identity/v3/projects/ebf1152f30df45409e750acf945eddc2/users/30f219ba9b7f4a8ab2619b7725b6af2b/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:12:53.911670 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900c5c8-5ee1-4368-a0aa-a66b34c38403 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:53.911993 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900c5c8-5ee1-4368-a0aa-a66b34c38403 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:53.912241 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900c5c8-5ee1-4368-a0aa-a66b34c38403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:53.927184 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed6185-47d8-4ac8-9c8c-27895aab7ae8 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:53.944371 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-1900c5c8-5ee1-4368-a0aa-a66b34c38403 None None] MFA Rules not processed for user `bdf53bf7236549a7a4bd6724169b71e1`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:53.946124 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-1900c5c8-5ee1-4368-a0aa-a66b34c38403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:53.984344 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c83cd0-deaf-4a99-8ade-e22fbe0ea205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:53.985003 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c83cd0-deaf-4a99-8ade-e22fbe0ea205 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:53.985284 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c83cd0-deaf-4a99-8ade-e22fbe0ea205 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:53.985562 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c83cd0-deaf-4a99-8ade-e22fbe0ea205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:54.042041 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 785/1585] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:53 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:54.043037 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900c5c8-5ee1-4368-a0aa-a66b34c38403 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:54.044729 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-1900c5c8-5ee1-4368-a0aa-a66b34c38403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:54.057397 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c83cd0-deaf-4a99-8ade-e22fbe0ea205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:54.059088 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c83cd0-deaf-4a99-8ade-e22fbe0ea205 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:54.073997 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 801/1586] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:12:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:12:54.075505 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34ff9e-bce8-46c1-86c6-4f8184cfe7e6 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:54.076601 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34ff9e-bce8-46c1-86c6-4f8184cfe7e6 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:54.076799 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34ff9e-bce8-46c1-86c6-4f8184cfe7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:54.109746 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-4d34ff9e-bce8-46c1-86c6-4f8184cfe7e6 None None] MFA Rules not processed for user `30f219ba9b7f4a8ab2619b7725b6af2b`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:54.111053 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-4d34ff9e-bce8-46c1-86c6-4f8184cfe7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:54.127014 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900c5c8-5ee1-4368-a0aa-a66b34c38403 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:54.131004 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb533d9-65d3-4ebd-a7b6-57fcdda9d090 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:54.131893 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb533d9-65d3-4ebd-a7b6-57fcdda9d090 service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:54.132376 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb533d9-65d3-4ebd-a7b6-57fcdda9d090 service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:54.132837 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb533d9-65d3-4ebd-a7b6-57fcdda9d090 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:54.198830 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 802/1587] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:54 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:54.199887 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34ff9e-bce8-46c1-86c6-4f8184cfe7e6 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:54.201680 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-4d34ff9e-bce8-46c1-86c6-4f8184cfe7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:54.211806 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb533d9-65d3-4ebd-a7b6-57fcdda9d090 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:54.214452 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb533d9-65d3-4ebd-a7b6-57fcdda9d090 service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:54.215653 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34ff9e-bce8-46c1-86c6-4f8184cfe7e6 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:54.234123 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 786/1588] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:12:54 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:12:54.253423 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66050b48-2032-4b2d-af44-cd7e7902ebbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:54.253927 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66050b48-2032-4b2d-af44-cd7e7902ebbc service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:54.254214 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66050b48-2032-4b2d-af44-cd7e7902ebbc service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:54.256226 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66050b48-2032-4b2d-af44-cd7e7902ebbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:54.270869 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66050b48-2032-4b2d-af44-cd7e7902ebbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:54.270869 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66050b48-2032-4b2d-af44-cd7e7902ebbc service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:54.285269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 803/1589] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:12:54 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:12:54.501148 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb533d9-65d3-4ebd-a7b6-57fcdda9d090 service cinder] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:54.510150 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb533d9-65d3-4ebd-a7b6-57fcdda9d090 service cinder] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:54.514570 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308a4de-a703-4354-81ee-b2dd094f261f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:54.515234 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308a4de-a703-4354-81ee-b2dd094f261f service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:54.515528 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308a4de-a703-4354-81ee-b2dd094f261f service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:54.515791 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308a4de-a703-4354-81ee-b2dd094f261f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:54.526160 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308a4de-a703-4354-81ee-b2dd094f261f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:54.531371 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308a4de-a703-4354-81ee-b2dd094f261f service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:54.556427 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 787/1590] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:12:54 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:12:54.805234 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f38c2a-5f82-4d71-9eb1-2fe63ae0555c None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:54.805579 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f38c2a-5f82-4d71-9eb1-2fe63ae0555c None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:54.806008 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f38c2a-5f82-4d71-9eb1-2fe63ae0555c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:54.829716 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308a4de-a703-4354-81ee-b2dd094f261f service cinder] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:54.840081 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308a4de-a703-4354-81ee-b2dd094f261f service cinder] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:54.846938 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652ba0c-f83c-4631-83fc-508400627caf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:54.848524 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652ba0c-f83c-4631-83fc-508400627caf service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:54.849117 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652ba0c-f83c-4631-83fc-508400627caf service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:54.850294 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652ba0c-f83c-4631-83fc-508400627caf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:54.853868 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-4652ba0c-f83c-4631-83fc-508400627caf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:54.886232 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-d7f38c2a-5f82-4d71-9eb1-2fe63ae0555c None None] MFA Rules not processed for user `36893da01a1845f5af4921a298abb9eb`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:54.886232 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-d7f38c2a-5f82-4d71-9eb1-2fe63ae0555c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:55.003160 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652ba0c-f83c-4631-83fc-508400627caf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:55.004763 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652ba0c-f83c-4631-83fc-508400627caf service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:55.017149 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 788/1591] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:12:54 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:12:55.018015 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652ba0c-f83c-4631-83fc-508400627caf service cinder] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:55.019876 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-4652ba0c-f83c-4631-83fc-508400627caf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:55.039084 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652ba0c-f83c-4631-83fc-508400627caf service cinder] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:55.044985 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939317c4-d66d-45af-9392-50f47fee54f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:55.046637 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939317c4-d66d-45af-9392-50f47fee54f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:55.047134 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939317c4-d66d-45af-9392-50f47fee54f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:55.047611 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939317c4-d66d-45af-9392-50f47fee54f0 admin admin] PATH_INFO: `/v3/projects/ba8109328f0749ce9e888b91da7331b9` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:55.049181 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939317c4-d66d-45af-9392-50f47fee54f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba8109328f0749ce9e888b91da7331b9)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:55.053001 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939317c4-d66d-45af-9392-50f47fee54f0 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:55.064510 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 804/1592] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:54 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:55.077032 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809af017-c09c-4826-916f-6538dd77de42 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:55.077328 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809af017-c09c-4826-916f-6538dd77de42 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:55.077651 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809af017-c09c-4826-916f-6538dd77de42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:55.097598 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-809af017-c09c-4826-916f-6538dd77de42 None None] MFA Rules not processed for user `36893da01a1845f5af4921a298abb9eb`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:55.098853 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-809af017-c09c-4826-916f-6538dd77de42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:55.108879 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 805/1593] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:55 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:12:55.138466 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f61a7-5d2c-43b4-8e6b-0e757247cf70 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:55.141008 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f61a7-5d2c-43b4-8e6b-0e757247cf70 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:55.141520 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f61a7-5d2c-43b4-8e6b-0e757247cf70 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:55.147715 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 806/1594] 10.222.0.23 () {54 vars in 959 bytes} [Thu Sep 23 03:12:55 2021] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:12:55.153604 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9eb7e-9f6d-429e-ae62-c0446811fb43 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:55.199731 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9eb7e-9f6d-429e-ae62-c0446811fb43 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:55.199731 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9eb7e-9f6d-429e-ae62-c0446811fb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:55.199731 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-97a9eb7e-9f6d-429e-ae62-c0446811fb43 None None] MFA Rules not processed for user `83aa47f723434143b22aac1b96b6a610`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:55.199731 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-97a9eb7e-9f6d-429e-ae62-c0446811fb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:55.221004 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 807/1595] 10.222.0.23 () {58 vars in 1057 bytes} [Thu Sep 23 03:12:55 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:12:55.227752 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9eb7e-9f6d-429e-ae62-c0446811fb43 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:55.248837 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9eb7e-9f6d-429e-ae62-c0446811fb43 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:55.263145 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5c50a-4c41-48b5-b00d-4aa27d173066 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:55.264692 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5c50a-4c41-48b5-b00d-4aa27d173066 service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:55.268728 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5c50a-4c41-48b5-b00d-4aa27d173066 service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:55.270919 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5c50a-4c41-48b5-b00d-4aa27d173066 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:55.279215 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5c50a-4c41-48b5-b00d-4aa27d173066 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:55.280931 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5c50a-4c41-48b5-b00d-4aa27d173066 service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:55.291299 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 808/1596] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:12:55 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:12:55.367477 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-939317c4-d66d-45af-9392-50f47fee54f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba8109328f0749ce9e888b91da7331b9', 'request_id': 'req-939317c4-d66d-45af-9392-50f47fee54f0'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:12:55.450394 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-939317c4-d66d-45af-9392-50f47fee54f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba8109328f0749ce9e888b91da7331b9', 'request_id': 'req-939317c4-d66d-45af-9392-50f47fee54f0'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:12:55.458111 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-939317c4-d66d-45af-9392-50f47fee54f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba8109328f0749ce9e888b91da7331b9', 'request_id': 'req-939317c4-d66d-45af-9392-50f47fee54f0'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:12:55.480730 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-939317c4-d66d-45af-9392-50f47fee54f0 admin admin] The token cache is being invalidate because project ba8109328f0749ce9e888b91da7331b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:12:55.481030 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-939317c4-d66d-45af-9392-50f47fee54f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:12:55.481699 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-939317c4-d66d-45af-9392-50f47fee54f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:12:55.483509 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 789/1597] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:12:55 2021] DELETE /identity/v3/projects/ba8109328f0749ce9e888b91da7331b9 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:12:55.487585 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5c50a-4c41-48b5-b00d-4aa27d173066 service nova] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:55.501921 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5c50a-4c41-48b5-b00d-4aa27d173066 service nova] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:55.623734 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32d608-d11a-4d12-9a66-4c15a88ecfcf None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:55.624027 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32d608-d11a-4d12-9a66-4c15a88ecfcf None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:55.624315 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32d608-d11a-4d12-9a66-4c15a88ecfcf None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:55.627338 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 790/1598] 10.222.0.23 () {54 vars in 912 bytes} [Thu Sep 23 03:12:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:12:55.639169 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25182abb-8bdc-420b-8fba-08d2ae782d6b None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:55.639494 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25182abb-8bdc-420b-8fba-08d2ae782d6b None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:55.641500 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25182abb-8bdc-420b-8fba-08d2ae782d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:55.642626 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2c91d-9354-4414-a0ce-37660597bb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:55.643514 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2c91d-9354-4414-a0ce-37660597bb58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:55.643878 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2c91d-9354-4414-a0ce-37660597bb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:55.644159 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2c91d-9354-4414-a0ce-37660597bb58 admin admin] PATH_INFO: `/v3/users/5048f89a0a654978a9d261abc9e3c512` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:55.645401 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2c91d-9354-4414-a0ce-37660597bb58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5048f89a0a654978a9d261abc9e3c512)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:55.647456 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2c91d-9354-4414-a0ce-37660597bb58 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:55.690821 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-25182abb-8bdc-420b-8fba-08d2ae782d6b None None] MFA Rules not processed for user `83aa47f723434143b22aac1b96b6a610`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:55.692188 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-25182abb-8bdc-420b-8fba-08d2ae782d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:55.836362 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 791/1599] 10.222.0.23 () {58 vars in 1010 bytes} [Thu Sep 23 03:12:55 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:12:55.848243 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-36f2c91d-9354-4414-a0ce-37660597bb58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5048f89a0a654978a9d261abc9e3c512'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:12:55.849859 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-36f2c91d-9354-4414-a0ce-37660597bb58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5048f89a0a654978a9d261abc9e3c512'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:12:55.851042 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-36f2c91d-9354-4414-a0ce-37660597bb58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5048f89a0a654978a9d261abc9e3c512'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:12:55.853323 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25182abb-8bdc-420b-8fba-08d2ae782d6b None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:55.856162 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-25182abb-8bdc-420b-8fba-08d2ae782d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:55.873273 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-36f2c91d-9354-4414-a0ce-37660597bb58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5048f89a0a654978a9d261abc9e3c512'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:12:55.966004 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25182abb-8bdc-420b-8fba-08d2ae782d6b None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:55.971418 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0a593-81c1-4f2a-a960-37d3b835145d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83242c1ef12d4a5b800e67346f4ad963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:55.972356 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0a593-81c1-4f2a-a960-37d3b835145d service glance] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:55.972757 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0a593-81c1-4f2a-a960-37d3b835145d service glance] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:55.973575 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0a593-81c1-4f2a-a960-37d3b835145d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:55.975022 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-42e0a593-81c1-4f2a-a960-37d3b835145d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:55.994068 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-36f2c91d-9354-4414-a0ce-37660597bb58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5048f89a0a654978a9d261abc9e3c512'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:12:56.007864 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0a593-81c1-4f2a-a960-37d3b835145d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:56.007864 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0a593-81c1-4f2a-a960-37d3b835145d service glance] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:56.020223 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 792/1600] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:12:55 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:12:56.047838 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 809/1601] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:12:55 2021] DELETE /identity/v3/users/5048f89a0a654978a9d261abc9e3c512 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:12:56.572391 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50671aa9-8abf-410f-a039-30d6bb359d89 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:56.572391 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50671aa9-8abf-410f-a039-30d6bb359d89 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:56.572391 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50671aa9-8abf-410f-a039-30d6bb359d89 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:56.572391 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 793/1602] 10.222.0.23 () {54 vars in 912 bytes} [Thu Sep 23 03:12:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:12:56.576253 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9539f58-3a73-43b6-837e-f8c109df50d6 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:56.576807 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9539f58-3a73-43b6-837e-f8c109df50d6 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:56.576908 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9539f58-3a73-43b6-837e-f8c109df50d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:56.579841 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50671aa9-8abf-410f-a039-30d6bb359d89 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:56.581737 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-50671aa9-8abf-410f-a039-30d6bb359d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:56.674645 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-c9539f58-3a73-43b6-837e-f8c109df50d6 None None] MFA Rules not processed for user `621e97bd0914448c8afadba25510053d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:56.677638 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-c9539f58-3a73-43b6-837e-f8c109df50d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:56.730135 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50671aa9-8abf-410f-a039-30d6bb359d89 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:56.741454 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d2363-8bbf-4e5c-9c53-553cd1fff4a7 tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30f219ba9b7f4a8ab2619b7725b6af2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebf1152f30df45409e750acf945eddc2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:56.742183 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d2363-8bbf-4e5c-9c53-553cd1fff4a7 tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:56.742480 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d2363-8bbf-4e5c-9c53-553cd1fff4a7 tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:56.742769 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d2363-8bbf-4e5c-9c53-553cd1fff4a7 tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:56.743528 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d2363-8bbf-4e5c-9c53-553cd1fff4a7 tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:12:56.743824 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d2363-8bbf-4e5c-9c53-553cd1fff4a7 tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:56.749084 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d2363-8bbf-4e5c-9c53-553cd1fff4a7 tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:56.764856 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 794/1603] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:12:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:12:56.768613 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d2363-8bbf-4e5c-9c53-553cd1fff4a7 tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:56.785823 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 810/1604] 10.222.0.23 () {58 vars in 1010 bytes} [Thu Sep 23 03:12:56 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:56.787655 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cd299-a87d-431e-83a9-8c6bece19816 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:56.788015 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cd299-a87d-431e-83a9-8c6bece19816 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:56.788364 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cd299-a87d-431e-83a9-8c6bece19816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:56.789284 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d2363-8bbf-4e5c-9c53-553cd1fff4a7 tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:56.794734 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0404f6d-cf0a-40a1-b7dd-0e48f400651a tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30f219ba9b7f4a8ab2619b7725b6af2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebf1152f30df45409e750acf945eddc2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:56.795877 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0404f6d-cf0a-40a1-b7dd-0e48f400651a tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:56.795877 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0404f6d-cf0a-40a1-b7dd-0e48f400651a tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:56.796307 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0404f6d-cf0a-40a1-b7dd-0e48f400651a tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:56.797643 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0404f6d-cf0a-40a1-b7dd-0e48f400651a tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:56.800081 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0404f6d-cf0a-40a1-b7dd-0e48f400651a tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:56.840971 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-f37cd299-a87d-431e-83a9-8c6bece19816 None None] MFA Rules not processed for user `415880421b3f4b7896e49188e8d1395c`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:56.842613 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-f37cd299-a87d-431e-83a9-8c6bece19816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:56.911607 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 795/1605] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:12:56 2021] POST /identity/v3/projects => generated 354 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:12:56.912836 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0404f6d-cf0a-40a1-b7dd-0e48f400651a tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:56.914976 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-b0404f6d-cf0a-40a1-b7dd-0e48f400651a tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:56.924229 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 811/1606] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:56 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:56.933162 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cd299-a87d-431e-83a9-8c6bece19816 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:56.949970 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cd299-a87d-431e-83a9-8c6bece19816 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:57.025089 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0404f6d-cf0a-40a1-b7dd-0e48f400651a tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:57.036993 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76f158-3a04-4e9a-b21f-48fcc3e0d5b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:57.037412 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76f158-3a04-4e9a-b21f-48fcc3e0d5b5 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:57.037871 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76f158-3a04-4e9a-b21f-48fcc3e0d5b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:57.038515 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76f158-3a04-4e9a-b21f-48fcc3e0d5b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:57.047772 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76f158-3a04-4e9a-b21f-48fcc3e0d5b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:57.049260 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76f158-3a04-4e9a-b21f-48fcc3e0d5b5 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:57.058297 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a867b-22bd-46d8-931b-5881dbe91eba tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30f219ba9b7f4a8ab2619b7725b6af2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebf1152f30df45409e750acf945eddc2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:57.058991 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a867b-22bd-46d8-931b-5881dbe91eba tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:57.066874 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a867b-22bd-46d8-931b-5881dbe91eba tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:57.066874 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a867b-22bd-46d8-931b-5881dbe91eba tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:57.066874 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a867b-22bd-46d8-931b-5881dbe91eba tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:12:57.066874 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a867b-22bd-46d8-931b-5881dbe91eba tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:57.066874 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a867b-22bd-46d8-931b-5881dbe91eba tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:57.072625 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 796/1607] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:12:56 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:12:57.074181 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ea602-d3c7-4559-be65-6f96e5989ec6 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:57.075091 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ea602-d3c7-4559-be65-6f96e5989ec6 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:57.075531 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ea602-d3c7-4559-be65-6f96e5989ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:57.105810 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-583ea602-d3c7-4559-be65-6f96e5989ec6 None None] MFA Rules not processed for user `415880421b3f4b7896e49188e8d1395c`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:57.107896 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-583ea602-d3c7-4559-be65-6f96e5989ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:57.121980 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 812/1608] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:12:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:12:57.169171 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a867b-22bd-46d8-931b-5881dbe91eba tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:57.191696 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a867b-22bd-46d8-931b-5881dbe91eba tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:57.200081 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50bf34-f161-4d88-b968-0d87d1f1d80e tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30f219ba9b7f4a8ab2619b7725b6af2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebf1152f30df45409e750acf945eddc2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:57.204368 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50bf34-f161-4d88-b968-0d87d1f1d80e tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:57.206019 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50bf34-f161-4d88-b968-0d87d1f1d80e tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:57.207474 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50bf34-f161-4d88-b968-0d87d1f1d80e tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] PATH_INFO: `/v3/projects/211949649697471fa026293a3542d6bf` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:57.214098 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50bf34-f161-4d88-b968-0d87d1f1d80e tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] RBAC: Authorizing `identity:delete_project(project_id=211949649697471fa026293a3542d6bf)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:57.217560 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: WARNING py.warnings [None req-dc50bf34-f161-4d88-b968-0d87d1f1d80e tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:12:57.217560 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: warnings.warn(msg) Sep 23 03:12:57.217560 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: Sep 23 03:12:57.243198 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50bf34-f161-4d88-b968-0d87d1f1d80e tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:57.258928 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 797/1609] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:57 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:57.272783 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ea602-d3c7-4559-be65-6f96e5989ec6 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:57.279730 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-583ea602-d3c7-4559-be65-6f96e5989ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:57.425743 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ea602-d3c7-4559-be65-6f96e5989ec6 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:57.432577 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a978ef0-c46a-41da-9e00-1d886d30260a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:57.433330 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a978ef0-c46a-41da-9e00-1d886d30260a service nova] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:57.433683 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a978ef0-c46a-41da-9e00-1d886d30260a service nova] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:57.434032 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a978ef0-c46a-41da-9e00-1d886d30260a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:57.444645 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a978ef0-c46a-41da-9e00-1d886d30260a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:57.446419 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a978ef0-c46a-41da-9e00-1d886d30260a service nova] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:57.456961 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 798/1610] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:12:57 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:12:57.574481 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a978ef0-c46a-41da-9e00-1d886d30260a service nova] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:57.576367 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-2a978ef0-c46a-41da-9e00-1d886d30260a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:57.718948 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-dc50bf34-f161-4d88-b968-0d87d1f1d80e tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '211949649697471fa026293a3542d6bf', 'request_id': 'req-dc50bf34-f161-4d88-b968-0d87d1f1d80e'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:12:57.730862 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a978ef0-c46a-41da-9e00-1d886d30260a service nova] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:57.836457 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a52ea-0634-448b-b447-cf895d76d2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:57.839461 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a52ea-0634-448b-b447-cf895d76d2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:57.839969 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a52ea-0634-448b-b447-cf895d76d2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:57.841312 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a52ea-0634-448b-b447-cf895d76d2b3 admin admin] PATH_INFO: `/v3/projects/45b6b8bf43fe4fb396ce1f429cd7a9d3` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:57.843123 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a52ea-0634-448b-b447-cf895d76d2b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45b6b8bf43fe4fb396ce1f429cd7a9d3)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:57.861773 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a52ea-0634-448b-b447-cf895d76d2b3 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:57.863759 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-dc50bf34-f161-4d88-b968-0d87d1f1d80e tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '211949649697471fa026293a3542d6bf', 'request_id': 'req-dc50bf34-f161-4d88-b968-0d87d1f1d80e'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:12:57.883822 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-dc50bf34-f161-4d88-b968-0d87d1f1d80e tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '211949649697471fa026293a3542d6bf', 'request_id': 'req-dc50bf34-f161-4d88-b968-0d87d1f1d80e'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:12:57.946366 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-dc50bf34-f161-4d88-b968-0d87d1f1d80e tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] The token cache is being invalidate because project 211949649697471fa026293a3542d6bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:12:57.946660 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-dc50bf34-f161-4d88-b968-0d87d1f1d80e tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:12:57.949071 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-dc50bf34-f161-4d88-b968-0d87d1f1d80e tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:12:57.957879 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 813/1611] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:12:57 2021] DELETE /identity/v3/projects/211949649697471fa026293a3542d6bf => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:12:58.120766 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-b94a52ea-0634-448b-b447-cf895d76d2b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45b6b8bf43fe4fb396ce1f429cd7a9d3', 'request_id': 'req-b94a52ea-0634-448b-b447-cf895d76d2b3'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:12:58.150784 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50bf34-f161-4d88-b968-0d87d1f1d80e tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:58.152530 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-dc50bf34-f161-4d88-b968-0d87d1f1d80e tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:58.240557 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-b94a52ea-0634-448b-b447-cf895d76d2b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45b6b8bf43fe4fb396ce1f429cd7a9d3', 'request_id': 'req-b94a52ea-0634-448b-b447-cf895d76d2b3'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:12:58.258763 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-b94a52ea-0634-448b-b447-cf895d76d2b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45b6b8bf43fe4fb396ce1f429cd7a9d3', 'request_id': 'req-b94a52ea-0634-448b-b447-cf895d76d2b3'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:12:58.278981 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-b94a52ea-0634-448b-b447-cf895d76d2b3 admin admin] The token cache is being invalidate because project 45b6b8bf43fe4fb396ce1f429cd7a9d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:12:58.279278 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-b94a52ea-0634-448b-b447-cf895d76d2b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:12:58.284168 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-b94a52ea-0634-448b-b447-cf895d76d2b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:12:58.287976 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 799/1612] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:12:57 2021] DELETE /identity/v3/projects/45b6b8bf43fe4fb396ce1f429cd7a9d3 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:12:58.289138 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50bf34-f161-4d88-b968-0d87d1f1d80e tempest-VolumeQuotaClassesTest-244529441 tempest-VolumeQuotaClassesTest-244529441-project-admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:58.294950 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a3e1b-1765-4309-b192-20835d96d7fe None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:58.295312 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a3e1b-1765-4309-b192-20835d96d7fe None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:58.295687 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a3e1b-1765-4309-b192-20835d96d7fe None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:58.298332 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 800/1613] 10.222.0.23 () {54 vars in 912 bytes} [Thu Sep 23 03:12:58 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:12:58.300149 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd8039-4937-49b2-b4c5-c4385cf32f65 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:58.300546 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd8039-4937-49b2-b4c5-c4385cf32f65 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:58.301153 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd8039-4937-49b2-b4c5-c4385cf32f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:58.358476 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-71cd8039-4937-49b2-b4c5-c4385cf32f65 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:58.360636 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-71cd8039-4937-49b2-b4c5-c4385cf32f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:58.470411 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418129f-002b-4651-a848-910a365ef620 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b7e780a23e4ee499cb7820a85feccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:58.470411 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418129f-002b-4651-a848-910a365ef620 service placement] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:58.470605 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418129f-002b-4651-a848-910a365ef620 service placement] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:58.470859 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418129f-002b-4651-a848-910a365ef620 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:58.475875 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-e418129f-002b-4651-a848-910a365ef620 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:58.503829 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418129f-002b-4651-a848-910a365ef620 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:58.505488 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418129f-002b-4651-a848-910a365ef620 service placement] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:58.506715 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 801/1614] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:58.508476 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50770ab-17c9-47b1-8013-64284e743549 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:58.509906 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50770ab-17c9-47b1-8013-64284e743549 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:58.510195 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50770ab-17c9-47b1-8013-64284e743549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:58.541756 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 814/1615] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:12:58 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:12:58.543295 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5964b20-3fc1-4799-9067-90892ff4dea1 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:58.543586 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5964b20-3fc1-4799-9067-90892ff4dea1 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:58.543863 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5964b20-3fc1-4799-9067-90892ff4dea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:58.583776 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-c5964b20-3fc1-4799-9067-90892ff4dea1 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:58.585066 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-c5964b20-3fc1-4799-9067-90892ff4dea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:58.609021 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-b50770ab-17c9-47b1-8013-64284e743549 None None] MFA Rules not processed for user `621e97bd0914448c8afadba25510053d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:12:58.612021 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 815/1616] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:12:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:58.615417 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5964b20-3fc1-4799-9067-90892ff4dea1 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:58.620677 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-b50770ab-17c9-47b1-8013-64284e743549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:58.635248 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5964b20-3fc1-4799-9067-90892ff4dea1 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:58.658173 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb0ba6-a76b-4ec0-a489-4bfe6c0fb34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:58.658173 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb0ba6-a76b-4ec0-a489-4bfe6c0fb34c admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:58.658173 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb0ba6-a76b-4ec0-a489-4bfe6c0fb34c admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:58.658173 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb0ba6-a76b-4ec0-a489-4bfe6c0fb34c admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:58.658669 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb0ba6-a76b-4ec0-a489-4bfe6c0fb34c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:12:58.658669 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb0ba6-a76b-4ec0-a489-4bfe6c0fb34c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:58.659924 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb0ba6-a76b-4ec0-a489-4bfe6c0fb34c admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:58.692103 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 816/1617] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:12:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 03:12:58.703722 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 802/1618] 10.222.0.23 () {58 vars in 1010 bytes} [Thu Sep 23 03:12:58 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:12:58.709160 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb0ba6-a76b-4ec0-a489-4bfe6c0fb34c admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:58.725255 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50770ab-17c9-47b1-8013-64284e743549 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:58.728079 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-b50770ab-17c9-47b1-8013-64284e743549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:58.734905 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb0ba6-a76b-4ec0-a489-4bfe6c0fb34c admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:58.741818 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887541fc-9b2b-42f3-9a46-b4b6af7810db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:58.742485 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887541fc-9b2b-42f3-9a46-b4b6af7810db admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:58.742768 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887541fc-9b2b-42f3-9a46-b4b6af7810db admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:58.743050 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887541fc-9b2b-42f3-9a46-b4b6af7810db admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:58.743816 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887541fc-9b2b-42f3-9a46-b4b6af7810db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:58.746413 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887541fc-9b2b-42f3-9a46-b4b6af7810db admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:58.758495 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50770ab-17c9-47b1-8013-64284e743549 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:58.768345 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d196381-5e68-44fd-bcaa-80069a904cd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:58.772820 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d196381-5e68-44fd-bcaa-80069a904cd1 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:58.773392 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d196381-5e68-44fd-bcaa-80069a904cd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:58.774050 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d196381-5e68-44fd-bcaa-80069a904cd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:58.797232 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d196381-5e68-44fd-bcaa-80069a904cd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:58.797232 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d196381-5e68-44fd-bcaa-80069a904cd1 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:58.800910 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 803/1619] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:12:58 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:12:58.891961 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d196381-5e68-44fd-bcaa-80069a904cd1 service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:58.893568 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-6d196381-5e68-44fd-bcaa-80069a904cd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:12:58.907542 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 817/1620] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:12:58 2021] POST /identity/v3/projects => generated 365 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:12:58.914572 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887541fc-9b2b-42f3-9a46-b4b6af7810db admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:58.922016 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d196381-5e68-44fd-bcaa-80069a904cd1 service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:59.012655 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887541fc-9b2b-42f3-9a46-b4b6af7810db admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:59.027577 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed3142-0e77-4492-94f9-e541d68cd145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:59.031050 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed3142-0e77-4492-94f9-e541d68cd145 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:59.031344 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed3142-0e77-4492-94f9-e541d68cd145 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:59.032853 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed3142-0e77-4492-94f9-e541d68cd145 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:59.046894 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed3142-0e77-4492-94f9-e541d68cd145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:59.049921 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed3142-0e77-4492-94f9-e541d68cd145 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:59.055062 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a79c7-8368-4d36-b3c1-79b0abbf8ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:59.055563 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a79c7-8368-4d36-b3c1-79b0abbf8ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:59.056343 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a79c7-8368-4d36-b3c1-79b0abbf8ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:59.056555 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a79c7-8368-4d36-b3c1-79b0abbf8ee7 admin admin] PATH_INFO: `/v3/users/7f33f8201ff842cc9ee6ab60c16a4280` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:59.060665 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a79c7-8368-4d36-b3c1-79b0abbf8ee7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f33f8201ff842cc9ee6ab60c16a4280)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:59.061880 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: WARNING py.warnings [None req-f90a79c7-8368-4d36-b3c1-79b0abbf8ee7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:12:59.061880 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: warnings.warn(msg) Sep 23 03:12:59.061880 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: Sep 23 03:12:59.063098 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a79c7-8368-4d36-b3c1-79b0abbf8ee7 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:59.294468 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 818/1621] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:12:58 2021] POST /identity/v3/users => generated 283 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:12:59.298737 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed3142-0e77-4492-94f9-e541d68cd145 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:59.321909 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed3142-0e77-4492-94f9-e541d68cd145 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:59.336415 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a75a1-8643-491f-a9d7-c6f3e0c9f76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:59.337612 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a75a1-8643-491f-a9d7-c6f3e0c9f76c admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:59.339717 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a75a1-8643-491f-a9d7-c6f3e0c9f76c admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:59.340160 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a75a1-8643-491f-a9d7-c6f3e0c9f76c admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:59.341099 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a75a1-8643-491f-a9d7-c6f3e0c9f76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:59.342936 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a75a1-8643-491f-a9d7-c6f3e0c9f76c admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:59.359212 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 819/1622] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:12:59 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:12:59.361324 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a75a1-8643-491f-a9d7-c6f3e0c9f76c admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:59.385681 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a75a1-8643-491f-a9d7-c6f3e0c9f76c admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:59.397852 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da68468-cfef-4063-8460-e0296b9493ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:59.398544 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da68468-cfef-4063-8460-e0296b9493ff admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:59.398828 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da68468-cfef-4063-8460-e0296b9493ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:59.399106 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da68468-cfef-4063-8460-e0296b9493ff admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:59.399844 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da68468-cfef-4063-8460-e0296b9493ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:59.402049 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da68468-cfef-4063-8460-e0296b9493ff admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:59.424017 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 820/1623] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:12:59 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:12:59.428184 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da68468-cfef-4063-8460-e0296b9493ff admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:12:59.448996 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da68468-cfef-4063-8460-e0296b9493ff admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:12:59.459621 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05b837-5986-4642-bb2f-92a446de90ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:12:59.460568 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05b837-5986-4642-bb2f-92a446de90ef admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:12:59.460857 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05b837-5986-4642-bb2f-92a446de90ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:12:59.461138 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05b837-5986-4642-bb2f-92a446de90ef admin admin] PATH_INFO: `/v3/projects/b786c92c7d7049dca294ad6cbb4fdcc0/users/e379f4b23db245ac960035f748abc5ee/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:12:59.508788 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05b837-5986-4642-bb2f-92a446de90ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b786c92c7d7049dca294ad6cbb4fdcc0, user_id=e379f4b23db245ac960035f748abc5ee, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:12:59.518505 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05b837-5986-4642-bb2f-92a446de90ef admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:12:59.674011 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-f90a79c7-8368-4d36-b3c1-79b0abbf8ee7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f33f8201ff842cc9ee6ab60c16a4280'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:12:59.674011 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-f90a79c7-8368-4d36-b3c1-79b0abbf8ee7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f33f8201ff842cc9ee6ab60c16a4280'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:12:59.674011 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-f90a79c7-8368-4d36-b3c1-79b0abbf8ee7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f33f8201ff842cc9ee6ab60c16a4280'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:00.036467 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-f90a79c7-8368-4d36-b3c1-79b0abbf8ee7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f33f8201ff842cc9ee6ab60c16a4280'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:00.049272 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 821/1624] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:12:59 2021] PUT /identity/v3/projects/b786c92c7d7049dca294ad6cbb4fdcc0/users/e379f4b23db245ac960035f748abc5ee/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:00.074998 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4e008-8d1d-4ebf-b35d-67a7a991f4ed None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:00.075458 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4e008-8d1d-4ebf-b35d-67a7a991f4ed None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:00.075894 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4e008-8d1d-4ebf-b35d-67a7a991f4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:00.109634 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-b7e4e008-8d1d-4ebf-b35d-67a7a991f4ed None None] MFA Rules not processed for user `e379f4b23db245ac960035f748abc5ee`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:00.110982 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-b7e4e008-8d1d-4ebf-b35d-67a7a991f4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:00.114503 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-f90a79c7-8368-4d36-b3c1-79b0abbf8ee7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f33f8201ff842cc9ee6ab60c16a4280'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:00.135474 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 804/1625] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:12:58 2021] DELETE /identity/v3/users/7f33f8201ff842cc9ee6ab60c16a4280 => generated 0 bytes in 1244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:00.140002 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d82fb2-62a4-4249-b32b-2a06b83e78e4 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:00.140304 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d82fb2-62a4-4249-b32b-2a06b83e78e4 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:00.140617 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d82fb2-62a4-4249-b32b-2a06b83e78e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:00.185283 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-79d82fb2-62a4-4249-b32b-2a06b83e78e4 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:00.191195 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-79d82fb2-62a4-4249-b32b-2a06b83e78e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:00.216572 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 822/1626] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:00 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:00.219309 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4e008-8d1d-4ebf-b35d-67a7a991f4ed None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:00.221572 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-b7e4e008-8d1d-4ebf-b35d-67a7a991f4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:00.315142 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 805/1627] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:13:00.326093 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d82fb2-62a4-4249-b32b-2a06b83e78e4 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:00.327423 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-79d82fb2-62a4-4249-b32b-2a06b83e78e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:00.340717 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4e008-8d1d-4ebf-b35d-67a7a991f4ed None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:00.346553 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599eece9-5f3c-4dd1-bf22-8ab76fde3e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:00.347735 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599eece9-5f3c-4dd1-bf22-8ab76fde3e60 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:00.348222 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599eece9-5f3c-4dd1-bf22-8ab76fde3e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:00.348677 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599eece9-5f3c-4dd1-bf22-8ab76fde3e60 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:00.349558 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599eece9-5f3c-4dd1-bf22-8ab76fde3e60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:00.352953 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599eece9-5f3c-4dd1-bf22-8ab76fde3e60 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:00.458213 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d82fb2-62a4-4249-b32b-2a06b83e78e4 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:00.465752 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a7c6e-eca6-4f3f-bc1e-ee67c8c5bd6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:00.466634 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a7c6e-eca6-4f3f-bc1e-ee67c8c5bd6b service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:00.467095 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a7c6e-eca6-4f3f-bc1e-ee67c8c5bd6b service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:00.467378 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a7c6e-eca6-4f3f-bc1e-ee67c8c5bd6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:00.486973 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a7c6e-eca6-4f3f-bc1e-ee67c8c5bd6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:00.486973 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a7c6e-eca6-4f3f-bc1e-ee67c8c5bd6b service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:00.489237 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 823/1628] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:13:00 2021] POST /identity/v3/projects => generated 363 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:13:00.490389 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599eece9-5f3c-4dd1-bf22-8ab76fde3e60 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:00.496413 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 806/1629] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:13:00.665130 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599eece9-5f3c-4dd1-bf22-8ab76fde3e60 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:00.680941 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502bc1c-902d-45df-9e01-ff070b9d4822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:00.681506 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502bc1c-902d-45df-9e01-ff070b9d4822 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:00.681804 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502bc1c-902d-45df-9e01-ff070b9d4822 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:00.682083 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502bc1c-902d-45df-9e01-ff070b9d4822 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:00.682787 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502bc1c-902d-45df-9e01-ff070b9d4822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:00.686246 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502bc1c-902d-45df-9e01-ff070b9d4822 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:01.010732 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 824/1630] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:13:00 2021] POST /identity/v3/users => generated 288 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:13:01.011370 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a7c6e-eca6-4f3f-bc1e-ee67c8c5bd6b service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:01.011370 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a7c6e-eca6-4f3f-bc1e-ee67c8c5bd6b service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:01.011370 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b14521-65f2-4079-8c69-dfaaf452672f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:01.011370 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b14521-65f2-4079-8c69-dfaaf452672f admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:01.012229 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b14521-65f2-4079-8c69-dfaaf452672f admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:01.012229 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b14521-65f2-4079-8c69-dfaaf452672f admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:01.012229 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b14521-65f2-4079-8c69-dfaaf452672f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:01.012229 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b14521-65f2-4079-8c69-dfaaf452672f admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:01.012229 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 807/1631] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:00 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:13:01.012749 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502bc1c-902d-45df-9e01-ff070b9d4822 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:01.012749 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502bc1c-902d-45df-9e01-ff070b9d4822 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:01.012749 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48de17-dc43-4f72-9493-e781b964cb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:01.012749 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48de17-dc43-4f72-9493-e781b964cb27 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:01.013074 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48de17-dc43-4f72-9493-e781b964cb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:01.013074 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48de17-dc43-4f72-9493-e781b964cb27 admin admin] PATH_INFO: `/v3/projects/1bcb89821a7a46349bd3456e1f58f98b/users/99f5f1d66e904e379b463570d1ce4257/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:01.013074 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48de17-dc43-4f72-9493-e781b964cb27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bcb89821a7a46349bd3456e1f58f98b, user_id=99f5f1d66e904e379b463570d1ce4257, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:01.013074 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48de17-dc43-4f72-9493-e781b964cb27 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:01.136680 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 825/1632] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:13:00 2021] PUT /identity/v3/projects/1bcb89821a7a46349bd3456e1f58f98b/users/99f5f1d66e904e379b463570d1ce4257/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:01.144541 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b14521-65f2-4079-8c69-dfaaf452672f admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:01.164294 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b14521-65f2-4079-8c69-dfaaf452672f admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:01.322692 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653c497-8931-477b-a3ae-bddda00f709d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:01.325471 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653c497-8931-477b-a3ae-bddda00f709d admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:01.326925 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653c497-8931-477b-a3ae-bddda00f709d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:01.327311 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653c497-8931-477b-a3ae-bddda00f709d admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:01.331429 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653c497-8931-477b-a3ae-bddda00f709d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:01.336350 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653c497-8931-477b-a3ae-bddda00f709d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:01.359423 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48de17-dc43-4f72-9493-e781b964cb27 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:01.359656 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 808/1633] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:01 2021] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:13:01.377890 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48de17-dc43-4f72-9493-e781b964cb27 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:01.399970 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f26bb-84b2-441d-96a6-9bed6b90a4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:01.400379 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f26bb-84b2-441d-96a6-9bed6b90a4b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:01.404427 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f26bb-84b2-441d-96a6-9bed6b90a4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:01.404427 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f26bb-84b2-441d-96a6-9bed6b90a4b4 admin admin] PATH_INFO: `/v3/projects/1bcb89821a7a46349bd3456e1f58f98b/users/99f5f1d66e904e379b463570d1ce4257/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:01.406821 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f26bb-84b2-441d-96a6-9bed6b90a4b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bcb89821a7a46349bd3456e1f58f98b, user_id=99f5f1d66e904e379b463570d1ce4257, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:01.417998 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f26bb-84b2-441d-96a6-9bed6b90a4b4 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:01.447350 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 826/1634] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:13:01 2021] PUT /identity/v3/projects/1bcb89821a7a46349bd3456e1f58f98b/users/99f5f1d66e904e379b463570d1ce4257/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:01.494279 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2bb34-c5fa-42da-85f4-f127dbefd856 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:01.494577 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2bb34-c5fa-42da-85f4-f127dbefd856 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:01.494577 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2bb34-c5fa-42da-85f4-f127dbefd856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:01.537372 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-f1c2bb34-c5fa-42da-85f4-f127dbefd856 None None] MFA Rules not processed for user `99f5f1d66e904e379b463570d1ce4257`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:01.538644 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-f1c2bb34-c5fa-42da-85f4-f127dbefd856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:01.691199 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 809/1635] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:01 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 23 03:13:01.709343 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f26bb-84b2-441d-96a6-9bed6b90a4b4 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:01.711072 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-0a2f26bb-84b2-441d-96a6-9bed6b90a4b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:01.941404 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f26bb-84b2-441d-96a6-9bed6b90a4b4 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:01.941404 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2639b4f-a398-467a-9e49-871d60bb0719 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:01.941404 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2639b4f-a398-467a-9e49-871d60bb0719 service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:01.941404 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2639b4f-a398-467a-9e49-871d60bb0719 service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:01.943049 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2639b4f-a398-467a-9e49-871d60bb0719 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:01.943049 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2639b4f-a398-467a-9e49-871d60bb0719 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:01.943049 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2639b4f-a398-467a-9e49-871d60bb0719 service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:01.943049 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 827/1636] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:01 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:13:01.962562 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2bb34-c5fa-42da-85f4-f127dbefd856 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:01.964227 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-f1c2bb34-c5fa-42da-85f4-f127dbefd856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:02.101568 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2bb34-c5fa-42da-85f4-f127dbefd856 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:02.111756 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba5a73-b408-4c12-a337-86eab57436b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:02.113670 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba5a73-b408-4c12-a337-86eab57436b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:02.113974 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba5a73-b408-4c12-a337-86eab57436b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:02.114254 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba5a73-b408-4c12-a337-86eab57436b1 admin admin] PATH_INFO: `/v3/projects/2ef7451816ff4a379f892f267d88d3e4` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:02.117220 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba5a73-b408-4c12-a337-86eab57436b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ef7451816ff4a379f892f267d88d3e4)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:02.119636 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba5a73-b408-4c12-a337-86eab57436b1 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:02.152650 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2639b4f-a398-467a-9e49-871d60bb0719 service cinder] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:02.164554 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2639b4f-a398-467a-9e49-871d60bb0719 service cinder] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:02.171079 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f83c09-3f9b-4685-a090-7a97ca3e1c93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:02.171079 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f83c09-3f9b-4685-a090-7a97ca3e1c93 service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:02.171353 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f83c09-3f9b-4685-a090-7a97ca3e1c93 service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:02.171701 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f83c09-3f9b-4685-a090-7a97ca3e1c93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:02.250853 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f83c09-3f9b-4685-a090-7a97ca3e1c93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:02.252516 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f83c09-3f9b-4685-a090-7a97ca3e1c93 service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:02.268570 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 828/1637] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:02 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:13:02.355034 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-ebba5a73-b408-4c12-a337-86eab57436b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ef7451816ff4a379f892f267d88d3e4', 'request_id': 'req-ebba5a73-b408-4c12-a337-86eab57436b1'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:02.480189 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-ebba5a73-b408-4c12-a337-86eab57436b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ef7451816ff4a379f892f267d88d3e4', 'request_id': 'req-ebba5a73-b408-4c12-a337-86eab57436b1'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:02.513360 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-ebba5a73-b408-4c12-a337-86eab57436b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ef7451816ff4a379f892f267d88d3e4', 'request_id': 'req-ebba5a73-b408-4c12-a337-86eab57436b1'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:02.530612 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-ebba5a73-b408-4c12-a337-86eab57436b1 admin admin] The token cache is being invalidate because project 2ef7451816ff4a379f892f267d88d3e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:13:02.530914 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-ebba5a73-b408-4c12-a337-86eab57436b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:02.531639 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-ebba5a73-b408-4c12-a337-86eab57436b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:02.533994 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 810/1638] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:13:01 2021] DELETE /identity/v3/projects/2ef7451816ff4a379f892f267d88d3e4 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:02.538527 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f83c09-3f9b-4685-a090-7a97ca3e1c93 service cinder] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:02.553012 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f83c09-3f9b-4685-a090-7a97ca3e1c93 service cinder] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:02.637862 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bcaa9-2e3b-4359-a3b9-8a5ac1df207e None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:02.644357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bcaa9-2e3b-4359-a3b9-8a5ac1df207e None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:02.644357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bcaa9-2e3b-4359-a3b9-8a5ac1df207e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:02.670873 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337726d6-882c-4924-a32f-93f7444c83be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:02.672354 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337726d6-882c-4924-a32f-93f7444c83be admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:02.672987 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337726d6-882c-4924-a32f-93f7444c83be admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:02.678995 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337726d6-882c-4924-a32f-93f7444c83be admin admin] PATH_INFO: `/v3/users/30f219ba9b7f4a8ab2619b7725b6af2b` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:02.678995 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337726d6-882c-4924-a32f-93f7444c83be admin admin] RBAC: Authorizing `identity:delete_user(user_id=30f219ba9b7f4a8ab2619b7725b6af2b)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:02.678995 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337726d6-882c-4924-a32f-93f7444c83be admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:02.731240 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-666bcaa9-2e3b-4359-a3b9-8a5ac1df207e None None] MFA Rules not processed for user `dbd9a5404ac747d4964d215c96918625`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:02.735852 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-666bcaa9-2e3b-4359-a3b9-8a5ac1df207e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:02.872353 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 811/1639] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:02 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:13:02.885418 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8927d28-7bf5-4d5f-8a14-2c7f032d64b3 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:02.885712 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8927d28-7bf5-4d5f-8a14-2c7f032d64b3 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:02.885995 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8927d28-7bf5-4d5f-8a14-2c7f032d64b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:02.928504 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-e8927d28-7bf5-4d5f-8a14-2c7f032d64b3 None None] MFA Rules not processed for user `dbd9a5404ac747d4964d215c96918625`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:02.929761 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-e8927d28-7bf5-4d5f-8a14-2c7f032d64b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:02.937415 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 812/1640] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:02 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:13:02.952047 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8927d28-7bf5-4d5f-8a14-2c7f032d64b3 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:02.952047 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-e8927d28-7bf5-4d5f-8a14-2c7f032d64b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:02.976257 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-337726d6-882c-4924-a32f-93f7444c83be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f219ba9b7f4a8ab2619b7725b6af2b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:02.980795 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-337726d6-882c-4924-a32f-93f7444c83be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f219ba9b7f4a8ab2619b7725b6af2b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:02.982601 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-337726d6-882c-4924-a32f-93f7444c83be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f219ba9b7f4a8ab2619b7725b6af2b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:02.998592 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-337726d6-882c-4924-a32f-93f7444c83be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f219ba9b7f4a8ab2619b7725b6af2b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:03.098884 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8927d28-7bf5-4d5f-8a14-2c7f032d64b3 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:03.101864 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-337726d6-882c-4924-a32f-93f7444c83be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f219ba9b7f4a8ab2619b7725b6af2b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:03.136795 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d7e8e-c037-4834-b2f0-70e21c16dd13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:03.141341 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d7e8e-c037-4834-b2f0-70e21c16dd13 service nova] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:03.141341 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d7e8e-c037-4834-b2f0-70e21c16dd13 service nova] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:03.141341 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d7e8e-c037-4834-b2f0-70e21c16dd13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:03.141937 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 829/1641] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:13:02 2021] DELETE /identity/v3/users/30f219ba9b7f4a8ab2619b7725b6af2b => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:03.142149 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-790d7e8e-c037-4834-b2f0-70e21c16dd13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:03.153099 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d7e8e-c037-4834-b2f0-70e21c16dd13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:03.155497 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d7e8e-c037-4834-b2f0-70e21c16dd13 service nova] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:03.167622 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 813/1642] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:02 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:13:03.686050 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337726d6-882c-4924-a32f-93f7444c83be admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:03.687584 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-337726d6-882c-4924-a32f-93f7444c83be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:03.782807 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337726d6-882c-4924-a32f-93f7444c83be admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:03.789264 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0669c14-99c7-47f0-90ad-9868eb2d2c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:03.790350 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0669c14-99c7-47f0-90ad-9868eb2d2c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:03.791325 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0669c14-99c7-47f0-90ad-9868eb2d2c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:03.791900 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0669c14-99c7-47f0-90ad-9868eb2d2c86 admin admin] PATH_INFO: `/v3/projects/ebf1152f30df45409e750acf945eddc2` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:03.793443 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0669c14-99c7-47f0-90ad-9868eb2d2c86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebf1152f30df45409e750acf945eddc2)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:03.796073 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0669c14-99c7-47f0-90ad-9868eb2d2c86 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:03.901543 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-a0669c14-99c7-47f0-90ad-9868eb2d2c86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebf1152f30df45409e750acf945eddc2', 'request_id': 'req-a0669c14-99c7-47f0-90ad-9868eb2d2c86'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:03.972955 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191479a-464c-45a4-bc3f-fef0f1d7f3f1 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:03.973250 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191479a-464c-45a4-bc3f-fef0f1d7f3f1 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:03.973535 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191479a-464c-45a4-bc3f-fef0f1d7f3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:03.981837 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-a0669c14-99c7-47f0-90ad-9868eb2d2c86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebf1152f30df45409e750acf945eddc2', 'request_id': 'req-a0669c14-99c7-47f0-90ad-9868eb2d2c86'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:03.999241 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-a0669c14-99c7-47f0-90ad-9868eb2d2c86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebf1152f30df45409e750acf945eddc2', 'request_id': 'req-a0669c14-99c7-47f0-90ad-9868eb2d2c86'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:04.021902 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-a0669c14-99c7-47f0-90ad-9868eb2d2c86 admin admin] The token cache is being invalidate because project ebf1152f30df45409e750acf945eddc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:13:04.022372 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-a0669c14-99c7-47f0-90ad-9868eb2d2c86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:04.023793 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-a0669c14-99c7-47f0-90ad-9868eb2d2c86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:04.026660 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 830/1643] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:13:03 2021] DELETE /identity/v3/projects/ebf1152f30df45409e750acf945eddc2 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:04.031711 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-6191479a-464c-45a4-bc3f-fef0f1d7f3f1 None None] MFA Rules not processed for user `bea2a7d9c3724d8b947a0a6363d2f5bd`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:04.031711 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-6191479a-464c-45a4-bc3f-fef0f1d7f3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:04.036047 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe9833-8915-4d31-b200-6286513373eb None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:04.036416 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe9833-8915-4d31-b200-6286513373eb None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:04.036730 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe9833-8915-4d31-b200-6286513373eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:04.055211 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-5bbe9833-8915-4d31-b200-6286513373eb None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:04.060556 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-5bbe9833-8915-4d31-b200-6286513373eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:04.095896 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 814/1644] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:03 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:04.108384 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191479a-464c-45a4-bc3f-fef0f1d7f3f1 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:04.109764 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-6191479a-464c-45a4-bc3f-fef0f1d7f3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:04.123499 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 831/1645] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:13:04.125217 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4c239-b60a-4174-b95f-d26a1f5b3c22 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:04.125705 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4c239-b60a-4174-b95f-d26a1f5b3c22 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:04.125985 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4c239-b60a-4174-b95f-d26a1f5b3c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:04.151314 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-bce4c239-b60a-4174-b95f-d26a1f5b3c22 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:04.152672 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-bce4c239-b60a-4174-b95f-d26a1f5b3c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:04.191934 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 832/1646] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:04.198186 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4c239-b60a-4174-b95f-d26a1f5b3c22 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:04.213973 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4c239-b60a-4174-b95f-d26a1f5b3c22 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:04.218172 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191479a-464c-45a4-bc3f-fef0f1d7f3f1 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:04.226006 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb21bd4-96b5-4a9b-ae05-9ebd4d507d08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:04.226679 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb21bd4-96b5-4a9b-ae05-9ebd4d507d08 service nova] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:04.227140 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb21bd4-96b5-4a9b-ae05-9ebd4d507d08 service nova] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:04.227521 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb21bd4-96b5-4a9b-ae05-9ebd4d507d08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:04.229056 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf720b-9561-47b6-a7f5-0120a65ce0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:04.229861 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf720b-9561-47b6-a7f5-0120a65ce0bb admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:04.230144 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf720b-9561-47b6-a7f5-0120a65ce0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:04.230475 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf720b-9561-47b6-a7f5-0120a65ce0bb admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:04.231209 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf720b-9561-47b6-a7f5-0120a65ce0bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:13:04.231517 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf720b-9561-47b6-a7f5-0120a65ce0bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:04.233308 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf720b-9561-47b6-a7f5-0120a65ce0bb admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:04.238641 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb21bd4-96b5-4a9b-ae05-9ebd4d507d08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:04.240448 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb21bd4-96b5-4a9b-ae05-9ebd4d507d08 service nova] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:04.249492 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 833/1647] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:13:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 03:13:04.254067 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf720b-9561-47b6-a7f5-0120a65ce0bb admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:04.271207 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf720b-9561-47b6-a7f5-0120a65ce0bb admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:04.276753 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de6d96-cbf0-4009-919f-2c94b68e523a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:04.277434 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de6d96-cbf0-4009-919f-2c94b68e523a admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:04.277720 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de6d96-cbf0-4009-919f-2c94b68e523a admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:04.278000 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de6d96-cbf0-4009-919f-2c94b68e523a admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:04.278732 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de6d96-cbf0-4009-919f-2c94b68e523a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:04.280880 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de6d96-cbf0-4009-919f-2c94b68e523a admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:04.281112 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 815/1648] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:04 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:13:04.380214 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 834/1649] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:13:04 2021] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:13:04.385438 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb21bd4-96b5-4a9b-ae05-9ebd4d507d08 service nova] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:04.402073 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb21bd4-96b5-4a9b-ae05-9ebd4d507d08 service nova] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:04.482244 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e5141-4fe2-470d-9c67-353fcb258d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:04.483209 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e5141-4fe2-470d-9c67-353fcb258d4c admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:04.483610 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e5141-4fe2-470d-9c67-353fcb258d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:04.484000 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e5141-4fe2-470d-9c67-353fcb258d4c admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:04.484832 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e5141-4fe2-470d-9c67-353fcb258d4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:04.487581 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e5141-4fe2-470d-9c67-353fcb258d4c admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:04.569673 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d2ccc-683a-4a54-9854-6efcfdd13e3a None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:04.569969 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d2ccc-683a-4a54-9854-6efcfdd13e3a None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:04.570345 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d2ccc-683a-4a54-9854-6efcfdd13e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:04.584933 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 816/1650] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:13:04 2021] POST /identity/v3/users => generated 283 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:13:04.589218 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e5141-4fe2-470d-9c67-353fcb258d4c admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:04.591687 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-424d2ccc-683a-4a54-9854-6efcfdd13e3a None None] MFA Rules not processed for user `dbd9a5404ac747d4964d215c96918625`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:04.592979 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-424d2ccc-683a-4a54-9854-6efcfdd13e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:04.615426 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e5141-4fe2-470d-9c67-353fcb258d4c admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:04.620598 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3247f-72f2-449b-b6a9-ce3d1954416b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:04.622277 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3247f-72f2-449b-b6a9-ce3d1954416b admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:04.622571 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3247f-72f2-449b-b6a9-ce3d1954416b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:04.628095 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3247f-72f2-449b-b6a9-ce3d1954416b admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:04.628095 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3247f-72f2-449b-b6a9-ce3d1954416b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:04.628095 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3247f-72f2-449b-b6a9-ce3d1954416b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:04.642092 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 817/1651] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:04 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:13:04.645859 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3247f-72f2-449b-b6a9-ce3d1954416b admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:04.659931 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3247f-72f2-449b-b6a9-ce3d1954416b admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:04.666024 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948ed4f-dcbc-4f43-9b2c-324763d5bd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:04.995415 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948ed4f-dcbc-4f43-9b2c-324763d5bd2c admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:04.995415 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948ed4f-dcbc-4f43-9b2c-324763d5bd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:04.995415 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948ed4f-dcbc-4f43-9b2c-324763d5bd2c admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:04.995415 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948ed4f-dcbc-4f43-9b2c-324763d5bd2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:04.995415 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948ed4f-dcbc-4f43-9b2c-324763d5bd2c admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:04.995415 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 818/1652] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:04 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:13:04.997501 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 835/1653] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:04 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:13:04.998004 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948ed4f-dcbc-4f43-9b2c-324763d5bd2c admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:04.998004 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948ed4f-dcbc-4f43-9b2c-324763d5bd2c admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:04.998004 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c37b5-872d-42f0-8464-0b8a0c73add4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:04.998004 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c37b5-872d-42f0-8464-0b8a0c73add4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:04.998558 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c37b5-872d-42f0-8464-0b8a0c73add4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:04.998558 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c37b5-872d-42f0-8464-0b8a0c73add4 admin admin] PATH_INFO: `/v3/projects/e04c62fc26cf4c34930aae50b2dfe551/users/c565865010eb410e918a162d31fea657/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:04.998558 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c37b5-872d-42f0-8464-0b8a0c73add4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e04c62fc26cf4c34930aae50b2dfe551, user_id=c565865010eb410e918a162d31fea657, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:04.998558 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c37b5-872d-42f0-8464-0b8a0c73add4 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:05.012277 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 819/1654] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:13:04 2021] PUT /identity/v3/projects/e04c62fc26cf4c34930aae50b2dfe551/users/c565865010eb410e918a162d31fea657/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:05.075739 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f002e-07d3-4d1d-8480-d97e8d9178b5 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:05.076051 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f002e-07d3-4d1d-8480-d97e8d9178b5 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:05.076396 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f002e-07d3-4d1d-8480-d97e8d9178b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:05.118276 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-b72f002e-07d3-4d1d-8480-d97e8d9178b5 None None] MFA Rules not processed for user `c565865010eb410e918a162d31fea657`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:05.120260 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-b72f002e-07d3-4d1d-8480-d97e8d9178b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:05.203433 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 836/1655] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:05 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:05.207677 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c37b5-872d-42f0-8464-0b8a0c73add4 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:05.302018 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c37b5-872d-42f0-8464-0b8a0c73add4 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:05.309544 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7668e-2f0f-417a-8162-15b0ddf78bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:05.310760 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7668e-2f0f-417a-8162-15b0ddf78bba admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:05.311386 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7668e-2f0f-417a-8162-15b0ddf78bba admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:05.311864 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7668e-2f0f-417a-8162-15b0ddf78bba admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:05.312918 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7668e-2f0f-417a-8162-15b0ddf78bba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:05.317769 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7668e-2f0f-417a-8162-15b0ddf78bba admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:05.424028 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 820/1656] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:13:05 2021] POST /identity/v3/projects => generated 365 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:13:05.428330 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f002e-07d3-4d1d-8480-d97e8d9178b5 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:05.443703 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f002e-07d3-4d1d-8480-d97e8d9178b5 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:05.530590 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07584a97-8fda-4776-8d9b-3cecbb2e9a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:05.530590 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07584a97-8fda-4776-8d9b-3cecbb2e9a39 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:05.530590 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07584a97-8fda-4776-8d9b-3cecbb2e9a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:05.532304 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07584a97-8fda-4776-8d9b-3cecbb2e9a39 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:05.533847 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07584a97-8fda-4776-8d9b-3cecbb2e9a39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:05.536670 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07584a97-8fda-4776-8d9b-3cecbb2e9a39 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:05.686268 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 837/1657] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:13:05 2021] POST /identity/v3/users => generated 289 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:13:05.690232 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7668e-2f0f-417a-8162-15b0ddf78bba admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:05.700507 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7668e-2f0f-417a-8162-15b0ddf78bba admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:05.705561 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de59ea-6ad0-470f-9f2c-d5f8e11238e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:05.706207 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de59ea-6ad0-470f-9f2c-d5f8e11238e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:05.706602 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de59ea-6ad0-470f-9f2c-d5f8e11238e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:05.707076 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de59ea-6ad0-470f-9f2c-d5f8e11238e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:05.707814 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de59ea-6ad0-470f-9f2c-d5f8e11238e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:05.709440 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de59ea-6ad0-470f-9f2c-d5f8e11238e9 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:05.720768 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 821/1658] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:05 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:13:05.725208 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07584a97-8fda-4776-8d9b-3cecbb2e9a39 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:05.736227 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07584a97-8fda-4776-8d9b-3cecbb2e9a39 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:05.745881 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97382632-1048-481c-8fd0-727a73eff44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:05.746843 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97382632-1048-481c-8fd0-727a73eff44f admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:05.747201 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97382632-1048-481c-8fd0-727a73eff44f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:05.747550 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97382632-1048-481c-8fd0-727a73eff44f admin admin] PATH_INFO: `/v3/projects/7a0129395d8c48c5be1af0f98c865786/users/99465cf23a5445f1bc769ae7abe002f7/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:05.763674 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97382632-1048-481c-8fd0-727a73eff44f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a0129395d8c48c5be1af0f98c865786, user_id=99465cf23a5445f1bc769ae7abe002f7, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:05.766590 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97382632-1048-481c-8fd0-727a73eff44f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:05.879307 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 838/1659] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:13:05 2021] PUT /identity/v3/projects/7a0129395d8c48c5be1af0f98c865786/users/99465cf23a5445f1bc769ae7abe002f7/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:13:05.880648 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de59ea-6ad0-470f-9f2c-d5f8e11238e9 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:05.900001 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de59ea-6ad0-470f-9f2c-d5f8e11238e9 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:06.036198 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955dc76-b1fb-45c8-873d-0b843fe73be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:06.036921 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955dc76-b1fb-45c8-873d-0b843fe73be3 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:06.037208 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955dc76-b1fb-45c8-873d-0b843fe73be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:06.037488 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955dc76-b1fb-45c8-873d-0b843fe73be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:06.038263 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955dc76-b1fb-45c8-873d-0b843fe73be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:06.039853 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955dc76-b1fb-45c8-873d-0b843fe73be3 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:06.056253 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 822/1660] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:05 2021] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:13:06.060346 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97382632-1048-481c-8fd0-727a73eff44f admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:06.076892 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97382632-1048-481c-8fd0-727a73eff44f admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:06.083017 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b202828-205f-4afd-9e75-d439d7abe6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:06.084123 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b202828-205f-4afd-9e75-d439d7abe6a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:06.084413 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b202828-205f-4afd-9e75-d439d7abe6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:06.084718 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b202828-205f-4afd-9e75-d439d7abe6a7 admin admin] PATH_INFO: `/v3/projects/7a0129395d8c48c5be1af0f98c865786/users/99465cf23a5445f1bc769ae7abe002f7/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:06.092339 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b202828-205f-4afd-9e75-d439d7abe6a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a0129395d8c48c5be1af0f98c865786, user_id=99465cf23a5445f1bc769ae7abe002f7, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:06.101990 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b202828-205f-4afd-9e75-d439d7abe6a7 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:06.127810 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 839/1661] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:13:06 2021] PUT /identity/v3/projects/7a0129395d8c48c5be1af0f98c865786/users/99465cf23a5445f1bc769ae7abe002f7/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:06.139076 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0629c5-a0ec-4886-8bcf-0d1c80045de0 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:06.139566 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0629c5-a0ec-4886-8bcf-0d1c80045de0 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:06.139989 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0629c5-a0ec-4886-8bcf-0d1c80045de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:06.224393 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-5d0629c5-a0ec-4886-8bcf-0d1c80045de0 None None] MFA Rules not processed for user `99465cf23a5445f1bc769ae7abe002f7`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:06.225838 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-5d0629c5-a0ec-4886-8bcf-0d1c80045de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:06.305746 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 823/1662] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:06 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:13:06.601871 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b202828-205f-4afd-9e75-d439d7abe6a7 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:06.604162 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-3b202828-205f-4afd-9e75-d439d7abe6a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:06.732701 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b202828-205f-4afd-9e75-d439d7abe6a7 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:06.737443 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92beef9f-e1a0-4059-8334-292dae7574f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:06.738489 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92beef9f-e1a0-4059-8334-292dae7574f2 service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:06.738915 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92beef9f-e1a0-4059-8334-292dae7574f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:06.739375 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92beef9f-e1a0-4059-8334-292dae7574f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:06.751492 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92beef9f-e1a0-4059-8334-292dae7574f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:06.753810 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92beef9f-e1a0-4059-8334-292dae7574f2 service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:06.795940 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 840/1663] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:06 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:13:07.168917 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0629c5-a0ec-4886-8bcf-0d1c80045de0 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:07.168917 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-5d0629c5-a0ec-4886-8bcf-0d1c80045de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:07.182439 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0629c5-a0ec-4886-8bcf-0d1c80045de0 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:07.187905 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c4bc9-b620-4447-86e2-088f4f8f190c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:07.189058 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c4bc9-b620-4447-86e2-088f4f8f190c service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:07.189512 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c4bc9-b620-4447-86e2-088f4f8f190c service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:07.190708 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c4bc9-b620-4447-86e2-088f4f8f190c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:07.316214 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c4bc9-b620-4447-86e2-088f4f8f190c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:07.319100 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c4bc9-b620-4447-86e2-088f4f8f190c service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:07.335548 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 824/1664] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:07 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:13:08.679322 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13613cbb-9791-4399-8eb5-d2fa88335cd4 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:08.679875 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13613cbb-9791-4399-8eb5-d2fa88335cd4 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:08.679969 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13613cbb-9791-4399-8eb5-d2fa88335cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:08.697496 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-13613cbb-9791-4399-8eb5-d2fa88335cd4 None None] MFA Rules not processed for user `bea2a7d9c3724d8b947a0a6363d2f5bd`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:08.698704 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-13613cbb-9791-4399-8eb5-d2fa88335cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:08.758098 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 841/1665] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:08 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:11.153298 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c4bc9-b620-4447-86e2-088f4f8f190c service cinder] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:11.154780 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-cc8c4bc9-b620-4447-86e2-088f4f8f190c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:11.218599 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c4bc9-b620-4447-86e2-088f4f8f190c service cinder] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:11.223073 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90581cbc-de67-431e-91a6-1ef9404d1210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:11.223946 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90581cbc-de67-431e-91a6-1ef9404d1210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:11.224225 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90581cbc-de67-431e-91a6-1ef9404d1210 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:11.224516 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90581cbc-de67-431e-91a6-1ef9404d1210 admin admin] PATH_INFO: `/v3/users/e379f4b23db245ac960035f748abc5ee` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:11.225715 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90581cbc-de67-431e-91a6-1ef9404d1210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e379f4b23db245ac960035f748abc5ee)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:11.228289 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90581cbc-de67-431e-91a6-1ef9404d1210 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:11.489096 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-90581cbc-de67-431e-91a6-1ef9404d1210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e379f4b23db245ac960035f748abc5ee'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:11.490554 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-90581cbc-de67-431e-91a6-1ef9404d1210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e379f4b23db245ac960035f748abc5ee'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:11.522360 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-90581cbc-de67-431e-91a6-1ef9404d1210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e379f4b23db245ac960035f748abc5ee'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:11.622826 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-90581cbc-de67-431e-91a6-1ef9404d1210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e379f4b23db245ac960035f748abc5ee'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:11.636758 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-90581cbc-de67-431e-91a6-1ef9404d1210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e379f4b23db245ac960035f748abc5ee'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:11.645422 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 825/1666] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:13:11 2021] DELETE /identity/v3/users/e379f4b23db245ac960035f748abc5ee => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:13:11.647849 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fb11a-b23a-428a-a5e2-575bf906b88f None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:11.648281 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fb11a-b23a-428a-a5e2-575bf906b88f None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:11.648479 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fb11a-b23a-428a-a5e2-575bf906b88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:11.673938 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-0d2fb11a-b23a-428a-a5e2-575bf906b88f None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:11.675218 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-0d2fb11a-b23a-428a-a5e2-575bf906b88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:11.745727 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 842/1667] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:11.760734 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90581cbc-de67-431e-91a6-1ef9404d1210 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:11.761256 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-90581cbc-de67-431e-91a6-1ef9404d1210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:11.820597 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90581cbc-de67-431e-91a6-1ef9404d1210 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:11.825292 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8a0c6-e32e-45fe-8a97-35ac0fc85695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:11.825964 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8a0c6-e32e-45fe-8a97-35ac0fc85695 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:11.826251 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8a0c6-e32e-45fe-8a97-35ac0fc85695 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:11.826532 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8a0c6-e32e-45fe-8a97-35ac0fc85695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:11.836618 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8a0c6-e32e-45fe-8a97-35ac0fc85695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:11.838851 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8a0c6-e32e-45fe-8a97-35ac0fc85695 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:11.850212 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 826/1668] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:13:12.451613 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2932c67-0e3d-4a48-95ce-d3ea23fefcf4 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:12.454434 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2932c67-0e3d-4a48-95ce-d3ea23fefcf4 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:12.454883 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2932c67-0e3d-4a48-95ce-d3ea23fefcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:12.489148 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-b2932c67-0e3d-4a48-95ce-d3ea23fefcf4 None None] MFA Rules not processed for user `96c9b76133d74b79a0d2da9a884651e1`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:12.492034 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-b2932c67-0e3d-4a48-95ce-d3ea23fefcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:12.570851 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8a0c6-e32e-45fe-8a97-35ac0fc85695 service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:12.574185 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-0fd8a0c6-e32e-45fe-8a97-35ac0fc85695 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:12.605166 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8a0c6-e32e-45fe-8a97-35ac0fc85695 service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:12.643054 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 843/1669] 10.222.0.23 () {58 vars in 1010 bytes} [Thu Sep 23 03:13:12 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:12.651811 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316daf8-f640-4bb1-b246-8bdb4b02d9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:12.660531 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316daf8-f640-4bb1-b246-8bdb4b02d9f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:12.660835 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316daf8-f640-4bb1-b246-8bdb4b02d9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:12.661122 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316daf8-f640-4bb1-b246-8bdb4b02d9f0 admin admin] PATH_INFO: `/v3/projects/b786c92c7d7049dca294ad6cbb4fdcc0` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:12.676746 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316daf8-f640-4bb1-b246-8bdb4b02d9f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b786c92c7d7049dca294ad6cbb4fdcc0)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:12.676746 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316daf8-f640-4bb1-b246-8bdb4b02d9f0 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:12.834606 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-a316daf8-f640-4bb1-b246-8bdb4b02d9f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b786c92c7d7049dca294ad6cbb4fdcc0', 'request_id': 'req-a316daf8-f640-4bb1-b246-8bdb4b02d9f0'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:12.914613 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-a316daf8-f640-4bb1-b246-8bdb4b02d9f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b786c92c7d7049dca294ad6cbb4fdcc0', 'request_id': 'req-a316daf8-f640-4bb1-b246-8bdb4b02d9f0'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:12.921793 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-a316daf8-f640-4bb1-b246-8bdb4b02d9f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b786c92c7d7049dca294ad6cbb4fdcc0', 'request_id': 'req-a316daf8-f640-4bb1-b246-8bdb4b02d9f0'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:12.933262 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-a316daf8-f640-4bb1-b246-8bdb4b02d9f0 admin admin] The token cache is being invalidate because project b786c92c7d7049dca294ad6cbb4fdcc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:13:12.933728 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-a316daf8-f640-4bb1-b246-8bdb4b02d9f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:12.934669 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-a316daf8-f640-4bb1-b246-8bdb4b02d9f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:12.937004 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 827/1670] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:13:12 2021] DELETE /identity/v3/projects/b786c92c7d7049dca294ad6cbb4fdcc0 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:13:12.941120 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2932c67-0e3d-4a48-95ce-d3ea23fefcf4 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:12.953515 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2932c67-0e3d-4a48-95ce-d3ea23fefcf4 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:12.979093 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316daf8-f640-4bb1-b246-8bdb4b02d9f0 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:12.981025 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-a316daf8-f640-4bb1-b246-8bdb4b02d9f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:13.039169 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d898a7e-7daa-4754-bb1f-e74d44fce2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:13.040422 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d898a7e-7daa-4754-bb1f-e74d44fce2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:13.040910 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d898a7e-7daa-4754-bb1f-e74d44fce2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:13.041453 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d898a7e-7daa-4754-bb1f-e74d44fce2e5 admin admin] PATH_INFO: `/v3/users/99f5f1d66e904e379b463570d1ce4257` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:13.043178 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d898a7e-7daa-4754-bb1f-e74d44fce2e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99f5f1d66e904e379b463570d1ce4257)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:13.045504 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d898a7e-7daa-4754-bb1f-e74d44fce2e5 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:13.082091 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316daf8-f640-4bb1-b246-8bdb4b02d9f0 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:13.087823 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530c8d9-47dc-4feb-808b-4b69243315c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df051fd059b34fe0993f501546d1610f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:13.088799 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530c8d9-47dc-4feb-808b-4b69243315c3 service swift] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:13.089225 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530c8d9-47dc-4feb-808b-4b69243315c3 service swift] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:13.089664 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530c8d9-47dc-4feb-808b-4b69243315c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:13.091669 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-9530c8d9-47dc-4feb-808b-4b69243315c3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:13.193225 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9530c8d9-47dc-4feb-808b-4b69243315c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:13.194914 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9530c8d9-47dc-4feb-808b-4b69243315c3 service swift] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:13.203744 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 828/1671] 10.222.0.23 () {60 vars in 1385 bytes} [Thu Sep 23 03:13:12 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 23 03:13:13.400184 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-2d898a7e-7daa-4754-bb1f-e74d44fce2e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99f5f1d66e904e379b463570d1ce4257'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:13.401319 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-2d898a7e-7daa-4754-bb1f-e74d44fce2e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99f5f1d66e904e379b463570d1ce4257'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:13.402437 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-2d898a7e-7daa-4754-bb1f-e74d44fce2e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99f5f1d66e904e379b463570d1ce4257'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:13.412264 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-2d898a7e-7daa-4754-bb1f-e74d44fce2e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99f5f1d66e904e379b463570d1ce4257'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:13.542797 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-2d898a7e-7daa-4754-bb1f-e74d44fce2e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99f5f1d66e904e379b463570d1ce4257'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:13.563296 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 844/1672] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:13:12 2021] DELETE /identity/v3/users/99f5f1d66e904e379b463570d1ce4257 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:13.656831 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88d90a-e70e-41eb-8e7f-2c487b108953 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:13.657803 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88d90a-e70e-41eb-8e7f-2c487b108953 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:13.658779 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88d90a-e70e-41eb-8e7f-2c487b108953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:13.722343 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-ad88d90a-e70e-41eb-8e7f-2c487b108953 None None] MFA Rules not processed for user `621e97bd0914448c8afadba25510053d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:13.723850 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-ad88d90a-e70e-41eb-8e7f-2c487b108953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:13.869187 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 829/1673] 10.222.0.13 () {58 vars in 1016 bytes} [Thu Sep 23 03:13:13 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:13.898253 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d898a7e-7daa-4754-bb1f-e74d44fce2e5 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:13.900482 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-2d898a7e-7daa-4754-bb1f-e74d44fce2e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:13.933442 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88d90a-e70e-41eb-8e7f-2c487b108953 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:13.935820 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-ad88d90a-e70e-41eb-8e7f-2c487b108953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:13.952357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88d90a-e70e-41eb-8e7f-2c487b108953 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:13.961228 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed851000-6a6a-4f95-866e-92546d0b5b67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:13.962653 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed851000-6a6a-4f95-866e-92546d0b5b67 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:13.963102 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed851000-6a6a-4f95-866e-92546d0b5b67 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:13.963515 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed851000-6a6a-4f95-866e-92546d0b5b67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:13.982326 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed851000-6a6a-4f95-866e-92546d0b5b67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:13.984027 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed851000-6a6a-4f95-866e-92546d0b5b67 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:14.001229 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 830/1674] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:13 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:13:14.049825 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d898a7e-7daa-4754-bb1f-e74d44fce2e5 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:14.061788 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8a426-59cc-44d3-8042-982051f5156e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:14.063125 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8a426-59cc-44d3-8042-982051f5156e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:14.063659 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8a426-59cc-44d3-8042-982051f5156e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:14.064104 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8a426-59cc-44d3-8042-982051f5156e admin admin] PATH_INFO: `/v3/users/015a9aafb9774863b7ffdd809a06f1d9` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:14.066034 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8a426-59cc-44d3-8042-982051f5156e admin admin] RBAC: Authorizing `identity:delete_user(user_id=015a9aafb9774863b7ffdd809a06f1d9)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:14.069326 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8a426-59cc-44d3-8042-982051f5156e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:14.398480 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-3ea8a426-59cc-44d3-8042-982051f5156e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '015a9aafb9774863b7ffdd809a06f1d9'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:14.400828 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-3ea8a426-59cc-44d3-8042-982051f5156e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '015a9aafb9774863b7ffdd809a06f1d9'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:14.407365 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-3ea8a426-59cc-44d3-8042-982051f5156e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '015a9aafb9774863b7ffdd809a06f1d9'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:14.413072 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-3ea8a426-59cc-44d3-8042-982051f5156e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '015a9aafb9774863b7ffdd809a06f1d9'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:14.537585 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-3ea8a426-59cc-44d3-8042-982051f5156e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '015a9aafb9774863b7ffdd809a06f1d9'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:14.584274 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 845/1675] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:13:13 2021] DELETE /identity/v3/users/015a9aafb9774863b7ffdd809a06f1d9 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:14.589509 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d901f3-be75-4894-bfc2-ed46a09a09aa None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:14.590036 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d901f3-be75-4894-bfc2-ed46a09a09aa None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:14.590329 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d901f3-be75-4894-bfc2-ed46a09a09aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:14.653012 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-86d901f3-be75-4894-bfc2-ed46a09a09aa None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:14.655109 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-86d901f3-be75-4894-bfc2-ed46a09a09aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:14.852146 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 831/1676] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:14.882337 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8a426-59cc-44d3-8042-982051f5156e admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:14.885615 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-3ea8a426-59cc-44d3-8042-982051f5156e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:15.026247 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8a426-59cc-44d3-8042-982051f5156e admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:15.046622 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d49dce-683e-416f-ae22-db23df5cbe4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:15.047297 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d49dce-683e-416f-ae22-db23df5cbe4e service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:15.047585 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d49dce-683e-416f-ae22-db23df5cbe4e service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:15.047886 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d49dce-683e-416f-ae22-db23df5cbe4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:15.058657 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d49dce-683e-416f-ae22-db23df5cbe4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:15.062376 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d49dce-683e-416f-ae22-db23df5cbe4e service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:15.088883 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 846/1677] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:13:15.517103 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d901f3-be75-4894-bfc2-ed46a09a09aa None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:15.518498 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-86d901f3-be75-4894-bfc2-ed46a09a09aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:15.536305 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d901f3-be75-4894-bfc2-ed46a09a09aa None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:15.557873 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d398ea0-0226-4196-9f68-14fa14596264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:15.560205 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d398ea0-0226-4196-9f68-14fa14596264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:15.561250 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d398ea0-0226-4196-9f68-14fa14596264 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:15.561589 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d398ea0-0226-4196-9f68-14fa14596264 admin admin] PATH_INFO: `/v3/projects/1bcb89821a7a46349bd3456e1f58f98b` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:15.563446 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d398ea0-0226-4196-9f68-14fa14596264 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bcb89821a7a46349bd3456e1f58f98b)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:15.567781 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d398ea0-0226-4196-9f68-14fa14596264 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:15.817903 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-0d398ea0-0226-4196-9f68-14fa14596264 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bcb89821a7a46349bd3456e1f58f98b', 'request_id': 'req-0d398ea0-0226-4196-9f68-14fa14596264'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:15.938179 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-0d398ea0-0226-4196-9f68-14fa14596264 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bcb89821a7a46349bd3456e1f58f98b', 'request_id': 'req-0d398ea0-0226-4196-9f68-14fa14596264'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:15.948273 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-0d398ea0-0226-4196-9f68-14fa14596264 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bcb89821a7a46349bd3456e1f58f98b', 'request_id': 'req-0d398ea0-0226-4196-9f68-14fa14596264'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:15.965413 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-0d398ea0-0226-4196-9f68-14fa14596264 admin admin] The token cache is being invalidate because project 1bcb89821a7a46349bd3456e1f58f98b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:13:15.966667 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-0d398ea0-0226-4196-9f68-14fa14596264 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:15.968023 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-0d398ea0-0226-4196-9f68-14fa14596264 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:15.970249 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 832/1678] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:13:15 2021] DELETE /identity/v3/projects/1bcb89821a7a46349bd3456e1f58f98b => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:15.980277 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bbcb9-4a9d-43ea-8f1f-6403f33a38dd None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:15.981080 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bbcb9-4a9d-43ea-8f1f-6403f33a38dd None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:15.981589 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bbcb9-4a9d-43ea-8f1f-6403f33a38dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:16.012206 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-997bbcb9-4a9d-43ea-8f1f-6403f33a38dd None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:16.012206 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-997bbcb9-4a9d-43ea-8f1f-6403f33a38dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:16.194510 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 847/1679] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:16.210269 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a061c-565d-458c-a43e-68fb99a016c0 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:16.210490 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a061c-565d-458c-a43e-68fb99a016c0 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:16.210975 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a061c-565d-458c-a43e-68fb99a016c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:16.258132 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-9a4a061c-565d-458c-a43e-68fb99a016c0 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:16.260794 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-9a4a061c-565d-458c-a43e-68fb99a016c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:16.292598 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 833/1680] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:16.305324 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bbcb9-4a9d-43ea-8f1f-6403f33a38dd None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:16.344119 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bbcb9-4a9d-43ea-8f1f-6403f33a38dd None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:16.380868 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc66c96-4aea-4f41-be93-dc538cb96d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:16.384447 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc66c96-4aea-4f41-be93-dc538cb96d14 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:16.384746 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc66c96-4aea-4f41-be93-dc538cb96d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:16.385027 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc66c96-4aea-4f41-be93-dc538cb96d14 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:16.385780 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc66c96-4aea-4f41-be93-dc538cb96d14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:13:16.388192 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc66c96-4aea-4f41-be93-dc538cb96d14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:16.393152 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc66c96-4aea-4f41-be93-dc538cb96d14 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:16.439904 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 848/1681] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:13:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:13:16.440474 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a061c-565d-458c-a43e-68fb99a016c0 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:16.455463 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a061c-565d-458c-a43e-68fb99a016c0 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:16.471485 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc66c96-4aea-4f41-be93-dc538cb96d14 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:16.474858 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c569264-fa4e-43a5-818c-c3bfaaa06c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:16.475553 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c569264-fa4e-43a5-818c-c3bfaaa06c70 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:16.475843 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c569264-fa4e-43a5-818c-c3bfaaa06c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:16.476253 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c569264-fa4e-43a5-818c-c3bfaaa06c70 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:16.476859 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c569264-fa4e-43a5-818c-c3bfaaa06c70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:16.497936 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c569264-fa4e-43a5-818c-c3bfaaa06c70 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:16.499108 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-9cc66c96-4aea-4f41-be93-dc538cb96d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:16.563799 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc66c96-4aea-4f41-be93-dc538cb96d14 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:16.581823 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e404e-49b5-410e-8546-68363445f373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:16.583285 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e404e-49b5-410e-8546-68363445f373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:16.583648 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e404e-49b5-410e-8546-68363445f373 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:16.585861 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e404e-49b5-410e-8546-68363445f373 admin admin] PATH_INFO: `/v3/projects/d84ced7fa8d04191af5ae1d758fccbb7` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:16.587682 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e404e-49b5-410e-8546-68363445f373 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d84ced7fa8d04191af5ae1d758fccbb7)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:16.590638 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e404e-49b5-410e-8546-68363445f373 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:17.059120 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 834/1682] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:13:16 2021] POST /identity/v3/projects => generated 377 bytes in 619 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:13:17.060509 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ae559-9e7c-4903-8fb2-07293d7e9d10 None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:17.060823 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ae559-9e7c-4903-8fb2-07293d7e9d10 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:17.061103 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ae559-9e7c-4903-8fb2-07293d7e9d10 None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:17.062752 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 835/1683] 10.222.0.23 () {54 vars in 921 bytes} [Thu Sep 23 03:13:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:13:17.063836 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70d659-20ac-4c5f-92d2-da7efdfe037d None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:17.064125 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70d659-20ac-4c5f-92d2-da7efdfe037d None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:17.064401 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70d659-20ac-4c5f-92d2-da7efdfe037d None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:17.066003 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 836/1684] 10.222.0.23 () {54 vars in 921 bytes} [Thu Sep 23 03:13:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:13:17.066681 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70d659-20ac-4c5f-92d2-da7efdfe037d None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:17.140210 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-070e404e-49b5-410e-8546-68363445f373 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd84ced7fa8d04191af5ae1d758fccbb7', 'request_id': 'req-070e404e-49b5-410e-8546-68363445f373'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:17.163641 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70d659-20ac-4c5f-92d2-da7efdfe037d None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:17.234952 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a1773-8d59-4b91-8c18-31a9fafbcb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:17.236215 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a1773-8d59-4b91-8c18-31a9fafbcb87 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:17.236664 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a1773-8d59-4b91-8c18-31a9fafbcb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:17.237079 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a1773-8d59-4b91-8c18-31a9fafbcb87 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:17.237899 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a1773-8d59-4b91-8c18-31a9fafbcb87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:17.240928 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a1773-8d59-4b91-8c18-31a9fafbcb87 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:17.292477 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-070e404e-49b5-410e-8546-68363445f373 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd84ced7fa8d04191af5ae1d758fccbb7', 'request_id': 'req-070e404e-49b5-410e-8546-68363445f373'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:17.300776 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-070e404e-49b5-410e-8546-68363445f373 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd84ced7fa8d04191af5ae1d758fccbb7', 'request_id': 'req-070e404e-49b5-410e-8546-68363445f373'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:17.351079 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-070e404e-49b5-410e-8546-68363445f373 admin admin] The token cache is being invalidate because project d84ced7fa8d04191af5ae1d758fccbb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:13:17.351383 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-070e404e-49b5-410e-8546-68363445f373 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:17.354877 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-070e404e-49b5-410e-8546-68363445f373 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:17.359098 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 849/1685] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:13:16 2021] DELETE /identity/v3/projects/d84ced7fa8d04191af5ae1d758fccbb7 => generated 0 bytes in 888 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:17.361362 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e11563-a1ad-41a8-b077-2033d100a083 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:17.361845 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e11563-a1ad-41a8-b077-2033d100a083 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:17.362291 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e11563-a1ad-41a8-b077-2033d100a083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:17.376987 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 837/1686] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:13:17 2021] POST /identity/v3/users => generated 289 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:13:17.378583 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02872dc-0710-420d-a5ad-5d6ea294b452 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:17.379983 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02872dc-0710-420d-a5ad-5d6ea294b452 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:17.380172 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02872dc-0710-420d-a5ad-5d6ea294b452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:17.392730 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-71e11563-a1ad-41a8-b077-2033d100a083 None None] MFA Rules not processed for user `83aa47f723434143b22aac1b96b6a610`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:17.394211 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-71e11563-a1ad-41a8-b077-2033d100a083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:17.433331 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-b02872dc-0710-420d-a5ad-5d6ea294b452 None None] MFA Rules not processed for user `83aa47f723434143b22aac1b96b6a610`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:17.435066 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-b02872dc-0710-420d-a5ad-5d6ea294b452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:17.502561 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 850/1687] 10.222.0.23 () {58 vars in 1019 bytes} [Thu Sep 23 03:13:17 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:17.503969 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c55da-3340-405a-a69a-a917f306f039 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:17.504331 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c55da-3340-405a-a69a-a917f306f039 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:17.504725 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c55da-3340-405a-a69a-a917f306f039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:17.527266 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-5c4c55da-3340-405a-a69a-a917f306f039 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:17.536627 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-5c4c55da-3340-405a-a69a-a917f306f039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:17.541624 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 851/1688] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:17.541624 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c55da-3340-405a-a69a-a917f306f039 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:17.541624 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-5c4c55da-3340-405a-a69a-a917f306f039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:17.550566 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c55da-3340-405a-a69a-a917f306f039 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:17.555332 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756d88d-e855-4cc7-af00-62f5fc8c514b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:17.556544 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756d88d-e855-4cc7-af00-62f5fc8c514b admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:17.556882 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756d88d-e855-4cc7-af00-62f5fc8c514b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:17.557159 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756d88d-e855-4cc7-af00-62f5fc8c514b admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:17.557883 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756d88d-e855-4cc7-af00-62f5fc8c514b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:17.559517 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756d88d-e855-4cc7-af00-62f5fc8c514b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:17.572607 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 852/1689] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:17 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:13:17.573535 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756d88d-e855-4cc7-af00-62f5fc8c514b admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:17.579652 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-2756d88d-e855-4cc7-af00-62f5fc8c514b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:17.579948 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 838/1690] 10.222.0.23 () {58 vars in 1019 bytes} [Thu Sep 23 03:13:17 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:17.579948 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6dc06-cc0b-4300-add8-f4fa9e4ce7b2 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:17.579948 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6dc06-cc0b-4300-add8-f4fa9e4ce7b2 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:17.579948 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6dc06-cc0b-4300-add8-f4fa9e4ce7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:17.598640 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756d88d-e855-4cc7-af00-62f5fc8c514b admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:17.605950 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8848cc-78dd-492d-a409-180e8f9a6dc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:17.606372 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8848cc-78dd-492d-a409-180e8f9a6dc4 service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:17.606665 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8848cc-78dd-492d-a409-180e8f9a6dc4 service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:17.606967 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8848cc-78dd-492d-a409-180e8f9a6dc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:17.649051 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-6dc6dc06-cc0b-4300-add8-f4fa9e4ce7b2 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:17.649051 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-6dc6dc06-cc0b-4300-add8-f4fa9e4ce7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:17.649269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8848cc-78dd-492d-a409-180e8f9a6dc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:17.649269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8848cc-78dd-492d-a409-180e8f9a6dc4 service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:17.649436 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 839/1691] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:17.649436 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6dc06-cc0b-4300-add8-f4fa9e4ce7b2 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:17.649589 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 853/1692] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:17 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:13:17.649589 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8848cc-78dd-492d-a409-180e8f9a6dc4 service nova] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:17.649589 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-6e8848cc-78dd-492d-a409-180e8f9a6dc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:17.667036 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8848cc-78dd-492d-a409-180e8f9a6dc4 service nova] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:17.673750 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6dc06-cc0b-4300-add8-f4fa9e4ce7b2 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:17.679933 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c862f44-1177-4a5d-a1b2-22f6ced8526a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:17.681171 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c862f44-1177-4a5d-a1b2-22f6ced8526a service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:17.681571 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c862f44-1177-4a5d-a1b2-22f6ced8526a service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:17.681947 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c862f44-1177-4a5d-a1b2-22f6ced8526a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:17.693158 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c862f44-1177-4a5d-a1b2-22f6ced8526a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:17.694878 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c862f44-1177-4a5d-a1b2-22f6ced8526a service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:17.695800 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff53c8-0fa4-4392-8732-249815e6354e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:17.697456 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff53c8-0fa4-4392-8732-249815e6354e admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:17.697783 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff53c8-0fa4-4392-8732-249815e6354e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:17.698066 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff53c8-0fa4-4392-8732-249815e6354e admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:17.698820 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff53c8-0fa4-4392-8732-249815e6354e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:17.700513 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff53c8-0fa4-4392-8732-249815e6354e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:17.708642 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 854/1693] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:17 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:13:17.709578 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c862f44-1177-4a5d-a1b2-22f6ced8526a service nova] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:17.722113 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c862f44-1177-4a5d-a1b2-22f6ced8526a service nova] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:17.722626 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 840/1694] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:17 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:13:17.727444 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1651d-d05a-464a-9527-f5b43143c9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:17.728132 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1651d-d05a-464a-9527-f5b43143c9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:17.728417 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff53c8-0fa4-4392-8732-249815e6354e admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:17.728549 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1651d-d05a-464a-9527-f5b43143c9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:17.728779 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1651d-d05a-464a-9527-f5b43143c9c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:17.729521 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1651d-d05a-464a-9527-f5b43143c9c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:13:17.729833 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1651d-d05a-464a-9527-f5b43143c9c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:17.731608 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1651d-d05a-464a-9527-f5b43143c9c6 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:17.750706 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff53c8-0fa4-4392-8732-249815e6354e admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:17.752525 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 855/1695] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:13:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:13:17.757595 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1651d-d05a-464a-9527-f5b43143c9c6 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:17.762716 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0e306-ffa7-4379-9af7-4cbc025eb2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:17.763737 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0e306-ffa7-4379-9af7-4cbc025eb2b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:17.763930 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0e306-ffa7-4379-9af7-4cbc025eb2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:17.764205 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0e306-ffa7-4379-9af7-4cbc025eb2b8 admin admin] PATH_INFO: `/v3/projects/5727c451ed734183827cecb9d23d44a0/users/52a6bc8766af4f1e92001c04cc428493/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:17.781438 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0e306-ffa7-4379-9af7-4cbc025eb2b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5727c451ed734183827cecb9d23d44a0, user_id=52a6bc8766af4f1e92001c04cc428493, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:17.784114 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0e306-ffa7-4379-9af7-4cbc025eb2b8 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:17.785934 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1651d-d05a-464a-9527-f5b43143c9c6 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:17.792693 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d88dd-3b59-400c-9dad-407bab5e6b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:17.793373 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d88dd-3b59-400c-9dad-407bab5e6b91 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:17.793712 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d88dd-3b59-400c-9dad-407bab5e6b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:17.793995 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d88dd-3b59-400c-9dad-407bab5e6b91 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:17.794696 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d88dd-3b59-400c-9dad-407bab5e6b91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:17.796711 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d88dd-3b59-400c-9dad-407bab5e6b91 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:18.029465 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 856/1697] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:13:17 2021] POST /identity/v3/projects => generated 383 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:13:18.030379 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d88dd-3b59-400c-9dad-407bab5e6b91 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:18.037623 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 841/1697] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:13:17 2021] PUT /identity/v3/projects/5727c451ed734183827cecb9d23d44a0/users/52a6bc8766af4f1e92001c04cc428493/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:18.039313 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ba307-c453-4e33-8a08-66cb3994b6d1 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:18.039608 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ba307-c453-4e33-8a08-66cb3994b6d1 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:18.039943 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ba307-c453-4e33-8a08-66cb3994b6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:18.083623 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-675ba307-c453-4e33-8a08-66cb3994b6d1 None None] MFA Rules not processed for user `52a6bc8766af4f1e92001c04cc428493`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:18.085481 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-675ba307-c453-4e33-8a08-66cb3994b6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:18.142494 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d88dd-3b59-400c-9dad-407bab5e6b91 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:18.147446 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360a227-25ac-461e-a309-35647a32408c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:18.148152 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360a227-25ac-461e-a309-35647a32408c admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:18.148440 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360a227-25ac-461e-a309-35647a32408c admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:18.148760 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360a227-25ac-461e-a309-35647a32408c admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:18.149554 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360a227-25ac-461e-a309-35647a32408c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:18.151479 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360a227-25ac-461e-a309-35647a32408c admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:18.174193 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 842/1698] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:18 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:18.184746 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ba307-c453-4e33-8a08-66cb3994b6d1 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:18.196144 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ba307-c453-4e33-8a08-66cb3994b6d1 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:18.202321 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3885b-2bac-4364-bd5d-c92fa4a53506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:18.203011 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3885b-2bac-4364-bd5d-c92fa4a53506 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:18.203294 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3885b-2bac-4364-bd5d-c92fa4a53506 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:18.203570 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3885b-2bac-4364-bd5d-c92fa4a53506 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:18.204262 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3885b-2bac-4364-bd5d-c92fa4a53506 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:18.206281 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3885b-2bac-4364-bd5d-c92fa4a53506 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:18.333175 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 857/1699] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:13:18 2021] POST /identity/v3/users => generated 292 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:13:18.438091 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 843/1700] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:13:18 2021] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:13:18.444027 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3885b-2bac-4364-bd5d-c92fa4a53506 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:18.444631 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360a227-25ac-461e-a309-35647a32408c admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:18.476407 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360a227-25ac-461e-a309-35647a32408c admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:18.542758 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3885b-2bac-4364-bd5d-c92fa4a53506 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:18.552910 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77163d4-80b6-4555-beb7-47a72628d560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:18.554710 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77163d4-80b6-4555-beb7-47a72628d560 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:18.556321 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77163d4-80b6-4555-beb7-47a72628d560 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:18.556637 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77163d4-80b6-4555-beb7-47a72628d560 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:18.558422 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77163d4-80b6-4555-beb7-47a72628d560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:18.560980 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77163d4-80b6-4555-beb7-47a72628d560 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:18.578147 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f90442-7012-4993-b0a6-c427aaa88ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:18.579031 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f90442-7012-4993-b0a6-c427aaa88ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:18.579330 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f90442-7012-4993-b0a6-c427aaa88ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:18.579608 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f90442-7012-4993-b0a6-c427aaa88ba3 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:18.580770 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f90442-7012-4993-b0a6-c427aaa88ba3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:18.584059 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f90442-7012-4993-b0a6-c427aaa88ba3 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:18.586470 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 844/1701] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:18 2021] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:13:18.590040 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77163d4-80b6-4555-beb7-47a72628d560 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:18.611584 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77163d4-80b6-4555-beb7-47a72628d560 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:18.624586 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e33b17-99a4-4835-836a-da83ac7fb2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:18.625531 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e33b17-99a4-4835-836a-da83ac7fb2ce admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:18.625885 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e33b17-99a4-4835-836a-da83ac7fb2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:18.626237 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e33b17-99a4-4835-836a-da83ac7fb2ce admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:18.627055 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e33b17-99a4-4835-836a-da83ac7fb2ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:18.628780 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e33b17-99a4-4835-836a-da83ac7fb2ce admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:18.640527 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 845/1702] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:18 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:13:18.644106 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e33b17-99a4-4835-836a-da83ac7fb2ce admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:18.655549 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e33b17-99a4-4835-836a-da83ac7fb2ce admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:18.661732 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b53e8-e9a5-417c-95df-c6803a3ccfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:18.661732 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b53e8-e9a5-417c-95df-c6803a3ccfdb admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:18.661732 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b53e8-e9a5-417c-95df-c6803a3ccfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:18.662061 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b53e8-e9a5-417c-95df-c6803a3ccfdb admin admin] PATH_INFO: `/v3/projects/3734708297474eb3bc9f1ac6d1f4910e/users/4d8192a0ffe3410d917c9fa9fee8118b/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:18.677791 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b53e8-e9a5-417c-95df-c6803a3ccfdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3734708297474eb3bc9f1ac6d1f4910e, user_id=4d8192a0ffe3410d917c9fa9fee8118b, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:18.681326 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b53e8-e9a5-417c-95df-c6803a3ccfdb admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:18.886180 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 858/1703] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:13:18 2021] POST /identity/v3/users => generated 295 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:13:18.886180 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f90442-7012-4993-b0a6-c427aaa88ba3 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:18.907272 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f90442-7012-4993-b0a6-c427aaa88ba3 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:18.920039 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 846/1704] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:13:18 2021] PUT /identity/v3/projects/3734708297474eb3bc9f1ac6d1f4910e/users/4d8192a0ffe3410d917c9fa9fee8118b/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:18.930535 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bac1c-15e2-48a5-a349-403c4906251e None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:18.930989 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bac1c-15e2-48a5-a349-403c4906251e None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:18.931350 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bac1c-15e2-48a5-a349-403c4906251e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:19.000291 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-293bac1c-15e2-48a5-a349-403c4906251e None None] MFA Rules not processed for user `4d8192a0ffe3410d917c9fa9fee8118b`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:19.000291 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-293bac1c-15e2-48a5-a349-403c4906251e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:19.001295 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a62834-f102-4640-80b5-507c7a528a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:19.001295 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a62834-f102-4640-80b5-507c7a528a9b admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:19.001295 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a62834-f102-4640-80b5-507c7a528a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:19.001295 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a62834-f102-4640-80b5-507c7a528a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:19.001706 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a62834-f102-4640-80b5-507c7a528a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:19.001706 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a62834-f102-4640-80b5-507c7a528a9b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:19.004703 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 859/1705] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:18 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:13:19.014446 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a62834-f102-4640-80b5-507c7a528a9b admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:19.025719 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a62834-f102-4640-80b5-507c7a528a9b admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:19.031251 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ba20e-2139-4ea0-a3e3-6abe2d099f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:19.032267 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ba20e-2139-4ea0-a3e3-6abe2d099f87 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:19.032649 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ba20e-2139-4ea0-a3e3-6abe2d099f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:19.033000 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ba20e-2139-4ea0-a3e3-6abe2d099f87 admin admin] PATH_INFO: `/v3/projects/f0aa56c0a9014c89b76b6c17d38fe0f2/users/749f54457bf34215897afb4059aff204/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:19.051272 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ba20e-2139-4ea0-a3e3-6abe2d099f87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0aa56c0a9014c89b76b6c17d38fe0f2, user_id=749f54457bf34215897afb4059aff204, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:19.053981 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ba20e-2139-4ea0-a3e3-6abe2d099f87 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:19.056447 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 847/1706] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:18 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:13:19.063570 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293bac1c-15e2-48a5-a349-403c4906251e None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:19.081250 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293bac1c-15e2-48a5-a349-403c4906251e None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:19.086457 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be993350-c1b6-45ad-88e7-e586c525f875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:19.087811 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be993350-c1b6-45ad-88e7-e586c525f875 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:19.088218 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be993350-c1b6-45ad-88e7-e586c525f875 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:19.088637 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be993350-c1b6-45ad-88e7-e586c525f875 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:19.089513 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be993350-c1b6-45ad-88e7-e586c525f875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:19.091729 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be993350-c1b6-45ad-88e7-e586c525f875 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:19.171814 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 860/1707] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:13:19 2021] PUT /identity/v3/projects/f0aa56c0a9014c89b76b6c17d38fe0f2/users/749f54457bf34215897afb4059aff204/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:19.177047 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ba20e-2139-4ea0-a3e3-6abe2d099f87 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:19.204641 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 848/1708] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:13:19 2021] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:13:19.214920 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be993350-c1b6-45ad-88e7-e586c525f875 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:19.261763 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ba20e-2139-4ea0-a3e3-6abe2d099f87 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:19.285249 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be993350-c1b6-45ad-88e7-e586c525f875 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:19.291273 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb6eab-27ca-4518-92ad-79baa109296c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:19.291985 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb6eab-27ca-4518-92ad-79baa109296c admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:19.292268 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb6eab-27ca-4518-92ad-79baa109296c admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:19.292582 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb6eab-27ca-4518-92ad-79baa109296c admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:19.293279 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb6eab-27ca-4518-92ad-79baa109296c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:19.295193 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb6eab-27ca-4518-92ad-79baa109296c admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:19.326042 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971d042-c6cc-4333-98f3-72bf135c7c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:19.327026 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971d042-c6cc-4333-98f3-72bf135c7c59 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:19.327418 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971d042-c6cc-4333-98f3-72bf135c7c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:19.327788 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971d042-c6cc-4333-98f3-72bf135c7c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:19.328834 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971d042-c6cc-4333-98f3-72bf135c7c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:19.330728 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971d042-c6cc-4333-98f3-72bf135c7c59 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:19.342563 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 861/1709] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:19 2021] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:13:19.346040 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971d042-c6cc-4333-98f3-72bf135c7c59 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:19.357061 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971d042-c6cc-4333-98f3-72bf135c7c59 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:19.363282 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa5526-ef50-4633-b65d-d79f3df6a371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:19.364180 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa5526-ef50-4633-b65d-d79f3df6a371 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:19.364813 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa5526-ef50-4633-b65d-d79f3df6a371 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:19.365160 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa5526-ef50-4633-b65d-d79f3df6a371 admin admin] PATH_INFO: `/v3/projects/f0aa56c0a9014c89b76b6c17d38fe0f2/users/749f54457bf34215897afb4059aff204/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:19.367080 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa5526-ef50-4633-b65d-d79f3df6a371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0aa56c0a9014c89b76b6c17d38fe0f2, user_id=749f54457bf34215897afb4059aff204, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:19.370707 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa5526-ef50-4633-b65d-d79f3df6a371 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:19.381473 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 862/1710] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:13:19 2021] PUT /identity/v3/projects/f0aa56c0a9014c89b76b6c17d38fe0f2/users/749f54457bf34215897afb4059aff204/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:13:19.391172 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2675439-8cd5-4eb1-8624-2af328e32ff8 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:19.391459 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2675439-8cd5-4eb1-8624-2af328e32ff8 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:19.391731 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2675439-8cd5-4eb1-8624-2af328e32ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:19.417531 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-f2675439-8cd5-4eb1-8624-2af328e32ff8 None None] MFA Rules not processed for user `749f54457bf34215897afb4059aff204`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:19.418722 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-f2675439-8cd5-4eb1-8624-2af328e32ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:19.438709 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 849/1711] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:13:19 2021] POST /identity/v3/users => generated 298 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:13:19.442229 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb6eab-27ca-4518-92ad-79baa109296c admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:19.454071 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb6eab-27ca-4518-92ad-79baa109296c admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:19.522003 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 863/1712] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:19 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:13:19.529679 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c8a27-54c0-450a-8edb-19b4a6bde201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:19.530381 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c8a27-54c0-450a-8edb-19b4a6bde201 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:19.530666 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c8a27-54c0-450a-8edb-19b4a6bde201 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:19.530945 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c8a27-54c0-450a-8edb-19b4a6bde201 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:19.531773 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c8a27-54c0-450a-8edb-19b4a6bde201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:19.532299 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2675439-8cd5-4eb1-8624-2af328e32ff8 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:19.533423 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c8a27-54c0-450a-8edb-19b4a6bde201 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:19.533757 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-f2675439-8cd5-4eb1-8624-2af328e32ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:19.546007 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 850/1713] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:19 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:13:19.550321 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c8a27-54c0-450a-8edb-19b4a6bde201 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:19.562109 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c8a27-54c0-450a-8edb-19b4a6bde201 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:19.568064 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89da323-3c9d-4459-a8fc-d0e0a4a4fb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:19.569083 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89da323-3c9d-4459-a8fc-d0e0a4a4fb89 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:19.569371 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89da323-3c9d-4459-a8fc-d0e0a4a4fb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:19.569676 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89da323-3c9d-4459-a8fc-d0e0a4a4fb89 admin admin] PATH_INFO: `/v3/projects/51aafd3c0cc848cca91dfb3e7ba07b5b/users/cef7be1085894cb18d0d8c53296dbc07/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:19.607635 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89da323-3c9d-4459-a8fc-d0e0a4a4fb89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51aafd3c0cc848cca91dfb3e7ba07b5b, user_id=cef7be1085894cb18d0d8c53296dbc07, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:19.610867 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89da323-3c9d-4459-a8fc-d0e0a4a4fb89 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:19.636269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2675439-8cd5-4eb1-8624-2af328e32ff8 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:19.640299 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0440aa2-c8e1-4608-93a8-bedcb29d6f89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:19.641020 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0440aa2-c8e1-4608-93a8-bedcb29d6f89 service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:19.641307 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0440aa2-c8e1-4608-93a8-bedcb29d6f89 service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:19.641645 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0440aa2-c8e1-4608-93a8-bedcb29d6f89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:19.731332 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0440aa2-c8e1-4608-93a8-bedcb29d6f89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:19.733280 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0440aa2-c8e1-4608-93a8-bedcb29d6f89 service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:19.754539 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 864/1714] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:19 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:13:19.831195 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 851/1715] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:13:19 2021] PUT /identity/v3/projects/51aafd3c0cc848cca91dfb3e7ba07b5b/users/cef7be1085894cb18d0d8c53296dbc07/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:13:19.832385 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0440aa2-c8e1-4608-93a8-bedcb29d6f89 service cinder] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:19.858807 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0440aa2-c8e1-4608-93a8-bedcb29d6f89 service cinder] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:19.953325 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed68467-8258-4ce4-96a9-0e84e2c42c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:19.954635 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed68467-8258-4ce4-96a9-0e84e2c42c8f admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:19.956677 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed68467-8258-4ce4-96a9-0e84e2c42c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:19.957052 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed68467-8258-4ce4-96a9-0e84e2c42c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:19.958066 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed68467-8258-4ce4-96a9-0e84e2c42c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:19.959751 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed68467-8258-4ce4-96a9-0e84e2c42c8f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:19.987843 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 865/1716] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:19 2021] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:13:19.997108 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89da323-3c9d-4459-a8fc-d0e0a4a4fb89 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:20.010277 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89da323-3c9d-4459-a8fc-d0e0a4a4fb89 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:20.016752 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b30e32-a4ba-4cde-8c0f-d4d17d21412d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:20.017923 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b30e32-a4ba-4cde-8c0f-d4d17d21412d admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:20.018250 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b30e32-a4ba-4cde-8c0f-d4d17d21412d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:20.018599 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b30e32-a4ba-4cde-8c0f-d4d17d21412d admin admin] PATH_INFO: `/v3/projects/51aafd3c0cc848cca91dfb3e7ba07b5b/users/cef7be1085894cb18d0d8c53296dbc07/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:20.020819 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b30e32-a4ba-4cde-8c0f-d4d17d21412d admin admin] RBAC: Authorizing `identity:create_grant(project_id=51aafd3c0cc848cca91dfb3e7ba07b5b, user_id=cef7be1085894cb18d0d8c53296dbc07, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:20.023505 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b30e32-a4ba-4cde-8c0f-d4d17d21412d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:20.042231 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 852/1717] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:13:19 2021] PUT /identity/v3/projects/51aafd3c0cc848cca91dfb3e7ba07b5b/users/cef7be1085894cb18d0d8c53296dbc07/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:20.107207 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d3b2f-52c2-4df9-844a-1353bae7d0cf None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:20.108930 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d3b2f-52c2-4df9-844a-1353bae7d0cf None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:20.108930 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d3b2f-52c2-4df9-844a-1353bae7d0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:20.157789 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-001d3b2f-52c2-4df9-844a-1353bae7d0cf None None] MFA Rules not processed for user `cef7be1085894cb18d0d8c53296dbc07`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:20.159317 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-001d3b2f-52c2-4df9-844a-1353bae7d0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:20.278661 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 866/1718] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:20 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:13:20.477677 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b30e32-a4ba-4cde-8c0f-d4d17d21412d admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:20.479395 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-66b30e32-a4ba-4cde-8c0f-d4d17d21412d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:20.545512 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b30e32-a4ba-4cde-8c0f-d4d17d21412d admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:20.549235 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953f6f9-34f9-4671-b8b7-8c964ccdddaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:20.549919 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953f6f9-34f9-4671-b8b7-8c964ccdddaa service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:20.550203 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953f6f9-34f9-4671-b8b7-8c964ccdddaa service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:20.550814 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953f6f9-34f9-4671-b8b7-8c964ccdddaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:20.562212 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953f6f9-34f9-4671-b8b7-8c964ccdddaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:20.563734 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953f6f9-34f9-4671-b8b7-8c964ccdddaa service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:20.576019 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 853/1719] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:20 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:13:21.154373 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d3b2f-52c2-4df9-844a-1353bae7d0cf None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:21.154373 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d3b2f-52c2-4df9-844a-1353bae7d0cf None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:21.154373 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79df9c-7c17-41cd-8d94-3e159250fea4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:21.154373 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79df9c-7c17-41cd-8d94-3e159250fea4 service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:21.156228 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79df9c-7c17-41cd-8d94-3e159250fea4 service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:21.156228 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79df9c-7c17-41cd-8d94-3e159250fea4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:21.214593 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79df9c-7c17-41cd-8d94-3e159250fea4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:21.216031 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79df9c-7c17-41cd-8d94-3e159250fea4 service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:21.224801 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 867/1720] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:21 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:13:21.290604 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953f6f9-34f9-4671-b8b7-8c964ccdddaa service cinder] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:21.292128 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-3953f6f9-34f9-4671-b8b7-8c964ccdddaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:21.371127 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953f6f9-34f9-4671-b8b7-8c964ccdddaa service cinder] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:21.378602 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08684f5d-5f5e-44a5-9304-2690493c876c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:21.380071 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08684f5d-5f5e-44a5-9304-2690493c876c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:21.380071 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08684f5d-5f5e-44a5-9304-2690493c876c admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:21.380071 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08684f5d-5f5e-44a5-9304-2690493c876c admin admin] PATH_INFO: `/v3/users/c565865010eb410e918a162d31fea657` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:21.382495 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08684f5d-5f5e-44a5-9304-2690493c876c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c565865010eb410e918a162d31fea657)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:21.388721 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08684f5d-5f5e-44a5-9304-2690493c876c admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:21.926925 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-08684f5d-5f5e-44a5-9304-2690493c876c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c565865010eb410e918a162d31fea657'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:21.927626 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-08684f5d-5f5e-44a5-9304-2690493c876c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c565865010eb410e918a162d31fea657'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:21.934497 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-08684f5d-5f5e-44a5-9304-2690493c876c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c565865010eb410e918a162d31fea657'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:22.000243 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-08684f5d-5f5e-44a5-9304-2690493c876c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c565865010eb410e918a162d31fea657'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:22.015405 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-08684f5d-5f5e-44a5-9304-2690493c876c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c565865010eb410e918a162d31fea657'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:22.022592 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 854/1721] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:13:21 2021] DELETE /identity/v3/users/c565865010eb410e918a162d31fea657 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:22.029170 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38dec6-d7b3-40ad-9a55-7039de76d37b None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:22.029861 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38dec6-d7b3-40ad-9a55-7039de76d37b None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:22.030174 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38dec6-d7b3-40ad-9a55-7039de76d37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:22.049109 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-ef38dec6-d7b3-40ad-9a55-7039de76d37b None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:22.060334 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-ef38dec6-d7b3-40ad-9a55-7039de76d37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:22.112064 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 868/1722] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:13:22.126073 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08684f5d-5f5e-44a5-9304-2690493c876c admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:22.128412 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-08684f5d-5f5e-44a5-9304-2690493c876c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:22.200903 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08684f5d-5f5e-44a5-9304-2690493c876c admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:22.204898 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd95c5-eba8-4004-b97a-1270d8227778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:22.205884 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd95c5-eba8-4004-b97a-1270d8227778 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:22.206259 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd95c5-eba8-4004-b97a-1270d8227778 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:22.206725 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd95c5-eba8-4004-b97a-1270d8227778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:22.226655 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd95c5-eba8-4004-b97a-1270d8227778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:22.229347 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd95c5-eba8-4004-b97a-1270d8227778 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:22.254771 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 855/1723] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:13:22.901761 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38dec6-d7b3-40ad-9a55-7039de76d37b None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:22.903176 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-ef38dec6-d7b3-40ad-9a55-7039de76d37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:22.916089 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38dec6-d7b3-40ad-9a55-7039de76d37b None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:22.920832 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbad59-003f-43ff-8904-b2dfc37ff94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:22.921703 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbad59-003f-43ff-8904-b2dfc37ff94d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:22.921989 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbad59-003f-43ff-8904-b2dfc37ff94d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:22.922266 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbad59-003f-43ff-8904-b2dfc37ff94d admin admin] PATH_INFO: `/v3/projects/e04c62fc26cf4c34930aae50b2dfe551` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:22.923560 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbad59-003f-43ff-8904-b2dfc37ff94d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e04c62fc26cf4c34930aae50b2dfe551)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:22.930058 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbad59-003f-43ff-8904-b2dfc37ff94d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:23.077076 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-dbdbad59-003f-43ff-8904-b2dfc37ff94d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e04c62fc26cf4c34930aae50b2dfe551', 'request_id': 'req-dbdbad59-003f-43ff-8904-b2dfc37ff94d'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:23.216448 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-dbdbad59-003f-43ff-8904-b2dfc37ff94d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e04c62fc26cf4c34930aae50b2dfe551', 'request_id': 'req-dbdbad59-003f-43ff-8904-b2dfc37ff94d'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:23.222642 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-dbdbad59-003f-43ff-8904-b2dfc37ff94d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e04c62fc26cf4c34930aae50b2dfe551', 'request_id': 'req-dbdbad59-003f-43ff-8904-b2dfc37ff94d'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:23.234368 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-dbdbad59-003f-43ff-8904-b2dfc37ff94d admin admin] The token cache is being invalidate because project e04c62fc26cf4c34930aae50b2dfe551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:13:23.234715 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-dbdbad59-003f-43ff-8904-b2dfc37ff94d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:23.235686 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-dbdbad59-003f-43ff-8904-b2dfc37ff94d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:23.237684 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 869/1724] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:13:22 2021] DELETE /identity/v3/projects/e04c62fc26cf4c34930aae50b2dfe551 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:13:23.242270 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd95c5-eba8-4004-b97a-1270d8227778 service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:23.253150 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd95c5-eba8-4004-b97a-1270d8227778 service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:23.337223 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57defe2-3794-4846-bd32-495e30b7cc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:23.338539 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57defe2-3794-4846-bd32-495e30b7cc10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:23.339045 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57defe2-3794-4846-bd32-495e30b7cc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:23.339641 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57defe2-3794-4846-bd32-495e30b7cc10 admin admin] PATH_INFO: `/v3/users/99465cf23a5445f1bc769ae7abe002f7` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:23.344752 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57defe2-3794-4846-bd32-495e30b7cc10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99465cf23a5445f1bc769ae7abe002f7)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:23.350753 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57defe2-3794-4846-bd32-495e30b7cc10 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:23.639074 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-f57defe2-3794-4846-bd32-495e30b7cc10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99465cf23a5445f1bc769ae7abe002f7'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:23.640234 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-f57defe2-3794-4846-bd32-495e30b7cc10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99465cf23a5445f1bc769ae7abe002f7'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:23.660876 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-f57defe2-3794-4846-bd32-495e30b7cc10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99465cf23a5445f1bc769ae7abe002f7'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:23.851297 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-f57defe2-3794-4846-bd32-495e30b7cc10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99465cf23a5445f1bc769ae7abe002f7'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:23.865459 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-f57defe2-3794-4846-bd32-495e30b7cc10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99465cf23a5445f1bc769ae7abe002f7'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:23.872747 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 856/1725] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:13:23 2021] DELETE /identity/v3/users/99465cf23a5445f1bc769ae7abe002f7 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:24.501993 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbad59-003f-43ff-8904-b2dfc37ff94d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:24.503535 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-dbdbad59-003f-43ff-8904-b2dfc37ff94d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:24.542786 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbad59-003f-43ff-8904-b2dfc37ff94d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:24.609498 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e27d8-7288-46a6-8a81-989322e62de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:24.610554 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e27d8-7288-46a6-8a81-989322e62de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:24.610943 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e27d8-7288-46a6-8a81-989322e62de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:24.611181 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e27d8-7288-46a6-8a81-989322e62de3 admin admin] PATH_INFO: `/v3/projects/7a0129395d8c48c5be1af0f98c865786` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:24.615881 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e27d8-7288-46a6-8a81-989322e62de3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a0129395d8c48c5be1af0f98c865786)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:24.616589 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e27d8-7288-46a6-8a81-989322e62de3 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:24.799920 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-748e27d8-7288-46a6-8a81-989322e62de3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a0129395d8c48c5be1af0f98c865786', 'request_id': 'req-748e27d8-7288-46a6-8a81-989322e62de3'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:24.867736 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-748e27d8-7288-46a6-8a81-989322e62de3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a0129395d8c48c5be1af0f98c865786', 'request_id': 'req-748e27d8-7288-46a6-8a81-989322e62de3'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:24.873628 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-748e27d8-7288-46a6-8a81-989322e62de3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a0129395d8c48c5be1af0f98c865786', 'request_id': 'req-748e27d8-7288-46a6-8a81-989322e62de3'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:24.885155 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-748e27d8-7288-46a6-8a81-989322e62de3 admin admin] The token cache is being invalidate because project 7a0129395d8c48c5be1af0f98c865786 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:13:24.885438 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-748e27d8-7288-46a6-8a81-989322e62de3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:24.886062 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-748e27d8-7288-46a6-8a81-989322e62de3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:24.887596 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 870/1726] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:13:24 2021] DELETE /identity/v3/projects/7a0129395d8c48c5be1af0f98c865786 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:24.894805 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a08d25-9b80-482f-8a94-2408a7e7a1ca None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:24.895336 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a08d25-9b80-482f-8a94-2408a7e7a1ca None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:24.895459 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a08d25-9b80-482f-8a94-2408a7e7a1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:24.913549 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-35a08d25-9b80-482f-8a94-2408a7e7a1ca None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:24.915228 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-35a08d25-9b80-482f-8a94-2408a7e7a1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:24.969810 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 857/1727] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:13:24.978321 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd3783-93c1-4950-b8df-7319dd227b8b None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:24.978607 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd3783-93c1-4950-b8df-7319dd227b8b None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:24.978885 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd3783-93c1-4950-b8df-7319dd227b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:24.997551 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-0fcd3783-93c1-4950-b8df-7319dd227b8b None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:24.998839 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-0fcd3783-93c1-4950-b8df-7319dd227b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:25.006797 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 871/1728] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:25.010954 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a08d25-9b80-482f-8a94-2408a7e7a1ca None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:25.020192 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a08d25-9b80-482f-8a94-2408a7e7a1ca None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:25.025356 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd0714-1a6e-4553-b835-2254605b9a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:25.026015 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd0714-1a6e-4553-b835-2254605b9a0b admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:25.026297 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd0714-1a6e-4553-b835-2254605b9a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:25.026577 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd0714-1a6e-4553-b835-2254605b9a0b admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:25.027294 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd0714-1a6e-4553-b835-2254605b9a0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:13:25.027612 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd0714-1a6e-4553-b835-2254605b9a0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:25.029242 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd0714-1a6e-4553-b835-2254605b9a0b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:25.040808 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 858/1729] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:13:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:13:25.044863 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd3783-93c1-4950-b8df-7319dd227b8b None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:25.053830 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd3783-93c1-4950-b8df-7319dd227b8b None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:25.058397 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed047d28-eb71-40d6-92c2-80af80d2792d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:25.059041 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed047d28-eb71-40d6-92c2-80af80d2792d admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:25.059318 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed047d28-eb71-40d6-92c2-80af80d2792d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:25.059591 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed047d28-eb71-40d6-92c2-80af80d2792d admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:25.060278 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed047d28-eb71-40d6-92c2-80af80d2792d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:25.062290 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed047d28-eb71-40d6-92c2-80af80d2792d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:25.143335 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 872/1730] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:13:25 2021] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:13:25.147515 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd0714-1a6e-4553-b835-2254605b9a0b admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:25.157685 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd0714-1a6e-4553-b835-2254605b9a0b admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:25.214125 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4cc62-8e09-4520-837a-b13d68319a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:25.214812 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4cc62-8e09-4520-837a-b13d68319a1d admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:25.215100 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4cc62-8e09-4520-837a-b13d68319a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:25.215377 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4cc62-8e09-4520-837a-b13d68319a1d admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:25.216101 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4cc62-8e09-4520-837a-b13d68319a1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:25.218106 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4cc62-8e09-4520-837a-b13d68319a1d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:25.305184 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 859/1731] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:13:25 2021] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:13:25.306387 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed047d28-eb71-40d6-92c2-80af80d2792d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:25.317743 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed047d28-eb71-40d6-92c2-80af80d2792d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:25.322601 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572c66c-1346-49c0-8dc0-2b7091431ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:25.323266 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572c66c-1346-49c0-8dc0-2b7091431ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:25.323605 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572c66c-1346-49c0-8dc0-2b7091431ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:25.323909 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572c66c-1346-49c0-8dc0-2b7091431ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:25.328374 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572c66c-1346-49c0-8dc0-2b7091431ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:25.330072 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572c66c-1346-49c0-8dc0-2b7091431ea3 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:25.341650 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 873/1732] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:25 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:13:25.345613 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4cc62-8e09-4520-837a-b13d68319a1d admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:25.355977 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4cc62-8e09-4520-837a-b13d68319a1d admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:25.360961 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ecc70a-d6e1-4144-9170-7380418dad71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:25.366253 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecc70a-d6e1-4144-9170-7380418dad71 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:25.366253 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecc70a-d6e1-4144-9170-7380418dad71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:25.366253 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecc70a-d6e1-4144-9170-7380418dad71 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:25.366253 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ecc70a-d6e1-4144-9170-7380418dad71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:25.366253 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ecc70a-d6e1-4144-9170-7380418dad71 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:25.374385 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 860/1733] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:25 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:13:25.378315 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572c66c-1346-49c0-8dc0-2b7091431ea3 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:25.388368 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572c66c-1346-49c0-8dc0-2b7091431ea3 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:25.395142 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f8c0d-5b11-47d3-8648-80a8fb63e9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:25.395142 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f8c0d-5b11-47d3-8648-80a8fb63e9f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:25.395142 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f8c0d-5b11-47d3-8648-80a8fb63e9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:25.395142 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f8c0d-5b11-47d3-8648-80a8fb63e9f5 admin admin] PATH_INFO: `/v3/projects/2c72efc1b9f442e2994883951d8043a3/users/6dda0159a5334ae9a63d5a1ee4e2646e/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:25.409302 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f8c0d-5b11-47d3-8648-80a8fb63e9f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c72efc1b9f442e2994883951d8043a3, user_id=6dda0159a5334ae9a63d5a1ee4e2646e, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:25.411925 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f8c0d-5b11-47d3-8648-80a8fb63e9f5 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:25.496204 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 874/1734] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:13:25 2021] PUT /identity/v3/projects/2c72efc1b9f442e2994883951d8043a3/users/6dda0159a5334ae9a63d5a1ee4e2646e/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:13:25.507234 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc87c4-a5a8-449c-a8f0-f989e371629a None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:25.507522 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc87c4-a5a8-449c-a8f0-f989e371629a None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:25.507803 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc87c4-a5a8-449c-a8f0-f989e371629a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:25.534490 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-c4dc87c4-a5a8-449c-a8f0-f989e371629a None None] MFA Rules not processed for user `6dda0159a5334ae9a63d5a1ee4e2646e`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:25.535694 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-c4dc87c4-a5a8-449c-a8f0-f989e371629a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:25.602828 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 861/1735] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:25 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:25.615355 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f8c0d-5b11-47d3-8648-80a8fb63e9f5 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:25.617100 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-3a0f8c0d-5b11-47d3-8648-80a8fb63e9f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:25.672794 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f8c0d-5b11-47d3-8648-80a8fb63e9f5 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:25.676452 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf420c26-f0e4-4545-9a60-4473469cf4fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:25.677150 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf420c26-f0e4-4545-9a60-4473469cf4fc service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:25.677436 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf420c26-f0e4-4545-9a60-4473469cf4fc service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:25.677715 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf420c26-f0e4-4545-9a60-4473469cf4fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:25.686325 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf420c26-f0e4-4545-9a60-4473469cf4fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:25.687758 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf420c26-f0e4-4545-9a60-4473469cf4fc service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:25.697324 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 875/1736] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:25 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:13:31.508574 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc87c4-a5a8-449c-a8f0-f989e371629a None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:31.522012 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc87c4-a5a8-449c-a8f0-f989e371629a None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:31.529828 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd2189-c390-461f-8461-ada3b46b6c9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:31.531005 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd2189-c390-461f-8461-ada3b46b6c9b service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:31.531492 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd2189-c390-461f-8461-ada3b46b6c9b service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:31.531980 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd2189-c390-461f-8461-ada3b46b6c9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:31.534405 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-c1cd2189-c390-461f-8461-ada3b46b6c9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:31.661016 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd2189-c390-461f-8461-ada3b46b6c9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:31.662467 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd2189-c390-461f-8461-ada3b46b6c9b service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:31.673565 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 862/1737] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:31 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:13:31.951425 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf420c26-f0e4-4545-9a60-4473469cf4fc service cinder] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:31.952979 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-cf420c26-f0e4-4545-9a60-4473469cf4fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:32.038159 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf420c26-f0e4-4545-9a60-4473469cf4fc service cinder] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:32.043735 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6cf07-7db1-43e4-a804-a3ea33b702c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:32.044662 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6cf07-7db1-43e4-a804-a3ea33b702c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:32.045044 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6cf07-7db1-43e4-a804-a3ea33b702c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:32.045322 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6cf07-7db1-43e4-a804-a3ea33b702c4 admin admin] PATH_INFO: `/v3/users/4d8192a0ffe3410d917c9fa9fee8118b` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:32.046722 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6cf07-7db1-43e4-a804-a3ea33b702c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d8192a0ffe3410d917c9fa9fee8118b)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:32.048854 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6cf07-7db1-43e4-a804-a3ea33b702c4 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:32.220883 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-0fa6cf07-7db1-43e4-a804-a3ea33b702c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d8192a0ffe3410d917c9fa9fee8118b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:32.222086 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-0fa6cf07-7db1-43e4-a804-a3ea33b702c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d8192a0ffe3410d917c9fa9fee8118b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:32.223101 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-0fa6cf07-7db1-43e4-a804-a3ea33b702c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d8192a0ffe3410d917c9fa9fee8118b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:32.233868 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-0fa6cf07-7db1-43e4-a804-a3ea33b702c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d8192a0ffe3410d917c9fa9fee8118b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:32.301008 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-0fa6cf07-7db1-43e4-a804-a3ea33b702c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d8192a0ffe3410d917c9fa9fee8118b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:32.340987 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 876/1738] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:13:31 2021] DELETE /identity/v3/users/4d8192a0ffe3410d917c9fa9fee8118b => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:32.443985 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bf3c5-2f18-4cfb-8bb9-ffd3d80ef56a None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:32.443985 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bf3c5-2f18-4cfb-8bb9-ffd3d80ef56a None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:32.443985 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bf3c5-2f18-4cfb-8bb9-ffd3d80ef56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:32.443985 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-ed9bf3c5-2f18-4cfb-8bb9-ffd3d80ef56a None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:32.443985 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-ed9bf3c5-2f18-4cfb-8bb9-ffd3d80ef56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:32.443985 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 863/1739] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:13:32.445295 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6cf07-7db1-43e4-a804-a3ea33b702c4 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:32.446781 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-0fa6cf07-7db1-43e4-a804-a3ea33b702c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:32.508523 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6cf07-7db1-43e4-a804-a3ea33b702c4 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:32.513972 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff654d5d-b61f-4856-b536-663cbbdd7982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:32.514864 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff654d5d-b61f-4856-b536-663cbbdd7982 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:32.515302 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff654d5d-b61f-4856-b536-663cbbdd7982 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:32.515730 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff654d5d-b61f-4856-b536-663cbbdd7982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:32.529279 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff654d5d-b61f-4856-b536-663cbbdd7982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:32.530812 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff654d5d-b61f-4856-b536-663cbbdd7982 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:32.542686 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 877/1740] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:13:33.564903 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9bf3c5-2f18-4cfb-8bb9-ffd3d80ef56a None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:33.570072 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-ed9bf3c5-2f18-4cfb-8bb9-ffd3d80ef56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:33.586194 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9bf3c5-2f18-4cfb-8bb9-ffd3d80ef56a None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:33.591570 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780da0a-c78e-4931-91e4-bab6bd481285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:33.592986 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780da0a-c78e-4931-91e4-bab6bd481285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:33.593164 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780da0a-c78e-4931-91e4-bab6bd481285 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:33.593741 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780da0a-c78e-4931-91e4-bab6bd481285 admin admin] PATH_INFO: `/v3/projects/3734708297474eb3bc9f1ac6d1f4910e` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:33.595122 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780da0a-c78e-4931-91e4-bab6bd481285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3734708297474eb3bc9f1ac6d1f4910e)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:33.597593 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780da0a-c78e-4931-91e4-bab6bd481285 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:33.735514 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d780da0a-c78e-4931-91e4-bab6bd481285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3734708297474eb3bc9f1ac6d1f4910e', 'request_id': 'req-d780da0a-c78e-4931-91e4-bab6bd481285'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:33.805030 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d780da0a-c78e-4931-91e4-bab6bd481285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3734708297474eb3bc9f1ac6d1f4910e', 'request_id': 'req-d780da0a-c78e-4931-91e4-bab6bd481285'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:33.828222 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d780da0a-c78e-4931-91e4-bab6bd481285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3734708297474eb3bc9f1ac6d1f4910e', 'request_id': 'req-d780da0a-c78e-4931-91e4-bab6bd481285'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:33.841597 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d780da0a-c78e-4931-91e4-bab6bd481285 admin admin] The token cache is being invalidate because project 3734708297474eb3bc9f1ac6d1f4910e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:13:33.842748 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d780da0a-c78e-4931-91e4-bab6bd481285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:33.842748 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d780da0a-c78e-4931-91e4-bab6bd481285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:33.847571 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 864/1741] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:13:33 2021] DELETE /identity/v3/projects/3734708297474eb3bc9f1ac6d1f4910e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:33.849601 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff654d5d-b61f-4856-b536-663cbbdd7982 service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:33.859698 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff654d5d-b61f-4856-b536-663cbbdd7982 service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:33.941591 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396ec42-b8d3-4b6b-93d7-15e1be90e373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:33.942847 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396ec42-b8d3-4b6b-93d7-15e1be90e373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:33.943300 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396ec42-b8d3-4b6b-93d7-15e1be90e373 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:33.943817 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396ec42-b8d3-4b6b-93d7-15e1be90e373 admin admin] PATH_INFO: `/v3/users/cef7be1085894cb18d0d8c53296dbc07` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:33.945429 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396ec42-b8d3-4b6b-93d7-15e1be90e373 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cef7be1085894cb18d0d8c53296dbc07)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:33.947846 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396ec42-b8d3-4b6b-93d7-15e1be90e373 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:34.141059 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-a396ec42-b8d3-4b6b-93d7-15e1be90e373 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cef7be1085894cb18d0d8c53296dbc07'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:34.141914 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-a396ec42-b8d3-4b6b-93d7-15e1be90e373 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cef7be1085894cb18d0d8c53296dbc07'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:34.142648 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-a396ec42-b8d3-4b6b-93d7-15e1be90e373 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cef7be1085894cb18d0d8c53296dbc07'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:34.151274 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-a396ec42-b8d3-4b6b-93d7-15e1be90e373 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cef7be1085894cb18d0d8c53296dbc07'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:34.245085 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-a396ec42-b8d3-4b6b-93d7-15e1be90e373 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cef7be1085894cb18d0d8c53296dbc07'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:34.270691 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 878/1742] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:13:33 2021] DELETE /identity/v3/users/cef7be1085894cb18d0d8c53296dbc07 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:13:34.752985 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780da0a-c78e-4931-91e4-bab6bd481285 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:34.754736 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-d780da0a-c78e-4931-91e4-bab6bd481285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:34.768723 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780da0a-c78e-4931-91e4-bab6bd481285 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:34.831129 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0926bfb-d58f-4cf4-b912-643c45867679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:34.831994 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0926bfb-d58f-4cf4-b912-643c45867679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:34.832276 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0926bfb-d58f-4cf4-b912-643c45867679 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:34.832577 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0926bfb-d58f-4cf4-b912-643c45867679 admin admin] PATH_INFO: `/v3/projects/51aafd3c0cc848cca91dfb3e7ba07b5b` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:34.833747 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0926bfb-d58f-4cf4-b912-643c45867679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51aafd3c0cc848cca91dfb3e7ba07b5b)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:34.835638 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0926bfb-d58f-4cf4-b912-643c45867679 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:34.961585 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-e0926bfb-d58f-4cf4-b912-643c45867679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51aafd3c0cc848cca91dfb3e7ba07b5b', 'request_id': 'req-e0926bfb-d58f-4cf4-b912-643c45867679'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:35.031977 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-e0926bfb-d58f-4cf4-b912-643c45867679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51aafd3c0cc848cca91dfb3e7ba07b5b', 'request_id': 'req-e0926bfb-d58f-4cf4-b912-643c45867679'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:35.038546 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-e0926bfb-d58f-4cf4-b912-643c45867679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51aafd3c0cc848cca91dfb3e7ba07b5b', 'request_id': 'req-e0926bfb-d58f-4cf4-b912-643c45867679'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:35.050763 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-e0926bfb-d58f-4cf4-b912-643c45867679 admin admin] The token cache is being invalidate because project 51aafd3c0cc848cca91dfb3e7ba07b5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:13:35.051110 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-e0926bfb-d58f-4cf4-b912-643c45867679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:35.051962 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-e0926bfb-d58f-4cf4-b912-643c45867679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:35.057811 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 865/1743] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:13:34 2021] DELETE /identity/v3/projects/51aafd3c0cc848cca91dfb3e7ba07b5b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:35.059502 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f02db-7516-436e-997d-292d286d9b68 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:35.059958 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f02db-7516-436e-997d-292d286d9b68 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:35.060073 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f02db-7516-436e-997d-292d286d9b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:35.088616 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-328f02db-7516-436e-997d-292d286d9b68 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:35.093799 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-328f02db-7516-436e-997d-292d286d9b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:35.156462 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 879/1744] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:35.164917 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b87775-2d9d-4b19-a4ae-ddbb5f3ceb3c None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:35.165205 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b87775-2d9d-4b19-a4ae-ddbb5f3ceb3c None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:35.165482 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b87775-2d9d-4b19-a4ae-ddbb5f3ceb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:35.183296 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-34b87775-2d9d-4b19-a4ae-ddbb5f3ceb3c None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:35.184612 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-34b87775-2d9d-4b19-a4ae-ddbb5f3ceb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:35.196871 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 866/1745] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:35.201008 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f02db-7516-436e-997d-292d286d9b68 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:35.210479 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f02db-7516-436e-997d-292d286d9b68 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:35.215685 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7add38-30a4-45d7-9cb3-c86902e1e1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:35.216347 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7add38-30a4-45d7-9cb3-c86902e1e1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:35.216696 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7add38-30a4-45d7-9cb3-c86902e1e1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:35.216977 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7add38-30a4-45d7-9cb3-c86902e1e1a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:35.217702 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7add38-30a4-45d7-9cb3-c86902e1e1a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:13:35.218010 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7add38-30a4-45d7-9cb3-c86902e1e1a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:35.219600 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7add38-30a4-45d7-9cb3-c86902e1e1a2 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:35.231047 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 880/1746] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:13:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:13:35.235813 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b87775-2d9d-4b19-a4ae-ddbb5f3ceb3c None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:35.244946 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b87775-2d9d-4b19-a4ae-ddbb5f3ceb3c None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:35.249602 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47db4a-1c85-4f0f-9d10-d2e688c4b7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:35.250264 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47db4a-1c85-4f0f-9d10-d2e688c4b7ee admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:35.250542 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47db4a-1c85-4f0f-9d10-d2e688c4b7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:35.250815 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47db4a-1c85-4f0f-9d10-d2e688c4b7ee admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:35.251505 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47db4a-1c85-4f0f-9d10-d2e688c4b7ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:35.253444 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47db4a-1c85-4f0f-9d10-d2e688c4b7ee admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:35.332406 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 867/1747] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:13:35 2021] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:13:35.347648 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7add38-30a4-45d7-9cb3-c86902e1e1a2 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:35.347648 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7add38-30a4-45d7-9cb3-c86902e1e1a2 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:35.403534 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10e761-d71a-420f-8d75-1265f3f6d96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:35.404201 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10e761-d71a-420f-8d75-1265f3f6d96e admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:35.404503 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10e761-d71a-420f-8d75-1265f3f6d96e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:35.404794 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10e761-d71a-420f-8d75-1265f3f6d96e admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:35.405479 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10e761-d71a-420f-8d75-1265f3f6d96e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:35.407363 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10e761-d71a-420f-8d75-1265f3f6d96e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:35.524673 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 881/1748] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:13:35 2021] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:13:35.528884 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47db4a-1c85-4f0f-9d10-d2e688c4b7ee admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:35.538904 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47db4a-1c85-4f0f-9d10-d2e688c4b7ee admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:35.544058 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966b5c4-5552-46ab-9f8f-e6b09392448b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:35.544769 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966b5c4-5552-46ab-9f8f-e6b09392448b admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:35.545057 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966b5c4-5552-46ab-9f8f-e6b09392448b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:35.545353 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966b5c4-5552-46ab-9f8f-e6b09392448b admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:35.546066 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966b5c4-5552-46ab-9f8f-e6b09392448b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:35.547709 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966b5c4-5552-46ab-9f8f-e6b09392448b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:35.557943 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 868/1749] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:35 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:13:35.561645 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10e761-d71a-420f-8d75-1265f3f6d96e admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:35.571267 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10e761-d71a-420f-8d75-1265f3f6d96e admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:35.576002 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bd508-f464-4840-8e2f-db1b5851607d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:35.576707 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bd508-f464-4840-8e2f-db1b5851607d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:35.577005 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bd508-f464-4840-8e2f-db1b5851607d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:35.577277 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bd508-f464-4840-8e2f-db1b5851607d admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:35.577977 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bd508-f464-4840-8e2f-db1b5851607d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:35.579631 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bd508-f464-4840-8e2f-db1b5851607d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:35.590736 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 882/1750] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:35 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:13:35.595065 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966b5c4-5552-46ab-9f8f-e6b09392448b admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:35.607741 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966b5c4-5552-46ab-9f8f-e6b09392448b admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:35.613578 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0969af7-b601-4551-a176-06beb73c1689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:35.614671 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0969af7-b601-4551-a176-06beb73c1689 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:35.614964 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0969af7-b601-4551-a176-06beb73c1689 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:35.615244 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0969af7-b601-4551-a176-06beb73c1689 admin admin] PATH_INFO: `/v3/projects/d6b244de4caa4573a104ebb11415cfac/users/69fe69b7e67a4e71a16f3cbac67a5340/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:35.630954 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0969af7-b601-4551-a176-06beb73c1689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6b244de4caa4573a104ebb11415cfac, user_id=69fe69b7e67a4e71a16f3cbac67a5340, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:35.634733 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0969af7-b601-4551-a176-06beb73c1689 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:35.702988 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 869/1751] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:13:35 2021] PUT /identity/v3/projects/d6b244de4caa4573a104ebb11415cfac/users/69fe69b7e67a4e71a16f3cbac67a5340/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:35.713977 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2f30e-0dc0-4df8-a2d3-ba2efcfe3ee5 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:35.714259 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2f30e-0dc0-4df8-a2d3-ba2efcfe3ee5 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:35.714536 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2f30e-0dc0-4df8-a2d3-ba2efcfe3ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:35.747145 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-aeb2f30e-0dc0-4df8-a2d3-ba2efcfe3ee5 None None] MFA Rules not processed for user `69fe69b7e67a4e71a16f3cbac67a5340`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:35.748533 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-aeb2f30e-0dc0-4df8-a2d3-ba2efcfe3ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:35.813231 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 883/1752] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:35 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:35.817763 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0969af7-b601-4551-a176-06beb73c1689 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:35.877401 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0969af7-b601-4551-a176-06beb73c1689 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:35.882139 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef035c5d-35ee-4580-b0e2-824f17f9c24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:35.882800 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef035c5d-35ee-4580-b0e2-824f17f9c24b admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:35.883099 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef035c5d-35ee-4580-b0e2-824f17f9c24b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:35.883381 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef035c5d-35ee-4580-b0e2-824f17f9c24b admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:35.884075 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef035c5d-35ee-4580-b0e2-824f17f9c24b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:35.886024 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef035c5d-35ee-4580-b0e2-824f17f9c24b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:36.037337 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 870/1753] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:13:35 2021] POST /identity/v3/projects => generated 389 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:13:36.042290 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2f30e-0dc0-4df8-a2d3-ba2efcfe3ee5 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:36.052904 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2f30e-0dc0-4df8-a2d3-ba2efcfe3ee5 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:36.107097 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc74f6-2c27-4f3c-a422-dd3a252064cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:36.107705 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc74f6-2c27-4f3c-a422-dd3a252064cb admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:36.107975 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc74f6-2c27-4f3c-a422-dd3a252064cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:36.108254 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc74f6-2c27-4f3c-a422-dd3a252064cb admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:36.109007 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc74f6-2c27-4f3c-a422-dd3a252064cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:36.111244 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc74f6-2c27-4f3c-a422-dd3a252064cb admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:36.213726 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 884/1754] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:13:36 2021] POST /identity/v3/users => generated 301 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:13:36.214874 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef035c5d-35ee-4580-b0e2-824f17f9c24b admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:36.225926 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef035c5d-35ee-4580-b0e2-824f17f9c24b admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:36.231022 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1916b-4e4b-4ecb-bc7a-f84e4b1f3445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:36.231699 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1916b-4e4b-4ecb-bc7a-f84e4b1f3445 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:36.231985 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1916b-4e4b-4ecb-bc7a-f84e4b1f3445 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:36.232264 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1916b-4e4b-4ecb-bc7a-f84e4b1f3445 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:36.233044 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1916b-4e4b-4ecb-bc7a-f84e4b1f3445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:36.239518 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1916b-4e4b-4ecb-bc7a-f84e4b1f3445 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:36.251129 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 871/1755] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:36 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:13:36.255267 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc74f6-2c27-4f3c-a422-dd3a252064cb admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:36.266097 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc74f6-2c27-4f3c-a422-dd3a252064cb admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:36.271713 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31e014-83a6-46e2-b89d-4149d8fcbf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:36.272737 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31e014-83a6-46e2-b89d-4149d8fcbf6a admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:36.273091 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31e014-83a6-46e2-b89d-4149d8fcbf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:36.273450 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31e014-83a6-46e2-b89d-4149d8fcbf6a admin admin] PATH_INFO: `/v3/projects/422acb24c50c410bbb47480626769091/users/3b363f7fd248423f9416ebc0ad6bfd3d/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:36.299698 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31e014-83a6-46e2-b89d-4149d8fcbf6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=422acb24c50c410bbb47480626769091, user_id=3b363f7fd248423f9416ebc0ad6bfd3d, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:36.302511 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31e014-83a6-46e2-b89d-4149d8fcbf6a admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:36.404063 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 885/1756] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:13:36 2021] PUT /identity/v3/projects/422acb24c50c410bbb47480626769091/users/3b363f7fd248423f9416ebc0ad6bfd3d/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:36.408057 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1916b-4e4b-4ecb-bc7a-f84e4b1f3445 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:36.418654 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1916b-4e4b-4ecb-bc7a-f84e4b1f3445 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:36.472720 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24edfbc5-43bd-4c44-9d98-6e198ec02afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:36.473406 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edfbc5-43bd-4c44-9d98-6e198ec02afe admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:36.473689 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edfbc5-43bd-4c44-9d98-6e198ec02afe admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:36.473969 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edfbc5-43bd-4c44-9d98-6e198ec02afe admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:36.474690 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24edfbc5-43bd-4c44-9d98-6e198ec02afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:36.476294 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24edfbc5-43bd-4c44-9d98-6e198ec02afe admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:36.487286 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 872/1757] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:36 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:13:36.491268 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31e014-83a6-46e2-b89d-4149d8fcbf6a admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:36.501544 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31e014-83a6-46e2-b89d-4149d8fcbf6a admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:36.506241 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96d89d-2c52-4461-82ec-58598e8f530a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:36.507125 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96d89d-2c52-4461-82ec-58598e8f530a admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:36.507405 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96d89d-2c52-4461-82ec-58598e8f530a admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:36.507679 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96d89d-2c52-4461-82ec-58598e8f530a admin admin] PATH_INFO: `/v3/projects/422acb24c50c410bbb47480626769091/users/3b363f7fd248423f9416ebc0ad6bfd3d/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:36.509708 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96d89d-2c52-4461-82ec-58598e8f530a admin admin] RBAC: Authorizing `identity:create_grant(project_id=422acb24c50c410bbb47480626769091, user_id=3b363f7fd248423f9416ebc0ad6bfd3d, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:36.512288 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96d89d-2c52-4461-82ec-58598e8f530a admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:36.522409 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 886/1758] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:13:36 2021] PUT /identity/v3/projects/422acb24c50c410bbb47480626769091/users/3b363f7fd248423f9416ebc0ad6bfd3d/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:13:36.533934 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540daf27-269d-4fd6-b58e-34173239b03b None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:36.534224 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540daf27-269d-4fd6-b58e-34173239b03b None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:36.534503 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540daf27-269d-4fd6-b58e-34173239b03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:36.561134 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-540daf27-269d-4fd6-b58e-34173239b03b None None] MFA Rules not processed for user `3b363f7fd248423f9416ebc0ad6bfd3d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:36.562328 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-540daf27-269d-4fd6-b58e-34173239b03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:36.628034 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 873/1759] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:36 2021] POST /identity/v3/auth/tokens => generated 3476 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:36.637821 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96d89d-2c52-4461-82ec-58598e8f530a admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:36.639510 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-5c96d89d-2c52-4461-82ec-58598e8f530a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:36.695494 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96d89d-2c52-4461-82ec-58598e8f530a admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:36.699226 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdbf14-9876-4144-a597-f7a6fb4c7fc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:36.699875 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdbf14-9876-4144-a597-f7a6fb4c7fc2 service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:36.700163 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdbf14-9876-4144-a597-f7a6fb4c7fc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:36.700423 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdbf14-9876-4144-a597-f7a6fb4c7fc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:36.709372 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cdbf14-9876-4144-a597-f7a6fb4c7fc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:36.710792 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cdbf14-9876-4144-a597-f7a6fb4c7fc2 service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:36.719958 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 887/1760] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:36 2021] GET /identity/v3/auth/tokens => generated 3476 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:13:36.853869 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540daf27-269d-4fd6-b58e-34173239b03b None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:36.919250 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540daf27-269d-4fd6-b58e-34173239b03b None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:36.923818 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69324c9-47bb-40cb-a370-391e8a658543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:36.924724 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69324c9-47bb-40cb-a370-391e8a658543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:36.925005 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69324c9-47bb-40cb-a370-391e8a658543 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:36.925278 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69324c9-47bb-40cb-a370-391e8a658543 admin admin] PATH_INFO: `/v3/users/69fe69b7e67a4e71a16f3cbac67a5340` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:36.926449 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69324c9-47bb-40cb-a370-391e8a658543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69fe69b7e67a4e71a16f3cbac67a5340)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:36.928357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69324c9-47bb-40cb-a370-391e8a658543 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:37.131457 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-e69324c9-47bb-40cb-a370-391e8a658543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69fe69b7e67a4e71a16f3cbac67a5340'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:37.132110 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-e69324c9-47bb-40cb-a370-391e8a658543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69fe69b7e67a4e71a16f3cbac67a5340'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:37.139340 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-e69324c9-47bb-40cb-a370-391e8a658543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69fe69b7e67a4e71a16f3cbac67a5340'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:37.215709 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-e69324c9-47bb-40cb-a370-391e8a658543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69fe69b7e67a4e71a16f3cbac67a5340'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:37.227763 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-e69324c9-47bb-40cb-a370-391e8a658543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69fe69b7e67a4e71a16f3cbac67a5340'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:37.233598 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 874/1761] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:13:36 2021] DELETE /identity/v3/users/69fe69b7e67a4e71a16f3cbac67a5340 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:37.238340 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04041922-3824-492b-93d8-d1b67cefec7d None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:37.238838 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04041922-3824-492b-93d8-d1b67cefec7d None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:37.238932 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04041922-3824-492b-93d8-d1b67cefec7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:37.256680 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-04041922-3824-492b-93d8-d1b67cefec7d None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:37.258473 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-04041922-3824-492b-93d8-d1b67cefec7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:37.313573 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 888/1762] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:37.325341 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69324c9-47bb-40cb-a370-391e8a658543 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:37.326757 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-e69324c9-47bb-40cb-a370-391e8a658543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:37.389141 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69324c9-47bb-40cb-a370-391e8a658543 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:37.393278 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225741f-814b-46ed-b2ad-bfe1e0fbd301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:37.393983 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225741f-814b-46ed-b2ad-bfe1e0fbd301 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:37.394369 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225741f-814b-46ed-b2ad-bfe1e0fbd301 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:37.394750 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225741f-814b-46ed-b2ad-bfe1e0fbd301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:37.404951 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225741f-814b-46ed-b2ad-bfe1e0fbd301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:37.406405 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225741f-814b-46ed-b2ad-bfe1e0fbd301 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:37.418368 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 875/1763] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:13:37.880061 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04041922-3824-492b-93d8-d1b67cefec7d None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:37.881754 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-04041922-3824-492b-93d8-d1b67cefec7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:37.893940 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04041922-3824-492b-93d8-d1b67cefec7d None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:37.899142 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed48e55-6f21-43dc-b255-2bc8c4dab6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:37.899954 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed48e55-6f21-43dc-b255-2bc8c4dab6ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:37.900238 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed48e55-6f21-43dc-b255-2bc8c4dab6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:37.900544 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed48e55-6f21-43dc-b255-2bc8c4dab6ae admin admin] PATH_INFO: `/v3/projects/d6b244de4caa4573a104ebb11415cfac` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:37.901776 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed48e55-6f21-43dc-b255-2bc8c4dab6ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6b244de4caa4573a104ebb11415cfac)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:37.903694 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed48e55-6f21-43dc-b255-2bc8c4dab6ae admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:38.049263 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-bed48e55-6f21-43dc-b255-2bc8c4dab6ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6b244de4caa4573a104ebb11415cfac', 'request_id': 'req-bed48e55-6f21-43dc-b255-2bc8c4dab6ae'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:38.130031 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-bed48e55-6f21-43dc-b255-2bc8c4dab6ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6b244de4caa4573a104ebb11415cfac', 'request_id': 'req-bed48e55-6f21-43dc-b255-2bc8c4dab6ae'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:38.136429 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-bed48e55-6f21-43dc-b255-2bc8c4dab6ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6b244de4caa4573a104ebb11415cfac', 'request_id': 'req-bed48e55-6f21-43dc-b255-2bc8c4dab6ae'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:38.147384 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-bed48e55-6f21-43dc-b255-2bc8c4dab6ae admin admin] The token cache is being invalidate because project d6b244de4caa4573a104ebb11415cfac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:13:38.150677 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-bed48e55-6f21-43dc-b255-2bc8c4dab6ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:38.150677 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-bed48e55-6f21-43dc-b255-2bc8c4dab6ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:38.150677 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 889/1764] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:13:37 2021] DELETE /identity/v3/projects/d6b244de4caa4573a104ebb11415cfac => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:38.155545 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225741f-814b-46ed-b2ad-bfe1e0fbd301 service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:38.166905 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225741f-814b-46ed-b2ad-bfe1e0fbd301 service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:38.249062 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07940b5e-b6d9-4be6-910c-4ea0519ce1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:38.253045 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07940b5e-b6d9-4be6-910c-4ea0519ce1b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:38.253045 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07940b5e-b6d9-4be6-910c-4ea0519ce1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:38.253045 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07940b5e-b6d9-4be6-910c-4ea0519ce1b0 admin admin] PATH_INFO: `/v3/users/3b363f7fd248423f9416ebc0ad6bfd3d` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:38.253045 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07940b5e-b6d9-4be6-910c-4ea0519ce1b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b363f7fd248423f9416ebc0ad6bfd3d)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:38.254262 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07940b5e-b6d9-4be6-910c-4ea0519ce1b0 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:38.446458 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-07940b5e-b6d9-4be6-910c-4ea0519ce1b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b363f7fd248423f9416ebc0ad6bfd3d'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:38.447071 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-07940b5e-b6d9-4be6-910c-4ea0519ce1b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b363f7fd248423f9416ebc0ad6bfd3d'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:38.454324 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-07940b5e-b6d9-4be6-910c-4ea0519ce1b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b363f7fd248423f9416ebc0ad6bfd3d'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:38.546078 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-07940b5e-b6d9-4be6-910c-4ea0519ce1b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b363f7fd248423f9416ebc0ad6bfd3d'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:38.559032 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-07940b5e-b6d9-4be6-910c-4ea0519ce1b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b363f7fd248423f9416ebc0ad6bfd3d'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:38.566181 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 876/1765] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:13:38 2021] DELETE /identity/v3/users/3b363f7fd248423f9416ebc0ad6bfd3d => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:39.215601 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed48e55-6f21-43dc-b255-2bc8c4dab6ae admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:39.215601 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-bed48e55-6f21-43dc-b255-2bc8c4dab6ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:39.229101 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed48e55-6f21-43dc-b255-2bc8c4dab6ae admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:39.293648 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfbd16-79d5-4110-8c44-970a0328c9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:39.295196 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfbd16-79d5-4110-8c44-970a0328c9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:39.295562 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfbd16-79d5-4110-8c44-970a0328c9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:39.295917 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfbd16-79d5-4110-8c44-970a0328c9d0 admin admin] PATH_INFO: `/v3/projects/422acb24c50c410bbb47480626769091` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:39.297259 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bfbd16-79d5-4110-8c44-970a0328c9d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=422acb24c50c410bbb47480626769091)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:39.299809 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bfbd16-79d5-4110-8c44-970a0328c9d0 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:39.415579 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-64bfbd16-79d5-4110-8c44-970a0328c9d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '422acb24c50c410bbb47480626769091', 'request_id': 'req-64bfbd16-79d5-4110-8c44-970a0328c9d0'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:39.507625 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-64bfbd16-79d5-4110-8c44-970a0328c9d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '422acb24c50c410bbb47480626769091', 'request_id': 'req-64bfbd16-79d5-4110-8c44-970a0328c9d0'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:39.513569 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-64bfbd16-79d5-4110-8c44-970a0328c9d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '422acb24c50c410bbb47480626769091', 'request_id': 'req-64bfbd16-79d5-4110-8c44-970a0328c9d0'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:39.525266 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-64bfbd16-79d5-4110-8c44-970a0328c9d0 admin admin] The token cache is being invalidate because project 422acb24c50c410bbb47480626769091 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:13:39.525554 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-64bfbd16-79d5-4110-8c44-970a0328c9d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:39.526182 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-64bfbd16-79d5-4110-8c44-970a0328c9d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:39.527725 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 890/1766] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:13:39 2021] DELETE /identity/v3/projects/422acb24c50c410bbb47480626769091 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:39.533445 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02c6b6-d0a4-47f5-8208-a18575650907 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:39.533892 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02c6b6-d0a4-47f5-8208-a18575650907 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:39.534169 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02c6b6-d0a4-47f5-8208-a18575650907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:39.551491 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-3f02c6b6-d0a4-47f5-8208-a18575650907 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:39.552741 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-3f02c6b6-d0a4-47f5-8208-a18575650907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:39.615038 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 877/1767] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:13:39.623620 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84007d-0544-40fe-9c75-36ba49db2302 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:39.623907 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84007d-0544-40fe-9c75-36ba49db2302 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:39.624187 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84007d-0544-40fe-9c75-36ba49db2302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:39.641945 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-cc84007d-0544-40fe-9c75-36ba49db2302 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:39.643139 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-cc84007d-0544-40fe-9c75-36ba49db2302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:39.651524 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 891/1768] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:39.655199 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02c6b6-d0a4-47f5-8208-a18575650907 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:39.665768 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02c6b6-d0a4-47f5-8208-a18575650907 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:39.670501 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb8e55-32c9-4a55-84e6-397a3aa68863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:39.671181 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb8e55-32c9-4a55-84e6-397a3aa68863 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:39.671568 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb8e55-32c9-4a55-84e6-397a3aa68863 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:39.671861 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb8e55-32c9-4a55-84e6-397a3aa68863 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:39.672631 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb8e55-32c9-4a55-84e6-397a3aa68863 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:13:39.672946 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb8e55-32c9-4a55-84e6-397a3aa68863 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:39.674542 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb8e55-32c9-4a55-84e6-397a3aa68863 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:39.687254 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 878/1769] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:13:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:13:39.691014 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84007d-0544-40fe-9c75-36ba49db2302 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:39.701119 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84007d-0544-40fe-9c75-36ba49db2302 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:39.706167 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb9e39-6347-458b-8cf2-6fb96dfd3a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:39.706842 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb9e39-6347-458b-8cf2-6fb96dfd3a4f admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:39.707130 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb9e39-6347-458b-8cf2-6fb96dfd3a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:39.707409 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb9e39-6347-458b-8cf2-6fb96dfd3a4f admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:39.708108 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb9e39-6347-458b-8cf2-6fb96dfd3a4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:39.710158 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb9e39-6347-458b-8cf2-6fb96dfd3a4f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:39.810252 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 892/1770] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:13:39 2021] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:13:39.814229 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb8e55-32c9-4a55-84e6-397a3aa68863 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:39.827305 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb8e55-32c9-4a55-84e6-397a3aa68863 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:39.840942 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb9e39-6347-458b-8cf2-6fb96dfd3a4f admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:39.843182 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-47fb9e39-6347-458b-8cf2-6fb96dfd3a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:39.887438 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216aeb7-6a45-4d19-b909-0400b3cb56f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:39.888128 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216aeb7-6a45-4d19-b909-0400b3cb56f5 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:39.888408 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216aeb7-6a45-4d19-b909-0400b3cb56f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:39.888716 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216aeb7-6a45-4d19-b909-0400b3cb56f5 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:39.889542 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216aeb7-6a45-4d19-b909-0400b3cb56f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:39.891566 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216aeb7-6a45-4d19-b909-0400b3cb56f5 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:39.917505 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb9e39-6347-458b-8cf2-6fb96dfd3a4f admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:39.922377 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af3da5-bdfc-497f-9b3e-4a17667e55bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:39.923418 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af3da5-bdfc-497f-9b3e-4a17667e55bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:39.923957 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af3da5-bdfc-497f-9b3e-4a17667e55bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:39.924308 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af3da5-bdfc-497f-9b3e-4a17667e55bf admin admin] PATH_INFO: `/v3/users/6dda0159a5334ae9a63d5a1ee4e2646e` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:39.925797 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af3da5-bdfc-497f-9b3e-4a17667e55bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dda0159a5334ae9a63d5a1ee4e2646e)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:39.927851 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af3da5-bdfc-497f-9b3e-4a17667e55bf admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:39.991205 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 879/1771] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:13:39 2021] POST /identity/v3/users => generated 294 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:13:39.993057 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216aeb7-6a45-4d19-b909-0400b3cb56f5 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:40.003032 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216aeb7-6a45-4d19-b909-0400b3cb56f5 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:40.008242 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9de913-f1a1-4e83-9ea9-afb82220ca8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:40.008971 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9de913-f1a1-4e83-9ea9-afb82220ca8d admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:40.009257 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9de913-f1a1-4e83-9ea9-afb82220ca8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:40.009537 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9de913-f1a1-4e83-9ea9-afb82220ca8d admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:40.010267 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9de913-f1a1-4e83-9ea9-afb82220ca8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:40.011887 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9de913-f1a1-4e83-9ea9-afb82220ca8d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:40.025052 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 880/1772] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:39 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:13:40.026062 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9de913-f1a1-4e83-9ea9-afb82220ca8d admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:40.037650 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9de913-f1a1-4e83-9ea9-afb82220ca8d admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:40.043233 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422b193-1099-4eac-888e-f7f7aed7cf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:40.043935 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422b193-1099-4eac-888e-f7f7aed7cf77 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:40.044260 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422b193-1099-4eac-888e-f7f7aed7cf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:40.044591 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422b193-1099-4eac-888e-f7f7aed7cf77 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:40.045328 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a422b193-1099-4eac-888e-f7f7aed7cf77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:40.046934 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a422b193-1099-4eac-888e-f7f7aed7cf77 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:40.057598 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 881/1773] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:40 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:13:40.063932 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422b193-1099-4eac-888e-f7f7aed7cf77 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:40.073233 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422b193-1099-4eac-888e-f7f7aed7cf77 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:40.077917 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de646f96-599c-4046-8e0e-d136365e24fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:40.078777 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de646f96-599c-4046-8e0e-d136365e24fb admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:40.079063 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de646f96-599c-4046-8e0e-d136365e24fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:40.079345 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de646f96-599c-4046-8e0e-d136365e24fb admin admin] PATH_INFO: `/v3/projects/ef4f65b412444c49ae77da3260f0aa06/users/e21128b82d44407aa7372ca8edaf423b/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:40.093568 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de646f96-599c-4046-8e0e-d136365e24fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4f65b412444c49ae77da3260f0aa06, user_id=e21128b82d44407aa7372ca8edaf423b, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:40.096206 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de646f96-599c-4046-8e0e-d136365e24fb admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:40.103804 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-c0af3da5-bdfc-497f-9b3e-4a17667e55bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dda0159a5334ae9a63d5a1ee4e2646e'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:40.104519 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-c0af3da5-bdfc-497f-9b3e-4a17667e55bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dda0159a5334ae9a63d5a1ee4e2646e'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:40.105226 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-c0af3da5-bdfc-497f-9b3e-4a17667e55bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dda0159a5334ae9a63d5a1ee4e2646e'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:40.112151 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-c0af3da5-bdfc-497f-9b3e-4a17667e55bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dda0159a5334ae9a63d5a1ee4e2646e'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:40.146677 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 882/1774] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:13:40 2021] PUT /identity/v3/projects/ef4f65b412444c49ae77da3260f0aa06/users/e21128b82d44407aa7372ca8edaf423b/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:13:40.158262 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389c155-7e38-4df3-9c10-8428ab8723d5 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:40.158403 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-c0af3da5-bdfc-497f-9b3e-4a17667e55bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dda0159a5334ae9a63d5a1ee4e2646e'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:40.158546 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389c155-7e38-4df3-9c10-8428ab8723d5 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:40.158854 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389c155-7e38-4df3-9c10-8428ab8723d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:40.175952 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 893/1775] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:13:39 2021] DELETE /identity/v3/users/6dda0159a5334ae9a63d5a1ee4e2646e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:40.180244 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f794c-7ed7-47dd-9512-698e5a2a6dbd None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:40.180569 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f794c-7ed7-47dd-9512-698e5a2a6dbd None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:40.180858 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f794c-7ed7-47dd-9512-698e5a2a6dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:40.185300 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-d389c155-7e38-4df3-9c10-8428ab8723d5 None None] MFA Rules not processed for user `e21128b82d44407aa7372ca8edaf423b`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:40.186502 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-d389c155-7e38-4df3-9c10-8428ab8723d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:40.197755 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-860f794c-7ed7-47dd-9512-698e5a2a6dbd None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:40.198958 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-860f794c-7ed7-47dd-9512-698e5a2a6dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:40.256929 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 883/1776] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:40 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:13:40.257743 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 894/1777] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:13:40.265417 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389c155-7e38-4df3-9c10-8428ab8723d5 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:40.267073 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f794c-7ed7-47dd-9512-698e5a2a6dbd None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:40.267563 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-d389c155-7e38-4df3-9c10-8428ab8723d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:40.268476 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-860f794c-7ed7-47dd-9512-698e5a2a6dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:40.281376 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389c155-7e38-4df3-9c10-8428ab8723d5 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:40.286385 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fea537-8882-4e02-98fb-7554394da5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:40.287061 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fea537-8882-4e02-98fb-7554394da5bc admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:40.287345 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fea537-8882-4e02-98fb-7554394da5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:40.287621 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fea537-8882-4e02-98fb-7554394da5bc admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:40.288324 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fea537-8882-4e02-98fb-7554394da5bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:40.290924 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fea537-8882-4e02-98fb-7554394da5bc admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:40.326466 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f794c-7ed7-47dd-9512-698e5a2a6dbd None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:40.330334 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f73d2-66c5-4915-a8a6-c07894f3a8f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:40.330864 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f73d2-66c5-4915-a8a6-c07894f3a8f7 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:40.331190 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f73d2-66c5-4915-a8a6-c07894f3a8f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:40.331475 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f73d2-66c5-4915-a8a6-c07894f3a8f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:40.341350 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f73d2-66c5-4915-a8a6-c07894f3a8f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:40.342778 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f73d2-66c5-4915-a8a6-c07894f3a8f7 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:40.352428 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 895/1778] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:13:40.384116 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 884/1779] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:13:40 2021] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:13:40.387797 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f73d2-66c5-4915-a8a6-c07894f3a8f7 service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:40.406281 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f73d2-66c5-4915-a8a6-c07894f3a8f7 service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:40.453908 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f9990-9a6d-43bb-8f94-baf2e0c25f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:40.454593 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f9990-9a6d-43bb-8f94-baf2e0c25f95 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:40.454888 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f9990-9a6d-43bb-8f94-baf2e0c25f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:40.455156 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f9990-9a6d-43bb-8f94-baf2e0c25f95 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:40.455880 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f9990-9a6d-43bb-8f94-baf2e0c25f95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:40.457847 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f9990-9a6d-43bb-8f94-baf2e0c25f95 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:40.547988 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 896/1780] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:13:40 2021] POST /identity/v3/users => generated 300 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:13:40.551940 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fea537-8882-4e02-98fb-7554394da5bc admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:40.565698 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fea537-8882-4e02-98fb-7554394da5bc admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:40.572368 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d06710-25b2-4ae4-b450-38bb56a9b22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:40.573164 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d06710-25b2-4ae4-b450-38bb56a9b22f admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:40.573477 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d06710-25b2-4ae4-b450-38bb56a9b22f admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:40.573757 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d06710-25b2-4ae4-b450-38bb56a9b22f admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:40.574600 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d06710-25b2-4ae4-b450-38bb56a9b22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:40.576694 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d06710-25b2-4ae4-b450-38bb56a9b22f admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:40.598197 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 885/1781] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:40 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:13:40.605858 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f9990-9a6d-43bb-8f94-baf2e0c25f95 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:40.619533 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f9990-9a6d-43bb-8f94-baf2e0c25f95 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:40.625595 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ac692-1c62-494d-9bfa-ee22625af953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:40.626505 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ac692-1c62-494d-9bfa-ee22625af953 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:40.626791 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ac692-1c62-494d-9bfa-ee22625af953 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:40.627071 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ac692-1c62-494d-9bfa-ee22625af953 admin admin] PATH_INFO: `/v3/projects/efdeec4901f34b84acd7a8aef09e0ce4/users/f8b70113537c4d17a9412963220c8fa5/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:40.643417 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ac692-1c62-494d-9bfa-ee22625af953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efdeec4901f34b84acd7a8aef09e0ce4, user_id=f8b70113537c4d17a9412963220c8fa5, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:40.646132 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ac692-1c62-494d-9bfa-ee22625af953 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:40.822016 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 897/1782] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:13:40 2021] PUT /identity/v3/projects/efdeec4901f34b84acd7a8aef09e0ce4/users/f8b70113537c4d17a9412963220c8fa5/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:40.822251 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d06710-25b2-4ae4-b450-38bb56a9b22f admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:40.834338 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d06710-25b2-4ae4-b450-38bb56a9b22f admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:40.881057 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ac692-1c62-494d-9bfa-ee22625af953 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:40.884806 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-c85ac692-1c62-494d-9bfa-ee22625af953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:40.920634 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528f699-de82-48b9-85e4-42836afe9640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:40.921477 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528f699-de82-48b9-85e4-42836afe9640 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:40.922140 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528f699-de82-48b9-85e4-42836afe9640 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:40.922140 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528f699-de82-48b9-85e4-42836afe9640 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:40.923270 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528f699-de82-48b9-85e4-42836afe9640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:40.925068 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528f699-de82-48b9-85e4-42836afe9640 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:40.940330 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 886/1783] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:40 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:13:40.948119 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528f699-de82-48b9-85e4-42836afe9640 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:40.966366 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528f699-de82-48b9-85e4-42836afe9640 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:40.985039 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cb8c3-5c90-411c-b4bc-598c56b478b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:40.986219 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cb8c3-5c90-411c-b4bc-598c56b478b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:40.986498 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cb8c3-5c90-411c-b4bc-598c56b478b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:40.986777 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cb8c3-5c90-411c-b4bc-598c56b478b0 admin admin] PATH_INFO: `/v3/projects/efdeec4901f34b84acd7a8aef09e0ce4/users/f8b70113537c4d17a9412963220c8fa5/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:40.988990 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cb8c3-5c90-411c-b4bc-598c56b478b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efdeec4901f34b84acd7a8aef09e0ce4, user_id=f8b70113537c4d17a9412963220c8fa5, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:40.992369 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cb8c3-5c90-411c-b4bc-598c56b478b0 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:41.005204 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ac692-1c62-494d-9bfa-ee22625af953 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:41.010548 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 887/1784] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:13:40 2021] PUT /identity/v3/projects/efdeec4901f34b84acd7a8aef09e0ce4/users/f8b70113537c4d17a9412963220c8fa5/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:41.020750 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d790e-c388-469f-bf31-7ac04b969c7a None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:41.021074 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d790e-c388-469f-bf31-7ac04b969c7a None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:41.021456 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d790e-c388-469f-bf31-7ac04b969c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:41.050246 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-e02d790e-c388-469f-bf31-7ac04b969c7a None None] MFA Rules not processed for user `f8b70113537c4d17a9412963220c8fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:41.051522 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-e02d790e-c388-469f-bf31-7ac04b969c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:41.141405 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae767f-c2a1-4d2f-a416-5c5ab6fd676b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:41.142350 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae767f-c2a1-4d2f-a416-5c5ab6fd676b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:41.142635 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae767f-c2a1-4d2f-a416-5c5ab6fd676b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:41.142960 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae767f-c2a1-4d2f-a416-5c5ab6fd676b admin admin] PATH_INFO: `/v3/projects/2c72efc1b9f442e2994883951d8043a3` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:41.144228 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae767f-c2a1-4d2f-a416-5c5ab6fd676b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c72efc1b9f442e2994883951d8043a3)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:41.147074 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae767f-c2a1-4d2f-a416-5c5ab6fd676b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:41.148255 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 888/1785] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:41 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:13:41.309501 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d790e-c388-469f-bf31-7ac04b969c7a None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:41.310509 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-04ae767f-c2a1-4d2f-a416-5c5ab6fd676b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c72efc1b9f442e2994883951d8043a3', 'request_id': 'req-04ae767f-c2a1-4d2f-a416-5c5ab6fd676b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:41.311103 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-e02d790e-c388-469f-bf31-7ac04b969c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:41.365916 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d790e-c388-469f-bf31-7ac04b969c7a None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:41.404399 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-04ae767f-c2a1-4d2f-a416-5c5ab6fd676b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c72efc1b9f442e2994883951d8043a3', 'request_id': 'req-04ae767f-c2a1-4d2f-a416-5c5ab6fd676b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:41.412196 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-04ae767f-c2a1-4d2f-a416-5c5ab6fd676b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c72efc1b9f442e2994883951d8043a3', 'request_id': 'req-04ae767f-c2a1-4d2f-a416-5c5ab6fd676b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:41.417631 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bcf653-5dbb-46e2-9303-26c829c089dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:41.418289 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcf653-5dbb-46e2-9303-26c829c089dc service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:41.418577 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcf653-5dbb-46e2-9303-26c829c089dc service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:41.418857 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcf653-5dbb-46e2-9303-26c829c089dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:41.426054 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-04ae767f-c2a1-4d2f-a416-5c5ab6fd676b admin admin] The token cache is being invalidate because project 2c72efc1b9f442e2994883951d8043a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:13:41.426054 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-04ae767f-c2a1-4d2f-a416-5c5ab6fd676b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:41.428356 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-04ae767f-c2a1-4d2f-a416-5c5ab6fd676b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:41.428586 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 898/1786] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:13:40 2021] DELETE /identity/v3/projects/2c72efc1b9f442e2994883951d8043a3 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:13:41.434980 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b8c50-60f3-4467-b29b-b53904905d15 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:41.442353 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b8c50-60f3-4467-b29b-b53904905d15 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:41.442353 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b8c50-60f3-4467-b29b-b53904905d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:41.453933 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-281b8c50-60f3-4467-b29b-b53904905d15 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:41.455239 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-281b8c50-60f3-4467-b29b-b53904905d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:41.493316 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bcf653-5dbb-46e2-9303-26c829c089dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:41.496090 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bcf653-5dbb-46e2-9303-26c829c089dc service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:41.514592 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 889/1787] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:41 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:13:41.549671 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 899/1788] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:41.556735 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579399b-1dc4-4e7c-919a-cbdcc8dbe2a5 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:41.557220 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579399b-1dc4-4e7c-919a-cbdcc8dbe2a5 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:41.557389 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579399b-1dc4-4e7c-919a-cbdcc8dbe2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:41.575393 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-e579399b-1dc4-4e7c-919a-cbdcc8dbe2a5 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:41.579397 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-e579399b-1dc4-4e7c-919a-cbdcc8dbe2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:41.585286 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 890/1789] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:13:41.589353 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b8c50-60f3-4467-b29b-b53904905d15 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:41.598861 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b8c50-60f3-4467-b29b-b53904905d15 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:41.603511 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf409360-0712-4f5f-9d21-3fc087fc62e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:41.604172 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf409360-0712-4f5f-9d21-3fc087fc62e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:41.604448 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf409360-0712-4f5f-9d21-3fc087fc62e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:41.604757 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf409360-0712-4f5f-9d21-3fc087fc62e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:41.605475 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf409360-0712-4f5f-9d21-3fc087fc62e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:13:41.605780 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf409360-0712-4f5f-9d21-3fc087fc62e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:41.607353 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf409360-0712-4f5f-9d21-3fc087fc62e5 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:41.620012 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 900/1790] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:13:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:13:41.624231 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579399b-1dc4-4e7c-919a-cbdcc8dbe2a5 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:41.633504 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579399b-1dc4-4e7c-919a-cbdcc8dbe2a5 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:41.638334 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648f55e-049e-4cbd-9b5c-b23fdc30d9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:41.638988 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648f55e-049e-4cbd-9b5c-b23fdc30d9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:41.639273 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648f55e-049e-4cbd-9b5c-b23fdc30d9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:41.639545 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648f55e-049e-4cbd-9b5c-b23fdc30d9c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:41.640221 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648f55e-049e-4cbd-9b5c-b23fdc30d9c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:41.642146 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648f55e-049e-4cbd-9b5c-b23fdc30d9c9 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:41.766849 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 891/1791] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:13:41 2021] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:13:41.771290 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf409360-0712-4f5f-9d21-3fc087fc62e5 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:41.782097 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf409360-0712-4f5f-9d21-3fc087fc62e5 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:41.841659 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8cd30-12c6-492c-9a93-e801c0f90f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:41.842333 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8cd30-12c6-492c-9a93-e801c0f90f88 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:41.842617 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8cd30-12c6-492c-9a93-e801c0f90f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:41.842999 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8cd30-12c6-492c-9a93-e801c0f90f88 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:41.843623 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8cd30-12c6-492c-9a93-e801c0f90f88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:41.845593 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8cd30-12c6-492c-9a93-e801c0f90f88 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:41.958738 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 901/1792] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:13:41 2021] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:13:41.963412 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648f55e-049e-4cbd-9b5c-b23fdc30d9c9 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:41.973480 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648f55e-049e-4cbd-9b5c-b23fdc30d9c9 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:41.978189 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa18b4d-7db1-46e4-806f-c97c209f98b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:41.978864 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa18b4d-7db1-46e4-806f-c97c209f98b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:41.979152 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa18b4d-7db1-46e4-806f-c97c209f98b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:41.979433 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa18b4d-7db1-46e4-806f-c97c209f98b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:41.980152 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa18b4d-7db1-46e4-806f-c97c209f98b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:41.981787 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa18b4d-7db1-46e4-806f-c97c209f98b6 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:41.995010 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 892/1793] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:41 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:13:41.997027 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8cd30-12c6-492c-9a93-e801c0f90f88 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:42.006820 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8cd30-12c6-492c-9a93-e801c0f90f88 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:42.011931 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf003e-bb36-4925-b853-6bd1a911dfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:42.012628 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf003e-bb36-4925-b853-6bd1a911dfe0 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:42.012916 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf003e-bb36-4925-b853-6bd1a911dfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:42.013193 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf003e-bb36-4925-b853-6bd1a911dfe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:42.013920 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf003e-bb36-4925-b853-6bd1a911dfe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:42.015503 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf003e-bb36-4925-b853-6bd1a911dfe0 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:42.025210 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 902/1794] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:41 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:13:42.029257 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa18b4d-7db1-46e4-806f-c97c209f98b6 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:42.039660 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa18b4d-7db1-46e4-806f-c97c209f98b6 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:42.044508 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dadd6-107d-4d10-b71b-ff4a86774bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:42.045429 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dadd6-107d-4d10-b71b-ff4a86774bbd admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:42.045708 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dadd6-107d-4d10-b71b-ff4a86774bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:42.045993 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dadd6-107d-4d10-b71b-ff4a86774bbd admin admin] PATH_INFO: `/v3/projects/aefdbd026e5e4f5da85798637a4aa1f9/users/9f4e9775eee142e19db6132e5cbe4b08/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:42.062411 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50dadd6-107d-4d10-b71b-ff4a86774bbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=aefdbd026e5e4f5da85798637a4aa1f9, user_id=9f4e9775eee142e19db6132e5cbe4b08, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:42.065245 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50dadd6-107d-4d10-b71b-ff4a86774bbd admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:42.140920 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 893/1795] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:13:42 2021] PUT /identity/v3/projects/aefdbd026e5e4f5da85798637a4aa1f9/users/9f4e9775eee142e19db6132e5cbe4b08/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:42.152836 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d3fc3-5f02-4aea-a189-5432fec57034 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:42.153124 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d3fc3-5f02-4aea-a189-5432fec57034 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:42.153400 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d3fc3-5f02-4aea-a189-5432fec57034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:42.184176 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-8a9d3fc3-5f02-4aea-a189-5432fec57034 None None] MFA Rules not processed for user `9f4e9775eee142e19db6132e5cbe4b08`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:42.184176 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-8a9d3fc3-5f02-4aea-a189-5432fec57034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:42.251312 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 903/1796] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:42 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:42.255923 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dadd6-107d-4d10-b71b-ff4a86774bbd admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:42.324295 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dadd6-107d-4d10-b71b-ff4a86774bbd admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:42.329249 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a457ea6-8d7b-4b61-a1e1-208bf9b9d586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:42.329927 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a457ea6-8d7b-4b61-a1e1-208bf9b9d586 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:42.330205 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a457ea6-8d7b-4b61-a1e1-208bf9b9d586 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:42.330489 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a457ea6-8d7b-4b61-a1e1-208bf9b9d586 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:42.331229 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a457ea6-8d7b-4b61-a1e1-208bf9b9d586 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:42.333265 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a457ea6-8d7b-4b61-a1e1-208bf9b9d586 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:42.434818 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 894/1797] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:13:42 2021] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:13:42.438774 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d3fc3-5f02-4aea-a189-5432fec57034 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:42.449340 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d3fc3-5f02-4aea-a189-5432fec57034 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:42.503264 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17407f19-9e6a-4cad-9e66-47c0e14a1700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:42.503937 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17407f19-9e6a-4cad-9e66-47c0e14a1700 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:42.504222 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17407f19-9e6a-4cad-9e66-47c0e14a1700 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:42.504525 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17407f19-9e6a-4cad-9e66-47c0e14a1700 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:42.505217 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17407f19-9e6a-4cad-9e66-47c0e14a1700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:42.507532 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17407f19-9e6a-4cad-9e66-47c0e14a1700 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:42.611181 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 904/1798] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:13:42 2021] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:13:42.615219 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a457ea6-8d7b-4b61-a1e1-208bf9b9d586 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:42.625291 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a457ea6-8d7b-4b61-a1e1-208bf9b9d586 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:42.629943 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4921458-665c-4493-a53b-5bdbdd2de7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:42.630607 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4921458-665c-4493-a53b-5bdbdd2de7ec admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:42.630890 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4921458-665c-4493-a53b-5bdbdd2de7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:42.631166 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4921458-665c-4493-a53b-5bdbdd2de7ec admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:42.631885 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4921458-665c-4493-a53b-5bdbdd2de7ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:42.633991 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4921458-665c-4493-a53b-5bdbdd2de7ec admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:42.645492 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 895/1799] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:42 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:13:42.651445 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17407f19-9e6a-4cad-9e66-47c0e14a1700 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:42.661444 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17407f19-9e6a-4cad-9e66-47c0e14a1700 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:42.666631 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9db09e-dd99-4f79-89af-ab5bf556d402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:42.667548 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db09e-dd99-4f79-89af-ab5bf556d402 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:42.667978 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db09e-dd99-4f79-89af-ab5bf556d402 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:42.668263 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db09e-dd99-4f79-89af-ab5bf556d402 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:42.669124 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9db09e-dd99-4f79-89af-ab5bf556d402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:42.670898 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9db09e-dd99-4f79-89af-ab5bf556d402 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:42.681708 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 905/1800] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:42 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:13:42.686015 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4921458-665c-4493-a53b-5bdbdd2de7ec admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:42.696888 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4921458-665c-4493-a53b-5bdbdd2de7ec admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:42.704723 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce17c08-97f1-43fb-992e-4369be5d39ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:42.704723 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce17c08-97f1-43fb-992e-4369be5d39ec admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:42.704723 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce17c08-97f1-43fb-992e-4369be5d39ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:42.704723 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce17c08-97f1-43fb-992e-4369be5d39ec admin admin] PATH_INFO: `/v3/projects/6b676fc31c0045b1b244fc935633ba2e/users/595616d5c0aa4ebc8f9cc9ff3cea1871/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:42.722340 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9db09e-dd99-4f79-89af-ab5bf556d402 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:42.723332 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce17c08-97f1-43fb-992e-4369be5d39ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b676fc31c0045b1b244fc935633ba2e, user_id=595616d5c0aa4ebc8f9cc9ff3cea1871, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:42.724638 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-bf9db09e-dd99-4f79-89af-ab5bf556d402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:42.726459 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce17c08-97f1-43fb-992e-4369be5d39ec admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:42.741445 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9db09e-dd99-4f79-89af-ab5bf556d402 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:42.746229 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb80c9-41d4-4764-a48a-3c076113a312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:42.747098 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb80c9-41d4-4764-a48a-3c076113a312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:42.747379 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb80c9-41d4-4764-a48a-3c076113a312 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:42.747654 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb80c9-41d4-4764-a48a-3c076113a312 admin admin] PATH_INFO: `/v3/users/e21128b82d44407aa7372ca8edaf423b` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:42.748894 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb80c9-41d4-4764-a48a-3c076113a312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e21128b82d44407aa7372ca8edaf423b)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:42.750880 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb80c9-41d4-4764-a48a-3c076113a312 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:42.857668 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 896/1801] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:13:42 2021] PUT /identity/v3/projects/6b676fc31c0045b1b244fc935633ba2e/users/595616d5c0aa4ebc8f9cc9ff3cea1871/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:13:42.860396 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ffb0b-4175-4d5c-a8a9-2e8e93f9d902 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:42.860740 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ffb0b-4175-4d5c-a8a9-2e8e93f9d902 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:42.861021 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ffb0b-4175-4d5c-a8a9-2e8e93f9d902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:42.886484 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-e27ffb0b-4175-4d5c-a8a9-2e8e93f9d902 None None] MFA Rules not processed for user `595616d5c0aa4ebc8f9cc9ff3cea1871`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:42.892650 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-e27ffb0b-4175-4d5c-a8a9-2e8e93f9d902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:42.948236 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 897/1802] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:42 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:13:42.952616 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ffb0b-4175-4d5c-a8a9-2e8e93f9d902 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:42.994411 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-68cb80c9-41d4-4764-a48a-3c076113a312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e21128b82d44407aa7372ca8edaf423b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:42.995653 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-68cb80c9-41d4-4764-a48a-3c076113a312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e21128b82d44407aa7372ca8edaf423b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:42.995761 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-68cb80c9-41d4-4764-a48a-3c076113a312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e21128b82d44407aa7372ca8edaf423b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:43.002324 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-68cb80c9-41d4-4764-a48a-3c076113a312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e21128b82d44407aa7372ca8edaf423b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:43.011313 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ffb0b-4175-4d5c-a8a9-2e8e93f9d902 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:43.015955 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb369d4-e7a0-44ab-a081-c9a1d317e707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:43.016666 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb369d4-e7a0-44ab-a081-c9a1d317e707 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:43.016955 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb369d4-e7a0-44ab-a081-c9a1d317e707 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:43.017238 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb369d4-e7a0-44ab-a081-c9a1d317e707 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:43.017917 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb369d4-e7a0-44ab-a081-c9a1d317e707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:43.019802 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb369d4-e7a0-44ab-a081-c9a1d317e707 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:43.071732 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-68cb80c9-41d4-4764-a48a-3c076113a312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e21128b82d44407aa7372ca8edaf423b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:43.088728 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 906/1803] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:13:42 2021] DELETE /identity/v3/users/e21128b82d44407aa7372ca8edaf423b => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:13:43.093031 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a852ab5-ebe6-407e-ab02-89ad40171f98 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:43.093325 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a852ab5-ebe6-407e-ab02-89ad40171f98 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:43.093606 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a852ab5-ebe6-407e-ab02-89ad40171f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:43.108749 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 898/1804] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:13:42 2021] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:13:43.110693 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-8a852ab5-ebe6-407e-ab02-89ad40171f98 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:43.112048 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-8a852ab5-ebe6-407e-ab02-89ad40171f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:43.113007 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb369d4-e7a0-44ab-a081-c9a1d317e707 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:43.114622 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-0eb369d4-e7a0-44ab-a081-c9a1d317e707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:43.168325 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 907/1805] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:13:43.175364 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb369d4-e7a0-44ab-a081-c9a1d317e707 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:43.178314 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a852ab5-ebe6-407e-ab02-89ad40171f98 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:43.180152 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-8a852ab5-ebe6-407e-ab02-89ad40171f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:43.181046 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81476d01-f186-44aa-8ea5-89bac5bbc220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:43.181802 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81476d01-f186-44aa-8ea5-89bac5bbc220 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:43.182162 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81476d01-f186-44aa-8ea5-89bac5bbc220 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:43.182514 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81476d01-f186-44aa-8ea5-89bac5bbc220 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:43.183272 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81476d01-f186-44aa-8ea5-89bac5bbc220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:43.185279 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81476d01-f186-44aa-8ea5-89bac5bbc220 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:43.233901 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a852ab5-ebe6-407e-ab02-89ad40171f98 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:43.237850 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0e93e-5858-451c-9f36-035f14f0b5ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:43.238512 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0e93e-5858-451c-9f36-035f14f0b5ef service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:43.238796 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0e93e-5858-451c-9f36-035f14f0b5ef service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:43.239073 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0e93e-5858-451c-9f36-035f14f0b5ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:43.249826 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0e93e-5858-451c-9f36-035f14f0b5ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:43.251267 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0e93e-5858-451c-9f36-035f14f0b5ef service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:43.260612 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 899/1806] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:13:43 2021] POST /identity/v3/users => generated 298 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:13:43.261136 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 908/1807] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:13:43.264398 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81476d01-f186-44aa-8ea5-89bac5bbc220 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:43.274722 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81476d01-f186-44aa-8ea5-89bac5bbc220 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:43.279770 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb877d2-b341-4775-8cb6-faa65fc9338b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:43.280444 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb877d2-b341-4775-8cb6-faa65fc9338b admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:43.280760 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb877d2-b341-4775-8cb6-faa65fc9338b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:43.281041 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb877d2-b341-4775-8cb6-faa65fc9338b admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:43.281764 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb877d2-b341-4775-8cb6-faa65fc9338b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:43.283399 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb877d2-b341-4775-8cb6-faa65fc9338b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:43.296383 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 900/1808] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:43 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:13:43.297964 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0e93e-5858-451c-9f36-035f14f0b5ef service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:43.314666 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0e93e-5858-451c-9f36-035f14f0b5ef service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:43.319619 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f58b53-ae10-443f-887d-4c9218c1a004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:43.320605 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f58b53-ae10-443f-887d-4c9218c1a004 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:43.320889 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f58b53-ae10-443f-887d-4c9218c1a004 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:43.321167 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f58b53-ae10-443f-887d-4c9218c1a004 admin admin] PATH_INFO: `/v3/projects/0800d1533d534b1f9dfe1d844e46857a/users/8d396880eef34aa787a0f92249f616d5/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:43.336725 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f58b53-ae10-443f-887d-4c9218c1a004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0800d1533d534b1f9dfe1d844e46857a, user_id=8d396880eef34aa787a0f92249f616d5, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:43.339950 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f58b53-ae10-443f-887d-4c9218c1a004 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:43.417638 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 909/1809] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:13:43 2021] PUT /identity/v3/projects/0800d1533d534b1f9dfe1d844e46857a/users/8d396880eef34aa787a0f92249f616d5/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:43.421703 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb877d2-b341-4775-8cb6-faa65fc9338b admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:43.432683 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb877d2-b341-4775-8cb6-faa65fc9338b admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:43.493245 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84d6f9-ccdf-4dd7-9b5b-5653c6619317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:43.494035 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84d6f9-ccdf-4dd7-9b5b-5653c6619317 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:43.494321 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84d6f9-ccdf-4dd7-9b5b-5653c6619317 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:43.494598 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84d6f9-ccdf-4dd7-9b5b-5653c6619317 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:43.495445 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84d6f9-ccdf-4dd7-9b5b-5653c6619317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:43.497060 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84d6f9-ccdf-4dd7-9b5b-5653c6619317 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:43.507503 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 901/1810] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:43 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:13:43.516993 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f58b53-ae10-443f-887d-4c9218c1a004 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:43.527559 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f58b53-ae10-443f-887d-4c9218c1a004 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:43.532647 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819537cc-c80e-468f-9b67-2a6d4004f85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:43.534350 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819537cc-c80e-468f-9b67-2a6d4004f85c admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:43.534624 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819537cc-c80e-468f-9b67-2a6d4004f85c admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:43.534904 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819537cc-c80e-468f-9b67-2a6d4004f85c admin admin] PATH_INFO: `/v3/projects/0800d1533d534b1f9dfe1d844e46857a/users/8d396880eef34aa787a0f92249f616d5/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:43.537261 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819537cc-c80e-468f-9b67-2a6d4004f85c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0800d1533d534b1f9dfe1d844e46857a, user_id=8d396880eef34aa787a0f92249f616d5, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:43.540829 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819537cc-c80e-468f-9b67-2a6d4004f85c admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:43.574946 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 910/1811] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:13:43 2021] PUT /identity/v3/projects/0800d1533d534b1f9dfe1d844e46857a/users/8d396880eef34aa787a0f92249f616d5/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:43.585507 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc17ad-ef26-44be-9a1e-c9cd8efa051d None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:43.585880 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc17ad-ef26-44be-9a1e-c9cd8efa051d None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:43.586255 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc17ad-ef26-44be-9a1e-c9cd8efa051d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:43.616541 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-3adc17ad-ef26-44be-9a1e-c9cd8efa051d None None] MFA Rules not processed for user `8d396880eef34aa787a0f92249f616d5`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:43.618132 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-3adc17ad-ef26-44be-9a1e-c9cd8efa051d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:43.688789 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 902/1812] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:43 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:13:43.699745 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819537cc-c80e-468f-9b67-2a6d4004f85c admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:43.701536 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-819537cc-c80e-468f-9b67-2a6d4004f85c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:43.760645 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc17ad-ef26-44be-9a1e-c9cd8efa051d None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:43.762454 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-3adc17ad-ef26-44be-9a1e-c9cd8efa051d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:43.765147 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819537cc-c80e-468f-9b67-2a6d4004f85c admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:43.769107 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efdc68-2647-49aa-a197-3c9190be0a40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:43.769901 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efdc68-2647-49aa-a197-3c9190be0a40 service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:43.770190 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efdc68-2647-49aa-a197-3c9190be0a40 service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:43.770467 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efdc68-2647-49aa-a197-3c9190be0a40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:43.772302 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-11efdc68-2647-49aa-a197-3c9190be0a40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:43.845781 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efdc68-2647-49aa-a197-3c9190be0a40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:43.847463 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efdc68-2647-49aa-a197-3c9190be0a40 service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:43.849577 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc17ad-ef26-44be-9a1e-c9cd8efa051d None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:43.856131 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d864e-1dd6-4dd6-8063-a3ffc549e633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:43.856705 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 911/1813] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:43 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:13:43.861184 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d864e-1dd6-4dd6-8063-a3ffc549e633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:43.861983 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d864e-1dd6-4dd6-8063-a3ffc549e633 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:43.861983 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d864e-1dd6-4dd6-8063-a3ffc549e633 admin admin] PATH_INFO: `/v3/projects/ef4f65b412444c49ae77da3260f0aa06` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:43.863311 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d864e-1dd6-4dd6-8063-a3ffc549e633 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef4f65b412444c49ae77da3260f0aa06)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:43.865450 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d864e-1dd6-4dd6-8063-a3ffc549e633 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:43.975390 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-299d864e-1dd6-4dd6-8063-a3ffc549e633 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef4f65b412444c49ae77da3260f0aa06', 'request_id': 'req-299d864e-1dd6-4dd6-8063-a3ffc549e633'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:44.032470 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-299d864e-1dd6-4dd6-8063-a3ffc549e633 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef4f65b412444c49ae77da3260f0aa06', 'request_id': 'req-299d864e-1dd6-4dd6-8063-a3ffc549e633'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:44.038061 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-299d864e-1dd6-4dd6-8063-a3ffc549e633 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef4f65b412444c49ae77da3260f0aa06', 'request_id': 'req-299d864e-1dd6-4dd6-8063-a3ffc549e633'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:44.049513 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-299d864e-1dd6-4dd6-8063-a3ffc549e633 admin admin] The token cache is being invalidate because project ef4f65b412444c49ae77da3260f0aa06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:13:44.049788 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-299d864e-1dd6-4dd6-8063-a3ffc549e633 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:44.050441 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-299d864e-1dd6-4dd6-8063-a3ffc549e633 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:44.051996 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 903/1814] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:13:43 2021] DELETE /identity/v3/projects/ef4f65b412444c49ae77da3260f0aa06 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:44.056196 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efdc68-2647-49aa-a197-3c9190be0a40 service cinder] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:44.066918 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efdc68-2647-49aa-a197-3c9190be0a40 service cinder] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:44.123355 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213aa2d5-800f-4caf-86ec-2112b61ba559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:44.124161 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213aa2d5-800f-4caf-86ec-2112b61ba559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:44.124442 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213aa2d5-800f-4caf-86ec-2112b61ba559 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:44.124747 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213aa2d5-800f-4caf-86ec-2112b61ba559 admin admin] PATH_INFO: `/v3/users/f8b70113537c4d17a9412963220c8fa5` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:44.125967 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213aa2d5-800f-4caf-86ec-2112b61ba559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8b70113537c4d17a9412963220c8fa5)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:44.127862 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213aa2d5-800f-4caf-86ec-2112b61ba559 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:44.308198 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-213aa2d5-800f-4caf-86ec-2112b61ba559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8b70113537c4d17a9412963220c8fa5'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:44.308872 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-213aa2d5-800f-4caf-86ec-2112b61ba559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8b70113537c4d17a9412963220c8fa5'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:44.309491 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-213aa2d5-800f-4caf-86ec-2112b61ba559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8b70113537c4d17a9412963220c8fa5'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:44.316079 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-213aa2d5-800f-4caf-86ec-2112b61ba559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8b70113537c4d17a9412963220c8fa5'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:44.381371 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-213aa2d5-800f-4caf-86ec-2112b61ba559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8b70113537c4d17a9412963220c8fa5'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:44.401632 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 912/1815] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:13:44 2021] DELETE /identity/v3/users/f8b70113537c4d17a9412963220c8fa5 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:13:44.942964 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d864e-1dd6-4dd6-8063-a3ffc549e633 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:44.947908 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-299d864e-1dd6-4dd6-8063-a3ffc549e633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:44.959370 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d864e-1dd6-4dd6-8063-a3ffc549e633 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:45.016595 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006cc69-c1cf-4dea-b0ba-7a81cf658c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:45.017468 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006cc69-c1cf-4dea-b0ba-7a81cf658c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:45.017754 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006cc69-c1cf-4dea-b0ba-7a81cf658c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:45.018034 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006cc69-c1cf-4dea-b0ba-7a81cf658c9b admin admin] PATH_INFO: `/v3/projects/efdeec4901f34b84acd7a8aef09e0ce4` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:45.019227 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006cc69-c1cf-4dea-b0ba-7a81cf658c9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=efdeec4901f34b84acd7a8aef09e0ce4)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:45.021184 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006cc69-c1cf-4dea-b0ba-7a81cf658c9b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:45.118227 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-6006cc69-c1cf-4dea-b0ba-7a81cf658c9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efdeec4901f34b84acd7a8aef09e0ce4', 'request_id': 'req-6006cc69-c1cf-4dea-b0ba-7a81cf658c9b'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:45.192711 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-6006cc69-c1cf-4dea-b0ba-7a81cf658c9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efdeec4901f34b84acd7a8aef09e0ce4', 'request_id': 'req-6006cc69-c1cf-4dea-b0ba-7a81cf658c9b'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:45.198660 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-6006cc69-c1cf-4dea-b0ba-7a81cf658c9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efdeec4901f34b84acd7a8aef09e0ce4', 'request_id': 'req-6006cc69-c1cf-4dea-b0ba-7a81cf658c9b'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:45.209361 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-6006cc69-c1cf-4dea-b0ba-7a81cf658c9b admin admin] The token cache is being invalidate because project efdeec4901f34b84acd7a8aef09e0ce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:13:45.209651 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-6006cc69-c1cf-4dea-b0ba-7a81cf658c9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:45.211118 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-6006cc69-c1cf-4dea-b0ba-7a81cf658c9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:13:45.212766 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 904/1816] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:13:44 2021] DELETE /identity/v3/projects/efdeec4901f34b84acd7a8aef09e0ce4 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:13:45.218643 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8b1ff-445c-4b2d-9dff-cf30771d700a None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:45.219111 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8b1ff-445c-4b2d-9dff-cf30771d700a None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:45.219230 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8b1ff-445c-4b2d-9dff-cf30771d700a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:45.237203 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-e1c8b1ff-445c-4b2d-9dff-cf30771d700a None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:45.238384 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-e1c8b1ff-445c-4b2d-9dff-cf30771d700a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:45.294403 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 913/1817] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:45.302238 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4117f8-9f31-4cb0-9316-33a7ca2b1b56 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:45.302525 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4117f8-9f31-4cb0-9316-33a7ca2b1b56 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:45.302801 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4117f8-9f31-4cb0-9316-33a7ca2b1b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:45.322570 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-ef4117f8-9f31-4cb0-9316-33a7ca2b1b56 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:45.323776 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-ef4117f8-9f31-4cb0-9316-33a7ca2b1b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:45.331561 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 905/1818] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:45.335589 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8b1ff-445c-4b2d-9dff-cf30771d700a None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:45.345138 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8b1ff-445c-4b2d-9dff-cf30771d700a None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:45.349787 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee9df6-643a-4aa3-a9dc-acbe568d1bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:45.350442 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee9df6-643a-4aa3-a9dc-acbe568d1bbd admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:45.350725 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee9df6-643a-4aa3-a9dc-acbe568d1bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:45.351002 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee9df6-643a-4aa3-a9dc-acbe568d1bbd admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:45.351721 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee9df6-643a-4aa3-a9dc-acbe568d1bbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:13:45.352031 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee9df6-643a-4aa3-a9dc-acbe568d1bbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:45.353643 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee9df6-643a-4aa3-a9dc-acbe568d1bbd admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:45.364971 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 914/1819] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:13:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:13:45.369337 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4117f8-9f31-4cb0-9316-33a7ca2b1b56 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:45.378141 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4117f8-9f31-4cb0-9316-33a7ca2b1b56 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:45.383296 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e5ea6-c1e4-4041-b166-9edbf21cbf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:45.383941 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e5ea6-c1e4-4041-b166-9edbf21cbf07 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:45.384243 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e5ea6-c1e4-4041-b166-9edbf21cbf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:45.384544 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e5ea6-c1e4-4041-b166-9edbf21cbf07 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:45.385243 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e5ea6-c1e4-4041-b166-9edbf21cbf07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:45.387133 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e5ea6-c1e4-4041-b166-9edbf21cbf07 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:45.487559 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 906/1820] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:13:45 2021] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:13:45.492304 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee9df6-643a-4aa3-a9dc-acbe568d1bbd admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:45.504021 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee9df6-643a-4aa3-a9dc-acbe568d1bbd admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:45.558872 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e87e1e-90ec-4096-9f21-094c878f4373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:45.559550 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e87e1e-90ec-4096-9f21-094c878f4373 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:45.559837 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e87e1e-90ec-4096-9f21-094c878f4373 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:45.560115 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e87e1e-90ec-4096-9f21-094c878f4373 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:45.560836 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e87e1e-90ec-4096-9f21-094c878f4373 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:45.562764 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e87e1e-90ec-4096-9f21-094c878f4373 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:45.708692 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 915/1821] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:13:45 2021] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:13:45.711618 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e5ea6-c1e4-4041-b166-9edbf21cbf07 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:45.721821 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e5ea6-c1e4-4041-b166-9edbf21cbf07 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:45.727186 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815f600-31d0-4f41-a706-f6b08362b431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:45.727894 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815f600-31d0-4f41-a706-f6b08362b431 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:45.728181 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815f600-31d0-4f41-a706-f6b08362b431 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:45.728465 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815f600-31d0-4f41-a706-f6b08362b431 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:45.729453 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815f600-31d0-4f41-a706-f6b08362b431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:45.731230 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815f600-31d0-4f41-a706-f6b08362b431 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:45.744949 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 907/1822] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:45 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:13:45.746680 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e87e1e-90ec-4096-9f21-094c878f4373 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:45.756867 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e87e1e-90ec-4096-9f21-094c878f4373 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:45.761807 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e030b-d392-478c-9a06-af1d0cdb2c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:45.762479 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e030b-d392-478c-9a06-af1d0cdb2c18 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:45.762765 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e030b-d392-478c-9a06-af1d0cdb2c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:45.763040 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e030b-d392-478c-9a06-af1d0cdb2c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:45.763760 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e030b-d392-478c-9a06-af1d0cdb2c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:45.765390 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e030b-d392-478c-9a06-af1d0cdb2c18 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:45.775930 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 916/1823] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:13:45 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:13:45.780122 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815f600-31d0-4f41-a706-f6b08362b431 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:45.790416 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815f600-31d0-4f41-a706-f6b08362b431 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:45.794924 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9db7ad-55e1-4b28-b347-437b847edbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:45.795975 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9db7ad-55e1-4b28-b347-437b847edbe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:45.796262 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9db7ad-55e1-4b28-b347-437b847edbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:45.796703 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9db7ad-55e1-4b28-b347-437b847edbe4 admin admin] PATH_INFO: `/v3/projects/6890bc95a89444e396791913437cac11/users/edc08d934ebc4f93b077aa217c19c16b/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:45.813409 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9db7ad-55e1-4b28-b347-437b847edbe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6890bc95a89444e396791913437cac11, user_id=edc08d934ebc4f93b077aa217c19c16b, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:45.816203 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9db7ad-55e1-4b28-b347-437b847edbe4 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:45.895603 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 908/1824] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:13:45 2021] PUT /identity/v3/projects/6890bc95a89444e396791913437cac11/users/edc08d934ebc4f93b077aa217c19c16b/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:13:45.907066 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6aa698-98df-4d18-8fe6-6dd8787bd56a None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:45.907438 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6aa698-98df-4d18-8fe6-6dd8787bd56a None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:45.907721 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6aa698-98df-4d18-8fe6-6dd8787bd56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:45.935163 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-1e6aa698-98df-4d18-8fe6-6dd8787bd56a None None] MFA Rules not processed for user `edc08d934ebc4f93b077aa217c19c16b`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:45.936430 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-1e6aa698-98df-4d18-8fe6-6dd8787bd56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:46.002816 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 917/1825] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:13:45 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:46.013579 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9db7ad-55e1-4b28-b347-437b847edbe4 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:46.015266 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-6e9db7ad-55e1-4b28-b347-437b847edbe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:46.068316 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9db7ad-55e1-4b28-b347-437b847edbe4 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:46.072855 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade5852-f6ab-40fd-a730-b58dd57a08f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:46.073506 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade5852-f6ab-40fd-a730-b58dd57a08f6 service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:46.073789 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade5852-f6ab-40fd-a730-b58dd57a08f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:46.074068 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade5852-f6ab-40fd-a730-b58dd57a08f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:46.082463 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade5852-f6ab-40fd-a730-b58dd57a08f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:46.083883 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade5852-f6ab-40fd-a730-b58dd57a08f6 service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:46.092605 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 909/1826] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:46 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:13:51.813463 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178d37b-79cf-48a4-a381-0af72d3a574c None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:51.813958 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178d37b-79cf-48a4-a381-0af72d3a574c None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:51.814280 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178d37b-79cf-48a4-a381-0af72d3a574c None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:51.822090 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 918/1827] 10.222.0.23 () {54 vars in 921 bytes} [Thu Sep 23 03:13:51 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 03:13:51.833924 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb00dd-f510-410b-928c-dab721ecaf64 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:51.834369 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb00dd-f510-410b-928c-dab721ecaf64 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:51.834504 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb00dd-f510-410b-928c-dab721ecaf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:51.857890 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-b8eb00dd-f510-410b-928c-dab721ecaf64 None None] MFA Rules not processed for user `83aa47f723434143b22aac1b96b6a610`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:13:51.859081 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-b8eb00dd-f510-410b-928c-dab721ecaf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:51.962309 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 910/1828] 10.222.0.23 () {58 vars in 1019 bytes} [Thu Sep 23 03:13:51 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:13:52.024766 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178d37b-79cf-48a4-a381-0af72d3a574c None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:52.026451 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-f178d37b-79cf-48a4-a381-0af72d3a574c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:52.044958 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178d37b-79cf-48a4-a381-0af72d3a574c None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:52.050579 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522714e-1175-433b-802d-21159e56a003 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:52.051229 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522714e-1175-433b-802d-21159e56a003 service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:52.051513 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522714e-1175-433b-802d-21159e56a003 service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:52.051790 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522714e-1175-433b-802d-21159e56a003 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:52.060547 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522714e-1175-433b-802d-21159e56a003 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:52.062111 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522714e-1175-433b-802d-21159e56a003 service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:52.072183 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 919/1829] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:52 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:13:54.295877 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb00dd-f510-410b-928c-dab721ecaf64 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:54.297457 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-b8eb00dd-f510-410b-928c-dab721ecaf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:54.310363 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb00dd-f510-410b-928c-dab721ecaf64 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:54.314166 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6728ae-96f8-47d9-81fc-d82b480aea86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:54.315013 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6728ae-96f8-47d9-81fc-d82b480aea86 service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:54.315306 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6728ae-96f8-47d9-81fc-d82b480aea86 service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:54.315581 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6728ae-96f8-47d9-81fc-d82b480aea86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:54.317563 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-bf6728ae-96f8-47d9-81fc-d82b480aea86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:54.387322 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6728ae-96f8-47d9-81fc-d82b480aea86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:54.388788 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6728ae-96f8-47d9-81fc-d82b480aea86 service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:54.401360 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 911/1830] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:54 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:13:56.252182 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522714e-1175-433b-802d-21159e56a003 service nova] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:13:56.261295 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522714e-1175-433b-802d-21159e56a003 service nova] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:13:56.264855 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c15f28-9619-42eb-87e8-7c29494d68e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:13:56.265492 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c15f28-9619-42eb-87e8-7c29494d68e3 service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:13:56.265776 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c15f28-9619-42eb-87e8-7c29494d68e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:13:56.266049 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c15f28-9619-42eb-87e8-7c29494d68e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:13:56.267768 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-b9c15f28-9619-42eb-87e8-7c29494d68e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:13:56.329134 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c15f28-9619-42eb-87e8-7c29494d68e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:13:56.330578 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c15f28-9619-42eb-87e8-7c29494d68e3 service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:13:56.340176 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 920/1831] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:13:56 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:14:28.800855 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6728ae-96f8-47d9-81fc-d82b480aea86 service cinder] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:28.802454 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-bf6728ae-96f8-47d9-81fc-d82b480aea86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:28.872093 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6728ae-96f8-47d9-81fc-d82b480aea86 service cinder] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:28.876962 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30f5ef-3f3d-4694-9040-8cd95403a93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:28.877844 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30f5ef-3f3d-4694-9040-8cd95403a93b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:28.878127 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30f5ef-3f3d-4694-9040-8cd95403a93b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:28.878401 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30f5ef-3f3d-4694-9040-8cd95403a93b admin admin] PATH_INFO: `/v3/users/9f4e9775eee142e19db6132e5cbe4b08` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:28.879675 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30f5ef-3f3d-4694-9040-8cd95403a93b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f4e9775eee142e19db6132e5cbe4b08)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:28.881630 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30f5ef-3f3d-4694-9040-8cd95403a93b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:29.101962 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-2c30f5ef-3f3d-4694-9040-8cd95403a93b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f4e9775eee142e19db6132e5cbe4b08'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:29.102667 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-2c30f5ef-3f3d-4694-9040-8cd95403a93b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f4e9775eee142e19db6132e5cbe4b08'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:29.110227 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-2c30f5ef-3f3d-4694-9040-8cd95403a93b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f4e9775eee142e19db6132e5cbe4b08'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:29.197071 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-2c30f5ef-3f3d-4694-9040-8cd95403a93b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f4e9775eee142e19db6132e5cbe4b08'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:29.209533 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-2c30f5ef-3f3d-4694-9040-8cd95403a93b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f4e9775eee142e19db6132e5cbe4b08'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:29.215460 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 912/1832] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:14:28 2021] DELETE /identity/v3/users/9f4e9775eee142e19db6132e5cbe4b08 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:14:29.220056 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2131b-3e21-47da-8164-fd0e645c08de None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:29.220582 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2131b-3e21-47da-8164-fd0e645c08de None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:29.220681 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2131b-3e21-47da-8164-fd0e645c08de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:29.238750 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-90b2131b-3e21-47da-8164-fd0e645c08de None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:14:29.240578 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-90b2131b-3e21-47da-8164-fd0e645c08de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:29.300782 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 921/1833] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:14:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:14:29.310831 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30f5ef-3f3d-4694-9040-8cd95403a93b admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:29.312202 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-2c30f5ef-3f3d-4694-9040-8cd95403a93b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:29.376173 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30f5ef-3f3d-4694-9040-8cd95403a93b admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:29.379930 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa86f5f-cc1a-428c-844c-07a8fbad5e5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:29.381120 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa86f5f-cc1a-428c-844c-07a8fbad5e5e service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:29.381420 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa86f5f-cc1a-428c-844c-07a8fbad5e5e service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:29.381701 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa86f5f-cc1a-428c-844c-07a8fbad5e5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:29.393214 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa86f5f-cc1a-428c-844c-07a8fbad5e5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:29.394660 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa86f5f-cc1a-428c-844c-07a8fbad5e5e service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:29.404742 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 913/1834] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:14:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:14:29.884099 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2131b-3e21-47da-8164-fd0e645c08de None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:29.885662 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-90b2131b-3e21-47da-8164-fd0e645c08de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:29.898251 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2131b-3e21-47da-8164-fd0e645c08de None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:29.902620 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47c15b-469f-4bd5-a151-76cf2c974417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:29.903482 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47c15b-469f-4bd5-a151-76cf2c974417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:29.903763 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47c15b-469f-4bd5-a151-76cf2c974417 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:29.904040 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47c15b-469f-4bd5-a151-76cf2c974417 admin admin] PATH_INFO: `/v3/projects/aefdbd026e5e4f5da85798637a4aa1f9` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:29.905405 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae47c15b-469f-4bd5-a151-76cf2c974417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aefdbd026e5e4f5da85798637a4aa1f9)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:29.907383 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae47c15b-469f-4bd5-a151-76cf2c974417 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:30.090250 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-ae47c15b-469f-4bd5-a151-76cf2c974417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aefdbd026e5e4f5da85798637a4aa1f9', 'request_id': 'req-ae47c15b-469f-4bd5-a151-76cf2c974417'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:30.162508 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-ae47c15b-469f-4bd5-a151-76cf2c974417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aefdbd026e5e4f5da85798637a4aa1f9', 'request_id': 'req-ae47c15b-469f-4bd5-a151-76cf2c974417'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:30.168777 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-ae47c15b-469f-4bd5-a151-76cf2c974417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aefdbd026e5e4f5da85798637a4aa1f9', 'request_id': 'req-ae47c15b-469f-4bd5-a151-76cf2c974417'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:30.179605 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-ae47c15b-469f-4bd5-a151-76cf2c974417 admin admin] The token cache is being invalidate because project aefdbd026e5e4f5da85798637a4aa1f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:14:30.179917 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-ae47c15b-469f-4bd5-a151-76cf2c974417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:30.180584 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-ae47c15b-469f-4bd5-a151-76cf2c974417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:30.182146 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 922/1835] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:14:29 2021] DELETE /identity/v3/projects/aefdbd026e5e4f5da85798637a4aa1f9 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:14:30.186146 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa86f5f-cc1a-428c-844c-07a8fbad5e5e service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:30.196022 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa86f5f-cc1a-428c-844c-07a8fbad5e5e service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:30.248997 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ca02a-1268-487d-b7a2-065b7d5fa202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:30.249860 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ca02a-1268-487d-b7a2-065b7d5fa202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:30.250141 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ca02a-1268-487d-b7a2-065b7d5fa202 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:30.250416 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ca02a-1268-487d-b7a2-065b7d5fa202 admin admin] PATH_INFO: `/v3/users/595616d5c0aa4ebc8f9cc9ff3cea1871` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:30.251577 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ca02a-1268-487d-b7a2-065b7d5fa202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=595616d5c0aa4ebc8f9cc9ff3cea1871)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:30.253512 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ca02a-1268-487d-b7a2-065b7d5fa202 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:30.478651 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-aa6ca02a-1268-487d-b7a2-065b7d5fa202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '595616d5c0aa4ebc8f9cc9ff3cea1871'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:30.479448 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-aa6ca02a-1268-487d-b7a2-065b7d5fa202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '595616d5c0aa4ebc8f9cc9ff3cea1871'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:30.486527 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-aa6ca02a-1268-487d-b7a2-065b7d5fa202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '595616d5c0aa4ebc8f9cc9ff3cea1871'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:30.533820 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-aa6ca02a-1268-487d-b7a2-065b7d5fa202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '595616d5c0aa4ebc8f9cc9ff3cea1871'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:30.545586 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-aa6ca02a-1268-487d-b7a2-065b7d5fa202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '595616d5c0aa4ebc8f9cc9ff3cea1871'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:30.551776 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 914/1836] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:14:30 2021] DELETE /identity/v3/users/595616d5c0aa4ebc8f9cc9ff3cea1871 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:14:31.120543 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47c15b-469f-4bd5-a151-76cf2c974417 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:31.122965 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-ae47c15b-469f-4bd5-a151-76cf2c974417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:31.138922 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47c15b-469f-4bd5-a151-76cf2c974417 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:31.200749 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04ff46-bd5d-42cc-8d18-fd6e4bd1654f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:31.201714 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04ff46-bd5d-42cc-8d18-fd6e4bd1654f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:31.202082 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04ff46-bd5d-42cc-8d18-fd6e4bd1654f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:31.202504 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04ff46-bd5d-42cc-8d18-fd6e4bd1654f admin admin] PATH_INFO: `/v3/projects/6b676fc31c0045b1b244fc935633ba2e` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:31.203913 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04ff46-bd5d-42cc-8d18-fd6e4bd1654f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b676fc31c0045b1b244fc935633ba2e)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:31.206060 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04ff46-bd5d-42cc-8d18-fd6e4bd1654f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:31.333176 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-1c04ff46-bd5d-42cc-8d18-fd6e4bd1654f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b676fc31c0045b1b244fc935633ba2e', 'request_id': 'req-1c04ff46-bd5d-42cc-8d18-fd6e4bd1654f'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:31.419968 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-1c04ff46-bd5d-42cc-8d18-fd6e4bd1654f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b676fc31c0045b1b244fc935633ba2e', 'request_id': 'req-1c04ff46-bd5d-42cc-8d18-fd6e4bd1654f'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:31.427935 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-1c04ff46-bd5d-42cc-8d18-fd6e4bd1654f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b676fc31c0045b1b244fc935633ba2e', 'request_id': 'req-1c04ff46-bd5d-42cc-8d18-fd6e4bd1654f'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:31.440467 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-1c04ff46-bd5d-42cc-8d18-fd6e4bd1654f admin admin] The token cache is being invalidate because project 6b676fc31c0045b1b244fc935633ba2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:14:31.440788 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-1c04ff46-bd5d-42cc-8d18-fd6e4bd1654f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:31.441430 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-1c04ff46-bd5d-42cc-8d18-fd6e4bd1654f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:31.443407 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 923/1837] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:14:31 2021] DELETE /identity/v3/projects/6b676fc31c0045b1b244fc935633ba2e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:14:31.447139 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ca02a-1268-487d-b7a2-065b7d5fa202 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:31.448847 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-aa6ca02a-1268-487d-b7a2-065b7d5fa202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:31.461556 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ca02a-1268-487d-b7a2-065b7d5fa202 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:31.517414 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea4e5b-237a-47fa-8bc6-e10da15fee6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:31.518293 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea4e5b-237a-47fa-8bc6-e10da15fee6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:31.519010 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea4e5b-237a-47fa-8bc6-e10da15fee6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:31.519010 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea4e5b-237a-47fa-8bc6-e10da15fee6e admin admin] PATH_INFO: `/v3/users/8d396880eef34aa787a0f92249f616d5` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:31.520133 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea4e5b-237a-47fa-8bc6-e10da15fee6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d396880eef34aa787a0f92249f616d5)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:31.522158 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea4e5b-237a-47fa-8bc6-e10da15fee6e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:31.706960 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-03ea4e5b-237a-47fa-8bc6-e10da15fee6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d396880eef34aa787a0f92249f616d5'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:31.707609 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-03ea4e5b-237a-47fa-8bc6-e10da15fee6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d396880eef34aa787a0f92249f616d5'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:31.714276 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-03ea4e5b-237a-47fa-8bc6-e10da15fee6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d396880eef34aa787a0f92249f616d5'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:31.799193 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-03ea4e5b-237a-47fa-8bc6-e10da15fee6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d396880eef34aa787a0f92249f616d5'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:31.812699 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-03ea4e5b-237a-47fa-8bc6-e10da15fee6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d396880eef34aa787a0f92249f616d5'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:31.820370 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 915/1838] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:14:31 2021] DELETE /identity/v3/users/8d396880eef34aa787a0f92249f616d5 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:14:32.143417 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04ff46-bd5d-42cc-8d18-fd6e4bd1654f admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:32.144917 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-1c04ff46-bd5d-42cc-8d18-fd6e4bd1654f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:32.157939 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04ff46-bd5d-42cc-8d18-fd6e4bd1654f admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:32.228755 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272ffb2-ba12-4989-9039-e41c1711efa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:32.229812 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272ffb2-ba12-4989-9039-e41c1711efa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:32.230313 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272ffb2-ba12-4989-9039-e41c1711efa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:32.230855 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272ffb2-ba12-4989-9039-e41c1711efa6 admin admin] PATH_INFO: `/v3/users/52a6bc8766af4f1e92001c04cc428493` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:32.232207 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272ffb2-ba12-4989-9039-e41c1711efa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52a6bc8766af4f1e92001c04cc428493)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:32.234614 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272ffb2-ba12-4989-9039-e41c1711efa6 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:32.379956 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea4e5b-237a-47fa-8bc6-e10da15fee6e admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:32.381536 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-03ea4e5b-237a-47fa-8bc6-e10da15fee6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:32.398539 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea4e5b-237a-47fa-8bc6-e10da15fee6e admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:32.409375 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb5875-f1ba-4139-a7c5-16d1bbdff963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:32.410241 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb5875-f1ba-4139-a7c5-16d1bbdff963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:32.410522 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb5875-f1ba-4139-a7c5-16d1bbdff963 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:32.410795 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb5875-f1ba-4139-a7c5-16d1bbdff963 admin admin] PATH_INFO: `/v3/projects/0800d1533d534b1f9dfe1d844e46857a` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:32.412457 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb5875-f1ba-4139-a7c5-16d1bbdff963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0800d1533d534b1f9dfe1d844e46857a)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:32.414382 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb5875-f1ba-4139-a7c5-16d1bbdff963 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:32.454124 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-c272ffb2-ba12-4989-9039-e41c1711efa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52a6bc8766af4f1e92001c04cc428493'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:32.454767 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-c272ffb2-ba12-4989-9039-e41c1711efa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52a6bc8766af4f1e92001c04cc428493'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:32.455362 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-c272ffb2-ba12-4989-9039-e41c1711efa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52a6bc8766af4f1e92001c04cc428493'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:32.461925 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-c272ffb2-ba12-4989-9039-e41c1711efa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52a6bc8766af4f1e92001c04cc428493'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:32.516427 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-3bdb5875-f1ba-4139-a7c5-16d1bbdff963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0800d1533d534b1f9dfe1d844e46857a', 'request_id': 'req-3bdb5875-f1ba-4139-a7c5-16d1bbdff963'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:32.534230 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-c272ffb2-ba12-4989-9039-e41c1711efa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52a6bc8766af4f1e92001c04cc428493'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:32.553913 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 924/1839] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:14:32 2021] DELETE /identity/v3/users/52a6bc8766af4f1e92001c04cc428493 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:14:32.558332 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f499cd-58fd-44be-b7e3-cf494d8721eb None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:32.558681 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f499cd-58fd-44be-b7e3-cf494d8721eb None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:32.558962 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f499cd-58fd-44be-b7e3-cf494d8721eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:32.576658 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-b4f499cd-58fd-44be-b7e3-cf494d8721eb None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:14:32.577852 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-b4f499cd-58fd-44be-b7e3-cf494d8721eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:32.596801 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-3bdb5875-f1ba-4139-a7c5-16d1bbdff963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0800d1533d534b1f9dfe1d844e46857a', 'request_id': 'req-3bdb5875-f1ba-4139-a7c5-16d1bbdff963'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:32.603540 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-3bdb5875-f1ba-4139-a7c5-16d1bbdff963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0800d1533d534b1f9dfe1d844e46857a', 'request_id': 'req-3bdb5875-f1ba-4139-a7c5-16d1bbdff963'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:32.614596 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-3bdb5875-f1ba-4139-a7c5-16d1bbdff963 admin admin] The token cache is being invalidate because project 0800d1533d534b1f9dfe1d844e46857a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:14:32.621272 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-3bdb5875-f1ba-4139-a7c5-16d1bbdff963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:32.621272 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-3bdb5875-f1ba-4139-a7c5-16d1bbdff963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:32.621272 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 916/1840] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:14:32 2021] DELETE /identity/v3/projects/0800d1533d534b1f9dfe1d844e46857a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:14:32.623008 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630eed3-b6c8-4bc8-bd48-a3e82429a1a2 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:32.623243 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630eed3-b6c8-4bc8-bd48-a3e82429a1a2 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:32.623518 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630eed3-b6c8-4bc8-bd48-a3e82429a1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:32.641652 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 925/1841] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:14:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:14:32.641956 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-2630eed3-b6c8-4bc8-bd48-a3e82429a1a2 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:14:32.642698 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-2630eed3-b6c8-4bc8-bd48-a3e82429a1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:32.651756 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 917/1842] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:14:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:14:32.656582 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f499cd-58fd-44be-b7e3-cf494d8721eb None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:32.657998 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-b4f499cd-58fd-44be-b7e3-cf494d8721eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:32.659788 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9e7b7-db76-42b2-b2fe-46c0856cd824 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:32.660332 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9e7b7-db76-42b2-b2fe-46c0856cd824 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:32.660551 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9e7b7-db76-42b2-b2fe-46c0856cd824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:32.679637 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-64e9e7b7-db76-42b2-b2fe-46c0856cd824 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:14:32.681174 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-64e9e7b7-db76-42b2-b2fe-46c0856cd824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:32.693146 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 918/1843] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:14:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:14:32.694197 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9e7b7-db76-42b2-b2fe-46c0856cd824 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:32.703460 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9e7b7-db76-42b2-b2fe-46c0856cd824 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:32.708811 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb29d90-f974-43e2-b1ea-5c435f78bacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:32.709472 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb29d90-f974-43e2-b1ea-5c435f78bacb admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:32.710084 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb29d90-f974-43e2-b1ea-5c435f78bacb admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:32.710084 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb29d90-f974-43e2-b1ea-5c435f78bacb admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:32.710759 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb29d90-f974-43e2-b1ea-5c435f78bacb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:14:32.711072 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb29d90-f974-43e2-b1ea-5c435f78bacb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:32.712698 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb29d90-f974-43e2-b1ea-5c435f78bacb admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:32.719825 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f499cd-58fd-44be-b7e3-cf494d8721eb None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:32.723531 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c501e-39eb-4c54-b532-422e0ef115c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:32.724039 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 919/1844] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:14:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:14:32.724296 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c501e-39eb-4c54-b532-422e0ef115c7 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:32.724609 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c501e-39eb-4c54-b532-422e0ef115c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:32.724887 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c501e-39eb-4c54-b532-422e0ef115c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:32.728440 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb29d90-f974-43e2-b1ea-5c435f78bacb admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:32.734432 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c501e-39eb-4c54-b532-422e0ef115c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:32.735981 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c501e-39eb-4c54-b532-422e0ef115c7 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:32.737886 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb29d90-f974-43e2-b1ea-5c435f78bacb admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:32.743066 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90e1b5-d371-479d-aadd-72584797e491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:32.743697 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90e1b5-d371-479d-aadd-72584797e491 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:32.744020 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90e1b5-d371-479d-aadd-72584797e491 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:32.744338 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90e1b5-d371-479d-aadd-72584797e491 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:32.745053 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c90e1b5-d371-479d-aadd-72584797e491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:32.746199 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 926/1845] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:14:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:14:32.749345 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c90e1b5-d371-479d-aadd-72584797e491 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:32.852515 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 920/1846] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:14:32 2021] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:14:32.859275 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c501e-39eb-4c54-b532-422e0ef115c7 service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:32.873752 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c501e-39eb-4c54-b532-422e0ef115c7 service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:32.929362 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b662808-25d9-40b9-b28b-4edf468b8d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:32.930044 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b662808-25d9-40b9-b28b-4edf468b8d4d admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:32.930324 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b662808-25d9-40b9-b28b-4edf468b8d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:32.930605 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b662808-25d9-40b9-b28b-4edf468b8d4d admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:32.931310 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b662808-25d9-40b9-b28b-4edf468b8d4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:32.933303 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b662808-25d9-40b9-b28b-4edf468b8d4d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:33.011583 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 927/1847] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:14:32 2021] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:14:33.015688 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90e1b5-d371-479d-aadd-72584797e491 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:33.033012 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90e1b5-d371-479d-aadd-72584797e491 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:33.040259 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a405a98-f354-4924-883a-baac81d8ea30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:33.041266 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a405a98-f354-4924-883a-baac81d8ea30 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:33.041610 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a405a98-f354-4924-883a-baac81d8ea30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:33.042411 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a405a98-f354-4924-883a-baac81d8ea30 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:33.043226 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a405a98-f354-4924-883a-baac81d8ea30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:33.045431 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a405a98-f354-4924-883a-baac81d8ea30 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:33.055778 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 921/1848] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:14:33 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:14:33.059996 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b662808-25d9-40b9-b28b-4edf468b8d4d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:33.071595 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b662808-25d9-40b9-b28b-4edf468b8d4d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:33.076803 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ca6f0-10b9-4ea0-a156-b064c0612713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:33.077480 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ca6f0-10b9-4ea0-a156-b064c0612713 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:33.077765 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ca6f0-10b9-4ea0-a156-b064c0612713 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:33.078042 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ca6f0-10b9-4ea0-a156-b064c0612713 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:33.078877 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ca6f0-10b9-4ea0-a156-b064c0612713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:33.080475 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ca6f0-10b9-4ea0-a156-b064c0612713 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:33.090969 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 928/1849] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:14:33 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:14:33.095230 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a405a98-f354-4924-883a-baac81d8ea30 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:33.105519 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a405a98-f354-4924-883a-baac81d8ea30 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:33.110523 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a93d7b-ebe0-4fa3-903d-de4a8f004f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:33.111430 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a93d7b-ebe0-4fa3-903d-de4a8f004f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:33.111710 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a93d7b-ebe0-4fa3-903d-de4a8f004f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:33.111984 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a93d7b-ebe0-4fa3-903d-de4a8f004f05 admin admin] PATH_INFO: `/v3/projects/322fdda86774429088573b8e05ef68c3/users/30ffc05b250446c68c36bf6be91e3fef/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:33.127586 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a93d7b-ebe0-4fa3-903d-de4a8f004f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=322fdda86774429088573b8e05ef68c3, user_id=30ffc05b250446c68c36bf6be91e3fef, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:33.130258 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a93d7b-ebe0-4fa3-903d-de4a8f004f05 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:33.151916 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ca6f0-10b9-4ea0-a156-b064c0612713 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:33.154710 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-5e2ca6f0-10b9-4ea0-a156-b064c0612713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:33.170489 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ca6f0-10b9-4ea0-a156-b064c0612713 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:33.176337 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd729b-a48d-4468-80f8-9cb23a63b6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:33.177876 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd729b-a48d-4468-80f8-9cb23a63b6ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:33.178160 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd729b-a48d-4468-80f8-9cb23a63b6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:33.178457 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd729b-a48d-4468-80f8-9cb23a63b6ad admin admin] PATH_INFO: `/v3/projects/5727c451ed734183827cecb9d23d44a0` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:33.180243 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd729b-a48d-4468-80f8-9cb23a63b6ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=5727c451ed734183827cecb9d23d44a0)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:33.182310 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd729b-a48d-4468-80f8-9cb23a63b6ad admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:33.220312 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 922/1850] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:14:33 2021] PUT /identity/v3/projects/322fdda86774429088573b8e05ef68c3/users/30ffc05b250446c68c36bf6be91e3fef/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:14:33.231049 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877342d-d903-44eb-bcc1-440493a52200 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:33.231341 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877342d-d903-44eb-bcc1-440493a52200 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:33.231623 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877342d-d903-44eb-bcc1-440493a52200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:33.257235 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-3877342d-d903-44eb-bcc1-440493a52200 None None] MFA Rules not processed for user `30ffc05b250446c68c36bf6be91e3fef`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:14:33.261527 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-3877342d-d903-44eb-bcc1-440493a52200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:33.295364 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-4edd729b-a48d-4468-80f8-9cb23a63b6ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5727c451ed734183827cecb9d23d44a0', 'request_id': 'req-4edd729b-a48d-4468-80f8-9cb23a63b6ad'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:33.321292 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 923/1851] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:14:33 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:14:33.331429 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877342d-d903-44eb-bcc1-440493a52200 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:33.332788 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-3877342d-d903-44eb-bcc1-440493a52200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:33.386009 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877342d-d903-44eb-bcc1-440493a52200 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:33.396109 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-4edd729b-a48d-4468-80f8-9cb23a63b6ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5727c451ed734183827cecb9d23d44a0', 'request_id': 'req-4edd729b-a48d-4468-80f8-9cb23a63b6ad'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:33.402151 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-4edd729b-a48d-4468-80f8-9cb23a63b6ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5727c451ed734183827cecb9d23d44a0', 'request_id': 'req-4edd729b-a48d-4468-80f8-9cb23a63b6ad'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:33.414039 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-4edd729b-a48d-4468-80f8-9cb23a63b6ad admin admin] The token cache is being invalidate because project 5727c451ed734183827cecb9d23d44a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:14:33.414328 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-4edd729b-a48d-4468-80f8-9cb23a63b6ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:33.414983 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-4edd729b-a48d-4468-80f8-9cb23a63b6ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:33.416803 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 929/1852] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:14:33 2021] DELETE /identity/v3/projects/5727c451ed734183827cecb9d23d44a0 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:14:33.420356 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd729b-a48d-4468-80f8-9cb23a63b6ad admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:33.421779 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-4edd729b-a48d-4468-80f8-9cb23a63b6ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:33.433687 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c445b-1da3-42b6-970f-cd05135762b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:33.434346 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c445b-1da3-42b6-970f-cd05135762b4 service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:33.434627 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c445b-1da3-42b6-970f-cd05135762b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:33.434902 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c445b-1da3-42b6-970f-cd05135762b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:33.436663 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-1c2c445b-1da3-42b6-970f-cd05135762b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:33.483310 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd729b-a48d-4468-80f8-9cb23a63b6ad admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:33.488085 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db370b-63a8-48a0-8a69-65bc75615769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:33.489002 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db370b-63a8-48a0-8a69-65bc75615769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:33.489334 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db370b-63a8-48a0-8a69-65bc75615769 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:33.489607 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db370b-63a8-48a0-8a69-65bc75615769 admin admin] PATH_INFO: `/v3/users/749f54457bf34215897afb4059aff204` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:33.490915 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db370b-63a8-48a0-8a69-65bc75615769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=749f54457bf34215897afb4059aff204)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:33.492888 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db370b-63a8-48a0-8a69-65bc75615769 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:33.493421 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c445b-1da3-42b6-970f-cd05135762b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:33.494860 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c445b-1da3-42b6-970f-cd05135762b4 service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:33.504094 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 924/1853] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:14:33 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:14:33.724128 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-64db370b-63a8-48a0-8a69-65bc75615769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '749f54457bf34215897afb4059aff204'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:33.724744 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-64db370b-63a8-48a0-8a69-65bc75615769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '749f54457bf34215897afb4059aff204'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:33.725354 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-64db370b-63a8-48a0-8a69-65bc75615769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '749f54457bf34215897afb4059aff204'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:33.731996 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-64db370b-63a8-48a0-8a69-65bc75615769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '749f54457bf34215897afb4059aff204'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:33.825667 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-64db370b-63a8-48a0-8a69-65bc75615769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '749f54457bf34215897afb4059aff204'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:33.843382 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 930/1854] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:14:33 2021] DELETE /identity/v3/users/749f54457bf34215897afb4059aff204 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:14:34.256171 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c445b-1da3-42b6-970f-cd05135762b4 service cinder] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:34.268214 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c445b-1da3-42b6-970f-cd05135762b4 service cinder] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:34.330096 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead6db3-a8d5-4178-989c-4129e4f3841e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:34.331739 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead6db3-a8d5-4178-989c-4129e4f3841e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:34.331739 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead6db3-a8d5-4178-989c-4129e4f3841e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:34.331739 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead6db3-a8d5-4178-989c-4129e4f3841e admin admin] PATH_INFO: `/v3/projects/f0aa56c0a9014c89b76b6c17d38fe0f2` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:34.332908 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead6db3-a8d5-4178-989c-4129e4f3841e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0aa56c0a9014c89b76b6c17d38fe0f2)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:34.334911 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead6db3-a8d5-4178-989c-4129e4f3841e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:34.476412 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-8ead6db3-a8d5-4178-989c-4129e4f3841e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0aa56c0a9014c89b76b6c17d38fe0f2', 'request_id': 'req-8ead6db3-a8d5-4178-989c-4129e4f3841e'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:34.568072 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-8ead6db3-a8d5-4178-989c-4129e4f3841e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0aa56c0a9014c89b76b6c17d38fe0f2', 'request_id': 'req-8ead6db3-a8d5-4178-989c-4129e4f3841e'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:34.577976 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-8ead6db3-a8d5-4178-989c-4129e4f3841e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0aa56c0a9014c89b76b6c17d38fe0f2', 'request_id': 'req-8ead6db3-a8d5-4178-989c-4129e4f3841e'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:34.588953 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-8ead6db3-a8d5-4178-989c-4129e4f3841e admin admin] The token cache is being invalidate because project f0aa56c0a9014c89b76b6c17d38fe0f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:14:34.589238 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-8ead6db3-a8d5-4178-989c-4129e4f3841e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:34.589860 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-8ead6db3-a8d5-4178-989c-4129e4f3841e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:34.591395 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 925/1855] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:14:34 2021] DELETE /identity/v3/projects/f0aa56c0a9014c89b76b6c17d38fe0f2 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:14:34.597163 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8bd41-6898-4ce0-8980-7796729fd1e7 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:34.597640 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8bd41-6898-4ce0-8980-7796729fd1e7 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:34.597744 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8bd41-6898-4ce0-8980-7796729fd1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:34.623549 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-62f8bd41-6898-4ce0-8980-7796729fd1e7 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:14:34.626544 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-62f8bd41-6898-4ce0-8980-7796729fd1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:34.684595 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 931/1856] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:14:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:14:34.693290 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be159ba8-7f50-4982-8acc-adec69bd1cc1 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:34.693588 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be159ba8-7f50-4982-8acc-adec69bd1cc1 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:34.693871 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be159ba8-7f50-4982-8acc-adec69bd1cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:34.711711 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-be159ba8-7f50-4982-8acc-adec69bd1cc1 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:14:34.712979 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-be159ba8-7f50-4982-8acc-adec69bd1cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:34.720977 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 926/1857] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:14:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:14:34.725551 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8bd41-6898-4ce0-8980-7796729fd1e7 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:34.735544 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8bd41-6898-4ce0-8980-7796729fd1e7 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:34.740868 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31257c5b-2ee5-4b21-8067-d0611e16424d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:34.741528 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31257c5b-2ee5-4b21-8067-d0611e16424d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:34.741810 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31257c5b-2ee5-4b21-8067-d0611e16424d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:34.742084 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31257c5b-2ee5-4b21-8067-d0611e16424d admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:34.742830 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31257c5b-2ee5-4b21-8067-d0611e16424d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:14:34.743133 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31257c5b-2ee5-4b21-8067-d0611e16424d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:34.744873 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31257c5b-2ee5-4b21-8067-d0611e16424d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:34.756093 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 932/1858] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:14:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:14:34.760255 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be159ba8-7f50-4982-8acc-adec69bd1cc1 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:34.769440 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be159ba8-7f50-4982-8acc-adec69bd1cc1 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:34.774621 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3b6b4-0def-4c20-96f9-12c5a13a0cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:34.775300 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3b6b4-0def-4c20-96f9-12c5a13a0cfe admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:34.775581 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3b6b4-0def-4c20-96f9-12c5a13a0cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:34.775856 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3b6b4-0def-4c20-96f9-12c5a13a0cfe admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:34.776564 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3b6b4-0def-4c20-96f9-12c5a13a0cfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:34.778460 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3b6b4-0def-4c20-96f9-12c5a13a0cfe admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:34.905736 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 927/1859] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:14:34 2021] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:14:34.909730 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31257c5b-2ee5-4b21-8067-d0611e16424d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:34.925835 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31257c5b-2ee5-4b21-8067-d0611e16424d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:34.979286 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0ab3e-5954-4cab-b522-714c19b52c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:34.979948 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0ab3e-5954-4cab-b522-714c19b52c1f admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:34.980241 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0ab3e-5954-4cab-b522-714c19b52c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:34.980544 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0ab3e-5954-4cab-b522-714c19b52c1f admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:34.981237 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0ab3e-5954-4cab-b522-714c19b52c1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:34.983400 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0ab3e-5954-4cab-b522-714c19b52c1f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:35.070842 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 933/1860] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:14:34 2021] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:14:35.075340 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3b6b4-0def-4c20-96f9-12c5a13a0cfe admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:35.086127 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3b6b4-0def-4c20-96f9-12c5a13a0cfe admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:35.090832 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29aa4f-cf2f-4757-954e-c826af3533cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:35.091500 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29aa4f-cf2f-4757-954e-c826af3533cc admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:35.091784 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29aa4f-cf2f-4757-954e-c826af3533cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:35.092064 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29aa4f-cf2f-4757-954e-c826af3533cc admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:35.092827 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29aa4f-cf2f-4757-954e-c826af3533cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:35.094421 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29aa4f-cf2f-4757-954e-c826af3533cc admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:35.105812 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 928/1861] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:14:35 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:14:35.109464 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0ab3e-5954-4cab-b522-714c19b52c1f admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:35.119437 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0ab3e-5954-4cab-b522-714c19b52c1f admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:35.124108 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943deef7-9c75-4719-9cd6-a982af38c3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:35.124799 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943deef7-9c75-4719-9cd6-a982af38c3ef admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:35.125081 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943deef7-9c75-4719-9cd6-a982af38c3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:35.125357 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943deef7-9c75-4719-9cd6-a982af38c3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:35.126080 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943deef7-9c75-4719-9cd6-a982af38c3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:35.127648 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943deef7-9c75-4719-9cd6-a982af38c3ef admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:35.138461 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 934/1862] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:14:35 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:14:35.142322 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29aa4f-cf2f-4757-954e-c826af3533cc admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:35.153048 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29aa4f-cf2f-4757-954e-c826af3533cc admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:35.157817 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f56cf-117c-458f-bf5a-3dedc73c9684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:35.158736 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f56cf-117c-458f-bf5a-3dedc73c9684 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:35.159017 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f56cf-117c-458f-bf5a-3dedc73c9684 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:35.159294 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f56cf-117c-458f-bf5a-3dedc73c9684 admin admin] PATH_INFO: `/v3/projects/039baf4a518247c08ceb49fe45ff6218/users/05c51dca4f8c421b8f3ad56becdf217e/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:35.174204 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f56cf-117c-458f-bf5a-3dedc73c9684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=039baf4a518247c08ceb49fe45ff6218, user_id=05c51dca4f8c421b8f3ad56becdf217e, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:35.176868 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f56cf-117c-458f-bf5a-3dedc73c9684 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:35.278114 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 929/1863] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:14:35 2021] PUT /identity/v3/projects/039baf4a518247c08ceb49fe45ff6218/users/05c51dca4f8c421b8f3ad56becdf217e/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:14:35.288048 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7e3ef-a3bf-4263-91b3-fb2f21e5dffa None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:35.288337 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7e3ef-a3bf-4263-91b3-fb2f21e5dffa None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:35.288656 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7e3ef-a3bf-4263-91b3-fb2f21e5dffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:35.322464 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-81a7e3ef-a3bf-4263-91b3-fb2f21e5dffa None None] MFA Rules not processed for user `05c51dca4f8c421b8f3ad56becdf217e`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:14:35.323653 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-81a7e3ef-a3bf-4263-91b3-fb2f21e5dffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:35.386762 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 935/1864] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:14:35 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:14:35.399587 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f56cf-117c-458f-bf5a-3dedc73c9684 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:35.401473 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-c64f56cf-117c-458f-bf5a-3dedc73c9684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:35.461751 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f56cf-117c-458f-bf5a-3dedc73c9684 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:35.465441 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424edc3-810e-49ae-ba12-edb7da25d914 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:35.466131 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424edc3-810e-49ae-ba12-edb7da25d914 service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:35.466415 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424edc3-810e-49ae-ba12-edb7da25d914 service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:35.466695 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424edc3-810e-49ae-ba12-edb7da25d914 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:35.475403 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424edc3-810e-49ae-ba12-edb7da25d914 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:35.476859 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424edc3-810e-49ae-ba12-edb7da25d914 service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:35.485802 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 930/1865] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:14:35 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:14:35.505924 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7e3ef-a3bf-4263-91b3-fb2f21e5dffa None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:35.566918 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7e3ef-a3bf-4263-91b3-fb2f21e5dffa None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:35.571844 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f9319-7584-4623-8d24-ac8998132b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:35.572804 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f9319-7584-4623-8d24-ac8998132b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:35.573028 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f9319-7584-4623-8d24-ac8998132b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:35.573304 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f9319-7584-4623-8d24-ac8998132b22 admin admin] PATH_INFO: `/v3/users/05c51dca4f8c421b8f3ad56becdf217e` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:35.574508 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f9319-7584-4623-8d24-ac8998132b22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c51dca4f8c421b8f3ad56becdf217e)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:35.576424 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f9319-7584-4623-8d24-ac8998132b22 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:35.786923 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-124f9319-7584-4623-8d24-ac8998132b22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c51dca4f8c421b8f3ad56becdf217e'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:35.787571 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-124f9319-7584-4623-8d24-ac8998132b22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c51dca4f8c421b8f3ad56becdf217e'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:35.788169 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-124f9319-7584-4623-8d24-ac8998132b22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c51dca4f8c421b8f3ad56becdf217e'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:35.794801 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-124f9319-7584-4623-8d24-ac8998132b22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c51dca4f8c421b8f3ad56becdf217e'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:35.865975 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-124f9319-7584-4623-8d24-ac8998132b22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c51dca4f8c421b8f3ad56becdf217e'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:35.884547 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 936/1866] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:14:35 2021] DELETE /identity/v3/users/05c51dca4f8c421b8f3ad56becdf217e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:14:35.889750 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfd0c2-4d5a-401a-a044-9e4e7c932b8e None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:35.889750 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfd0c2-4d5a-401a-a044-9e4e7c932b8e None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:35.889750 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfd0c2-4d5a-401a-a044-9e4e7c932b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:35.906079 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-5fbfd0c2-4d5a-401a-a044-9e4e7c932b8e None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:14:35.907264 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-5fbfd0c2-4d5a-401a-a044-9e4e7c932b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:35.964035 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 931/1867] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:14:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:14:35.974569 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f9319-7584-4623-8d24-ac8998132b22 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:35.975961 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-124f9319-7584-4623-8d24-ac8998132b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:36.031366 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f9319-7584-4623-8d24-ac8998132b22 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:36.035046 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b045355-14b9-4776-93d9-cd500b5bde73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:36.035692 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b045355-14b9-4776-93d9-cd500b5bde73 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:36.035999 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b045355-14b9-4776-93d9-cd500b5bde73 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:36.036277 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b045355-14b9-4776-93d9-cd500b5bde73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:36.045513 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b045355-14b9-4776-93d9-cd500b5bde73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:36.046929 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b045355-14b9-4776-93d9-cd500b5bde73 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:36.056136 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 937/1868] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:14:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:14:36.465347 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfd0c2-4d5a-401a-a044-9e4e7c932b8e None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:36.467133 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-5fbfd0c2-4d5a-401a-a044-9e4e7c932b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:36.481401 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfd0c2-4d5a-401a-a044-9e4e7c932b8e None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:36.487358 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627b99b-645e-4cae-bb55-d3c728a422fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:36.488225 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627b99b-645e-4cae-bb55-d3c728a422fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:36.488531 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627b99b-645e-4cae-bb55-d3c728a422fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:36.488942 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627b99b-645e-4cae-bb55-d3c728a422fc admin admin] PATH_INFO: `/v3/projects/039baf4a518247c08ceb49fe45ff6218` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:36.490289 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627b99b-645e-4cae-bb55-d3c728a422fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=039baf4a518247c08ceb49fe45ff6218)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:36.492192 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627b99b-645e-4cae-bb55-d3c728a422fc admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:36.636391 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d627b99b-645e-4cae-bb55-d3c728a422fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '039baf4a518247c08ceb49fe45ff6218', 'request_id': 'req-d627b99b-645e-4cae-bb55-d3c728a422fc'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:36.705194 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d627b99b-645e-4cae-bb55-d3c728a422fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '039baf4a518247c08ceb49fe45ff6218', 'request_id': 'req-d627b99b-645e-4cae-bb55-d3c728a422fc'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:36.711039 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d627b99b-645e-4cae-bb55-d3c728a422fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '039baf4a518247c08ceb49fe45ff6218', 'request_id': 'req-d627b99b-645e-4cae-bb55-d3c728a422fc'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:36.721732 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d627b99b-645e-4cae-bb55-d3c728a422fc admin admin] The token cache is being invalidate because project 039baf4a518247c08ceb49fe45ff6218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:14:36.722015 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d627b99b-645e-4cae-bb55-d3c728a422fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:36.723052 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d627b99b-645e-4cae-bb55-d3c728a422fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:36.724968 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 932/1869] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:14:36 2021] DELETE /identity/v3/projects/039baf4a518247c08ceb49fe45ff6218 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:14:36.730876 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a9be5-f0ff-4211-a96d-75595e274c9f None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:36.731180 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a9be5-f0ff-4211-a96d-75595e274c9f None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:36.731485 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a9be5-f0ff-4211-a96d-75595e274c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:36.750559 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-bf7a9be5-f0ff-4211-a96d-75595e274c9f None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:14:36.751752 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-bf7a9be5-f0ff-4211-a96d-75595e274c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:36.808433 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 938/1870] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:14:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:14:36.815744 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8faa1-49db-4413-a175-79db3defbedb None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:36.816200 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8faa1-49db-4413-a175-79db3defbedb None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:36.816483 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8faa1-49db-4413-a175-79db3defbedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:36.834446 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-bab8faa1-49db-4413-a175-79db3defbedb None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:14:36.835634 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-bab8faa1-49db-4413-a175-79db3defbedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:36.843644 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 933/1871] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:14:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:14:36.848047 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a9be5-f0ff-4211-a96d-75595e274c9f None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:36.858740 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a9be5-f0ff-4211-a96d-75595e274c9f None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:36.863361 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dd464-c983-434a-8cf5-df0cabf5f224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:36.864021 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dd464-c983-434a-8cf5-df0cabf5f224 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:36.864872 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dd464-c983-434a-8cf5-df0cabf5f224 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:36.865148 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dd464-c983-434a-8cf5-df0cabf5f224 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:36.865871 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59dd464-c983-434a-8cf5-df0cabf5f224 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:14:36.866176 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59dd464-c983-434a-8cf5-df0cabf5f224 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:36.867798 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59dd464-c983-434a-8cf5-df0cabf5f224 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:36.879315 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 939/1872] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:14:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:14:36.883583 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8faa1-49db-4413-a175-79db3defbedb None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:36.892849 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8faa1-49db-4413-a175-79db3defbedb None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:36.898911 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9839f6-48e1-45be-a33a-50fe017dba29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:36.898911 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9839f6-48e1-45be-a33a-50fe017dba29 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:36.898911 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9839f6-48e1-45be-a33a-50fe017dba29 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:36.898911 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9839f6-48e1-45be-a33a-50fe017dba29 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:36.899824 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9839f6-48e1-45be-a33a-50fe017dba29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:36.901319 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9839f6-48e1-45be-a33a-50fe017dba29 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:36.992977 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 934/1873] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:14:36 2021] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:14:36.996994 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dd464-c983-434a-8cf5-df0cabf5f224 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:37.006811 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dd464-c983-434a-8cf5-df0cabf5f224 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:37.060928 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7afec-818d-44f4-be92-d7ae8371702d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:37.061608 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7afec-818d-44f4-be92-d7ae8371702d admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:37.061894 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7afec-818d-44f4-be92-d7ae8371702d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:37.062171 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7afec-818d-44f4-be92-d7ae8371702d admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:37.062855 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7afec-818d-44f4-be92-d7ae8371702d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:37.064817 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7afec-818d-44f4-be92-d7ae8371702d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:37.162603 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 940/1874] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:14:36 2021] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:14:37.166679 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9839f6-48e1-45be-a33a-50fe017dba29 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:37.177291 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9839f6-48e1-45be-a33a-50fe017dba29 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:37.182096 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dab3e0-2f4c-403a-8ed8-f6625b799cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:37.182769 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dab3e0-2f4c-403a-8ed8-f6625b799cec admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:37.183034 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dab3e0-2f4c-403a-8ed8-f6625b799cec admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:37.183308 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dab3e0-2f4c-403a-8ed8-f6625b799cec admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:37.184061 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dab3e0-2f4c-403a-8ed8-f6625b799cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:37.185667 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dab3e0-2f4c-403a-8ed8-f6625b799cec admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:37.196930 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 935/1875] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:14:37 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:14:37.200713 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7afec-818d-44f4-be92-d7ae8371702d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:37.210841 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7afec-818d-44f4-be92-d7ae8371702d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:37.215645 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e2d9e-4aac-40c0-99e3-fa10bc3b6cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:37.216297 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e2d9e-4aac-40c0-99e3-fa10bc3b6cda admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:37.218346 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e2d9e-4aac-40c0-99e3-fa10bc3b6cda admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:37.218346 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e2d9e-4aac-40c0-99e3-fa10bc3b6cda admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:37.218346 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e2d9e-4aac-40c0-99e3-fa10bc3b6cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:37.219122 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e2d9e-4aac-40c0-99e3-fa10bc3b6cda admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:37.229529 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 941/1876] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:14:37 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:14:37.233906 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dab3e0-2f4c-403a-8ed8-f6625b799cec admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:37.254116 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dab3e0-2f4c-403a-8ed8-f6625b799cec admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:37.268165 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1f7cc-1c91-4abc-a733-d3f780f35e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:37.269272 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1f7cc-1c91-4abc-a733-d3f780f35e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:37.270176 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1f7cc-1c91-4abc-a733-d3f780f35e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:37.270176 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1f7cc-1c91-4abc-a733-d3f780f35e30 admin admin] PATH_INFO: `/v3/projects/e1ec2df5083745b796d8f38b3d808717/users/9a312c6f310342c28bbffe826370bbef/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:37.290581 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1f7cc-1c91-4abc-a733-d3f780f35e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ec2df5083745b796d8f38b3d808717, user_id=9a312c6f310342c28bbffe826370bbef, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:37.293319 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1f7cc-1c91-4abc-a733-d3f780f35e30 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:37.408425 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 936/1877] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:14:37 2021] PUT /identity/v3/projects/e1ec2df5083745b796d8f38b3d808717/users/9a312c6f310342c28bbffe826370bbef/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:14:37.419715 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e538351-0c4f-41f4-920f-213b9e37fe3a None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:37.420229 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e538351-0c4f-41f4-920f-213b9e37fe3a None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:37.420531 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e538351-0c4f-41f4-920f-213b9e37fe3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:37.449284 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-8e538351-0c4f-41f4-920f-213b9e37fe3a None None] MFA Rules not processed for user `9a312c6f310342c28bbffe826370bbef`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:14:37.450614 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-8e538351-0c4f-41f4-920f-213b9e37fe3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:37.515068 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 942/1878] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:14:37 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:14:37.555299 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1f7cc-1c91-4abc-a733-d3f780f35e30 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:37.557095 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-fdf1f7cc-1c91-4abc-a733-d3f780f35e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:37.616446 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1f7cc-1c91-4abc-a733-d3f780f35e30 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:37.622394 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e91de1-46f9-47f3-a6a6-60d22413f216 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:37.623053 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e91de1-46f9-47f3-a6a6-60d22413f216 service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:37.623344 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e91de1-46f9-47f3-a6a6-60d22413f216 service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:37.623749 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e91de1-46f9-47f3-a6a6-60d22413f216 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:37.632171 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e91de1-46f9-47f3-a6a6-60d22413f216 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:37.633649 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e91de1-46f9-47f3-a6a6-60d22413f216 service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:37.642338 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 937/1879] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:14:37 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:14:45.040984 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a83f5-4250-4b95-86ad-e54f836c9ad8 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:45.041522 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a83f5-4250-4b95-86ad-e54f836c9ad8 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:45.041613 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a83f5-4250-4b95-86ad-e54f836c9ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:45.060238 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-a06a83f5-4250-4b95-86ad-e54f836c9ad8 None None] MFA Rules not processed for user `36893da01a1845f5af4921a298abb9eb`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:14:45.061464 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-a06a83f5-4250-4b95-86ad-e54f836c9ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:45.119904 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 943/1880] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:14:45 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:14:46.661989 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e91de1-46f9-47f3-a6a6-60d22413f216 service cinder] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:46.663451 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-d5e91de1-46f9-47f3-a6a6-60d22413f216 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:46.740840 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e91de1-46f9-47f3-a6a6-60d22413f216 service cinder] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:46.745821 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f730e7-9032-4996-b394-4f6f82241b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:46.746681 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f730e7-9032-4996-b394-4f6f82241b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:46.746969 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f730e7-9032-4996-b394-4f6f82241b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:46.747256 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f730e7-9032-4996-b394-4f6f82241b85 admin admin] PATH_INFO: `/v3/users/30ffc05b250446c68c36bf6be91e3fef` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:46.748594 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f730e7-9032-4996-b394-4f6f82241b85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30ffc05b250446c68c36bf6be91e3fef)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:46.750807 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f730e7-9032-4996-b394-4f6f82241b85 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:46.942601 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-48f730e7-9032-4996-b394-4f6f82241b85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30ffc05b250446c68c36bf6be91e3fef'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:46.943346 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-48f730e7-9032-4996-b394-4f6f82241b85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30ffc05b250446c68c36bf6be91e3fef'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:46.950609 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-48f730e7-9032-4996-b394-4f6f82241b85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30ffc05b250446c68c36bf6be91e3fef'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:47.042186 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-48f730e7-9032-4996-b394-4f6f82241b85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30ffc05b250446c68c36bf6be91e3fef'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:47.054888 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-48f730e7-9032-4996-b394-4f6f82241b85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30ffc05b250446c68c36bf6be91e3fef'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:47.060781 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 938/1881] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:14:46 2021] DELETE /identity/v3/users/30ffc05b250446c68c36bf6be91e3fef => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:14:47.079775 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74353af-b3c3-4924-8683-a8e55439a59c None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:47.080230 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74353af-b3c3-4924-8683-a8e55439a59c None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:47.080361 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74353af-b3c3-4924-8683-a8e55439a59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:47.099289 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-f74353af-b3c3-4924-8683-a8e55439a59c None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:14:47.101415 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-f74353af-b3c3-4924-8683-a8e55439a59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:47.160193 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 944/1882] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:14:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:14:47.170596 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f730e7-9032-4996-b394-4f6f82241b85 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:47.172097 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-48f730e7-9032-4996-b394-4f6f82241b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:47.228140 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f730e7-9032-4996-b394-4f6f82241b85 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:47.231931 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbacc6-de1a-4fd9-8c92-babea496e1a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:47.232528 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbacc6-de1a-4fd9-8c92-babea496e1a5 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:47.233065 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbacc6-de1a-4fd9-8c92-babea496e1a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:47.233340 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbacc6-de1a-4fd9-8c92-babea496e1a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:47.243767 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbacc6-de1a-4fd9-8c92-babea496e1a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:47.245223 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbacc6-de1a-4fd9-8c92-babea496e1a5 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:47.254355 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 939/1883] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:14:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:14:47.777536 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74353af-b3c3-4924-8683-a8e55439a59c None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:47.778984 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-f74353af-b3c3-4924-8683-a8e55439a59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:47.792180 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74353af-b3c3-4924-8683-a8e55439a59c None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:47.799464 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3966442-28ae-4995-ba9a-6534a1e071e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:47.800568 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3966442-28ae-4995-ba9a-6534a1e071e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:47.800804 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3966442-28ae-4995-ba9a-6534a1e071e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:47.801170 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3966442-28ae-4995-ba9a-6534a1e071e9 admin admin] PATH_INFO: `/v3/projects/322fdda86774429088573b8e05ef68c3` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:47.802573 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3966442-28ae-4995-ba9a-6534a1e071e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=322fdda86774429088573b8e05ef68c3)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:47.808106 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3966442-28ae-4995-ba9a-6534a1e071e9 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:48.106035 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b3966442-28ae-4995-ba9a-6534a1e071e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '322fdda86774429088573b8e05ef68c3', 'request_id': 'req-b3966442-28ae-4995-ba9a-6534a1e071e9'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:48.215000 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b3966442-28ae-4995-ba9a-6534a1e071e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '322fdda86774429088573b8e05ef68c3', 'request_id': 'req-b3966442-28ae-4995-ba9a-6534a1e071e9'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:48.221198 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b3966442-28ae-4995-ba9a-6534a1e071e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '322fdda86774429088573b8e05ef68c3', 'request_id': 'req-b3966442-28ae-4995-ba9a-6534a1e071e9'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:48.236231 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b3966442-28ae-4995-ba9a-6534a1e071e9 admin admin] The token cache is being invalidate because project 322fdda86774429088573b8e05ef68c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:14:48.236676 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b3966442-28ae-4995-ba9a-6534a1e071e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:48.237522 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b3966442-28ae-4995-ba9a-6534a1e071e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:48.244430 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 945/1884] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:14:47 2021] DELETE /identity/v3/projects/322fdda86774429088573b8e05ef68c3 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:14:48.246093 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fb690-90f9-40ff-8d14-71eca68bb97c None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:48.246572 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fb690-90f9-40ff-8d14-71eca68bb97c None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:48.247890 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fb690-90f9-40ff-8d14-71eca68bb97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:48.265735 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-5d4fb690-90f9-40ff-8d14-71eca68bb97c None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:14:48.272023 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-5d4fb690-90f9-40ff-8d14-71eca68bb97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:48.339780 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 940/1885] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:14:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:14:48.349048 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67f53a-9091-4a5b-88fb-d1764e2245e7 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:48.349334 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67f53a-9091-4a5b-88fb-d1764e2245e7 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:48.349611 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67f53a-9091-4a5b-88fb-d1764e2245e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:48.368203 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-8d67f53a-9091-4a5b-88fb-d1764e2245e7 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:14:48.369463 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-8d67f53a-9091-4a5b-88fb-d1764e2245e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:48.377255 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 946/1886] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:14:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:14:48.381431 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fb690-90f9-40ff-8d14-71eca68bb97c None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:48.390782 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fb690-90f9-40ff-8d14-71eca68bb97c None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:48.395922 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecfed4-9863-4942-8e88-7d26e7a51bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:48.396618 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecfed4-9863-4942-8e88-7d26e7a51bdb admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:48.396913 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecfed4-9863-4942-8e88-7d26e7a51bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:48.397195 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecfed4-9863-4942-8e88-7d26e7a51bdb admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:48.397947 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecfed4-9863-4942-8e88-7d26e7a51bdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:14:48.398257 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecfed4-9863-4942-8e88-7d26e7a51bdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:48.399860 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecfed4-9863-4942-8e88-7d26e7a51bdb admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:48.411714 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 941/1887] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:14:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:14:48.415794 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67f53a-9091-4a5b-88fb-d1764e2245e7 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:48.424976 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67f53a-9091-4a5b-88fb-d1764e2245e7 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:48.429956 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cf6ba-700a-4d2d-b7db-44dd1ddf2c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:48.430607 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cf6ba-700a-4d2d-b7db-44dd1ddf2c4e admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:48.430894 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cf6ba-700a-4d2d-b7db-44dd1ddf2c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:48.431176 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cf6ba-700a-4d2d-b7db-44dd1ddf2c4e admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:48.431918 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49cf6ba-700a-4d2d-b7db-44dd1ddf2c4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:48.433846 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49cf6ba-700a-4d2d-b7db-44dd1ddf2c4e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:48.499899 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 947/1888] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:14:48 2021] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:14:48.504331 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecfed4-9863-4942-8e88-7d26e7a51bdb admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:48.514273 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecfed4-9863-4942-8e88-7d26e7a51bdb admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:48.569261 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d2a96-03b2-439a-85db-4e85eb970710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:48.569848 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d2a96-03b2-439a-85db-4e85eb970710 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:48.570134 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d2a96-03b2-439a-85db-4e85eb970710 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:48.570410 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d2a96-03b2-439a-85db-4e85eb970710 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:48.571114 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d2a96-03b2-439a-85db-4e85eb970710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:48.573057 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d2a96-03b2-439a-85db-4e85eb970710 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:48.663497 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 942/1889] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:14:48 2021] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:14:48.667588 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cf6ba-700a-4d2d-b7db-44dd1ddf2c4e admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:48.678342 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cf6ba-700a-4d2d-b7db-44dd1ddf2c4e admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:48.683267 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e9ac6-4943-4c52-82b1-621342de1321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:48.683930 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e9ac6-4943-4c52-82b1-621342de1321 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:48.684215 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e9ac6-4943-4c52-82b1-621342de1321 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:48.684516 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e9ac6-4943-4c52-82b1-621342de1321 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:48.685242 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e9ac6-4943-4c52-82b1-621342de1321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:48.686864 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e9ac6-4943-4c52-82b1-621342de1321 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:48.697810 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 948/1890] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:14:48 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:14:48.701573 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d2a96-03b2-439a-85db-4e85eb970710 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:48.711899 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d2a96-03b2-439a-85db-4e85eb970710 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:48.716711 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74fef2-6441-4155-807d-c35f7a6b7944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:48.717384 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74fef2-6441-4155-807d-c35f7a6b7944 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:48.717669 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74fef2-6441-4155-807d-c35f7a6b7944 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:48.717951 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74fef2-6441-4155-807d-c35f7a6b7944 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:48.718681 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74fef2-6441-4155-807d-c35f7a6b7944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:48.720308 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74fef2-6441-4155-807d-c35f7a6b7944 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:48.731769 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 943/1891] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:14:48 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:14:48.735556 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e9ac6-4943-4c52-82b1-621342de1321 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:48.748012 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e9ac6-4943-4c52-82b1-621342de1321 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:48.752825 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9184a36-3834-4fff-a3ab-74f016d2ae7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:48.753703 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9184a36-3834-4fff-a3ab-74f016d2ae7f admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:48.753979 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9184a36-3834-4fff-a3ab-74f016d2ae7f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:48.754821 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9184a36-3834-4fff-a3ab-74f016d2ae7f admin admin] PATH_INFO: `/v3/projects/6f66ea6efe7a4d2cb84edec8a4b42ad3/users/c56e9f5417c743fc938f86802e50b143/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:48.769689 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9184a36-3834-4fff-a3ab-74f016d2ae7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f66ea6efe7a4d2cb84edec8a4b42ad3, user_id=c56e9f5417c743fc938f86802e50b143, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:48.773075 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9184a36-3834-4fff-a3ab-74f016d2ae7f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:48.848015 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 949/1892] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:14:48 2021] PUT /identity/v3/projects/6f66ea6efe7a4d2cb84edec8a4b42ad3/users/c56e9f5417c743fc938f86802e50b143/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:14:48.858394 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2db75-ea5b-43b1-89f1-91b4fc5f75af None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:48.858686 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2db75-ea5b-43b1-89f1-91b4fc5f75af None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:48.858970 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2db75-ea5b-43b1-89f1-91b4fc5f75af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:48.884964 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-11f2db75-ea5b-43b1-89f1-91b4fc5f75af None None] MFA Rules not processed for user `c56e9f5417c743fc938f86802e50b143`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:14:48.886169 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-11f2db75-ea5b-43b1-89f1-91b4fc5f75af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:48.946960 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 944/1893] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:14:48 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:14:48.957028 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9184a36-3834-4fff-a3ab-74f016d2ae7f admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:48.959409 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-d9184a36-3834-4fff-a3ab-74f016d2ae7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:49.012708 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9184a36-3834-4fff-a3ab-74f016d2ae7f admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:49.016296 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99522cd-897c-46b6-a9b8-2cee7664beb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:49.016962 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99522cd-897c-46b6-a9b8-2cee7664beb1 service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:49.017246 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99522cd-897c-46b6-a9b8-2cee7664beb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:49.017520 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99522cd-897c-46b6-a9b8-2cee7664beb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:49.025547 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99522cd-897c-46b6-a9b8-2cee7664beb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:49.026955 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99522cd-897c-46b6-a9b8-2cee7664beb1 service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:49.035507 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 950/1894] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:14:48 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:14:55.021689 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a301e-e3ef-444a-baff-1c99f393afdc None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:55.022268 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a301e-e3ef-444a-baff-1c99f393afdc None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:55.022268 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a301e-e3ef-444a-baff-1c99f393afdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:55.053281 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-f98a301e-e3ef-444a-baff-1c99f393afdc None None] MFA Rules not processed for user `c56e9f5417c743fc938f86802e50b143`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:14:55.054303 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-f98a301e-e3ef-444a-baff-1c99f393afdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:55.074021 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 945/1895] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:14:55 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:14:56.596991 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99522cd-897c-46b6-a9b8-2cee7664beb1 service cinder] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:56.598931 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-d99522cd-897c-46b6-a9b8-2cee7664beb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:56.664462 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99522cd-897c-46b6-a9b8-2cee7664beb1 service cinder] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:56.669763 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1fdba-d0db-421a-a0d5-6bb9743b30ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:56.670659 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1fdba-d0db-421a-a0d5-6bb9743b30ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:56.670950 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1fdba-d0db-421a-a0d5-6bb9743b30ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:56.671227 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1fdba-d0db-421a-a0d5-6bb9743b30ec admin admin] PATH_INFO: `/v3/users/ba6c83813eac480891cfd5b04b32b06c` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:56.672458 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1fdba-d0db-421a-a0d5-6bb9743b30ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba6c83813eac480891cfd5b04b32b06c)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:56.674744 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1fdba-d0db-421a-a0d5-6bb9743b30ec admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:56.901283 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-95e1fdba-d0db-421a-a0d5-6bb9743b30ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba6c83813eac480891cfd5b04b32b06c'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:56.901943 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-95e1fdba-d0db-421a-a0d5-6bb9743b30ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba6c83813eac480891cfd5b04b32b06c'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:56.902556 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-95e1fdba-d0db-421a-a0d5-6bb9743b30ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba6c83813eac480891cfd5b04b32b06c'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:56.910370 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-95e1fdba-d0db-421a-a0d5-6bb9743b30ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba6c83813eac480891cfd5b04b32b06c'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:57.024879 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-95e1fdba-d0db-421a-a0d5-6bb9743b30ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba6c83813eac480891cfd5b04b32b06c'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:57.051467 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 951/1896] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:14:56 2021] DELETE /identity/v3/users/ba6c83813eac480891cfd5b04b32b06c => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:14:57.051730 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764f7ae-4d72-4ff3-9c32-dc5f31e16738 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:57.051730 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764f7ae-4d72-4ff3-9c32-dc5f31e16738 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:57.051730 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764f7ae-4d72-4ff3-9c32-dc5f31e16738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:57.071324 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-4764f7ae-4d72-4ff3-9c32-dc5f31e16738 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:14:57.072640 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-4764f7ae-4d72-4ff3-9c32-dc5f31e16738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:57.145348 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 946/1897] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:14:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:14:57.155072 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1fdba-d0db-421a-a0d5-6bb9743b30ec admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:57.156805 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-95e1fdba-d0db-421a-a0d5-6bb9743b30ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:57.199123 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764f7ae-4d72-4ff3-9c32-dc5f31e16738 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:57.200670 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-4764f7ae-4d72-4ff3-9c32-dc5f31e16738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:57.215825 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764f7ae-4d72-4ff3-9c32-dc5f31e16738 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:57.228165 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1fdba-d0db-421a-a0d5-6bb9743b30ec admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:57.231955 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afb809-d759-4ba5-9f8f-af4af78ab9ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:57.236379 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afb809-d759-4ba5-9f8f-af4af78ab9ea service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:57.236379 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afb809-d759-4ba5-9f8f-af4af78ab9ea service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:57.236379 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afb809-d759-4ba5-9f8f-af4af78ab9ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:57.236815 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6358b1-56e3-4e8f-81c0-3d4f1c7af2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:57.236815 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6358b1-56e3-4e8f-81c0-3d4f1c7af2f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:57.236815 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6358b1-56e3-4e8f-81c0-3d4f1c7af2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:57.236815 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6358b1-56e3-4e8f-81c0-3d4f1c7af2f4 admin admin] PATH_INFO: `/v3/users/edc08d934ebc4f93b077aa217c19c16b` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:57.237356 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6358b1-56e3-4e8f-81c0-3d4f1c7af2f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edc08d934ebc4f93b077aa217c19c16b)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:57.239455 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6358b1-56e3-4e8f-81c0-3d4f1c7af2f4 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:57.244299 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afb809-d759-4ba5-9f8f-af4af78ab9ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:57.246306 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afb809-d759-4ba5-9f8f-af4af78ab9ea service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:57.256597 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 952/1898] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:14:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:14:57.475085 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-2b6358b1-56e3-4e8f-81c0-3d4f1c7af2f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edc08d934ebc4f93b077aa217c19c16b'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:57.475806 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-2b6358b1-56e3-4e8f-81c0-3d4f1c7af2f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edc08d934ebc4f93b077aa217c19c16b'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:57.490397 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-2b6358b1-56e3-4e8f-81c0-3d4f1c7af2f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edc08d934ebc4f93b077aa217c19c16b'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:57.584706 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-2b6358b1-56e3-4e8f-81c0-3d4f1c7af2f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edc08d934ebc4f93b077aa217c19c16b'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:57.599470 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-2b6358b1-56e3-4e8f-81c0-3d4f1c7af2f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edc08d934ebc4f93b077aa217c19c16b'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:57.605526 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 947/1899] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:14:57 2021] DELETE /identity/v3/users/edc08d934ebc4f93b077aa217c19c16b => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:14:57.613412 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a754989-0005-4202-8a1e-27eb8012fcd5 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:57.613910 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a754989-0005-4202-8a1e-27eb8012fcd5 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:57.614219 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a754989-0005-4202-8a1e-27eb8012fcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:57.632541 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-8a754989-0005-4202-8a1e-27eb8012fcd5 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:14:57.633805 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-8a754989-0005-4202-8a1e-27eb8012fcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:57.700301 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 953/1900] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:14:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:14:57.717180 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6358b1-56e3-4e8f-81c0-3d4f1c7af2f4 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:57.718709 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-2b6358b1-56e3-4e8f-81c0-3d4f1c7af2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:57.776268 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6358b1-56e3-4e8f-81c0-3d4f1c7af2f4 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:57.781838 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb809b-ef77-4d72-be79-e361172b297d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:57.781838 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb809b-ef77-4d72-be79-e361172b297d service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:57.781838 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb809b-ef77-4d72-be79-e361172b297d service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:57.781838 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb809b-ef77-4d72-be79-e361172b297d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:57.790873 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb809b-ef77-4d72-be79-e361172b297d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:57.792435 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb809b-ef77-4d72-be79-e361172b297d service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:57.802345 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 948/1901] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:14:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:14:57.808914 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a754989-0005-4202-8a1e-27eb8012fcd5 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:57.817535 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-8a754989-0005-4202-8a1e-27eb8012fcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:57.823768 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a754989-0005-4202-8a1e-27eb8012fcd5 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:57.828432 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb551cdf-c03c-470f-acb8-850d652917e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:57.829470 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb551cdf-c03c-470f-acb8-850d652917e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:57.829760 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb551cdf-c03c-470f-acb8-850d652917e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:57.830171 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb551cdf-c03c-470f-acb8-850d652917e2 admin admin] PATH_INFO: `/v3/projects/fb475808abab43e79f172a96ab5982fd` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:57.831380 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb551cdf-c03c-470f-acb8-850d652917e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb475808abab43e79f172a96ab5982fd)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:57.835486 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb551cdf-c03c-470f-acb8-850d652917e2 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:57.991665 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-bb551cdf-c03c-470f-acb8-850d652917e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb475808abab43e79f172a96ab5982fd', 'request_id': 'req-bb551cdf-c03c-470f-acb8-850d652917e2'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:58.059220 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-bb551cdf-c03c-470f-acb8-850d652917e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb475808abab43e79f172a96ab5982fd', 'request_id': 'req-bb551cdf-c03c-470f-acb8-850d652917e2'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:58.063913 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb809b-ef77-4d72-be79-e361172b297d service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:58.063913 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-b9bb809b-ef77-4d72-be79-e361172b297d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:58.067976 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-bb551cdf-c03c-470f-acb8-850d652917e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb475808abab43e79f172a96ab5982fd', 'request_id': 'req-bb551cdf-c03c-470f-acb8-850d652917e2'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:58.073882 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb809b-ef77-4d72-be79-e361172b297d service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:58.080979 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-bb551cdf-c03c-470f-acb8-850d652917e2 admin admin] The token cache is being invalidate because project fb475808abab43e79f172a96ab5982fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:14:58.081251 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-bb551cdf-c03c-470f-acb8-850d652917e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:58.082460 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-bb551cdf-c03c-470f-acb8-850d652917e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:58.084039 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 954/1902] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:14:57 2021] DELETE /identity/v3/projects/fb475808abab43e79f172a96ab5982fd => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:14:58.089333 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb551cdf-c03c-470f-acb8-850d652917e2 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:58.092823 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-bb551cdf-c03c-470f-acb8-850d652917e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:58.132986 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b0efc-faca-4ba5-bcc0-148259e42d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:58.133879 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b0efc-faca-4ba5-bcc0-148259e42d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:58.134163 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b0efc-faca-4ba5-bcc0-148259e42d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:58.134436 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b0efc-faca-4ba5-bcc0-148259e42d94 admin admin] PATH_INFO: `/v3/users/9a312c6f310342c28bbffe826370bbef` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:58.135665 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b0efc-faca-4ba5-bcc0-148259e42d94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a312c6f310342c28bbffe826370bbef)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:58.137809 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b0efc-faca-4ba5-bcc0-148259e42d94 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:58.166226 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb551cdf-c03c-470f-acb8-850d652917e2 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:58.171089 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea252b-9dd8-4e81-a7b7-d1c1c2eedede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:58.172234 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea252b-9dd8-4e81-a7b7-d1c1c2eedede admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:58.172613 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea252b-9dd8-4e81-a7b7-d1c1c2eedede admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:58.172961 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea252b-9dd8-4e81-a7b7-d1c1c2eedede admin admin] PATH_INFO: `/v3/users/bdf53bf7236549a7a4bd6724169b71e1` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:58.174233 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea252b-9dd8-4e81-a7b7-d1c1c2eedede admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdf53bf7236549a7a4bd6724169b71e1)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:58.177247 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea252b-9dd8-4e81-a7b7-d1c1c2eedede admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:58.423555 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-840b0efc-faca-4ba5-bcc0-148259e42d94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a312c6f310342c28bbffe826370bbef'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:58.424209 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-840b0efc-faca-4ba5-bcc0-148259e42d94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a312c6f310342c28bbffe826370bbef'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:58.430830 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-840b0efc-faca-4ba5-bcc0-148259e42d94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a312c6f310342c28bbffe826370bbef'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:58.507301 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-6fea252b-9dd8-4e81-a7b7-d1c1c2eedede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdf53bf7236549a7a4bd6724169b71e1'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:58.508018 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-6fea252b-9dd8-4e81-a7b7-d1c1c2eedede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdf53bf7236549a7a4bd6724169b71e1'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:58.508669 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-6fea252b-9dd8-4e81-a7b7-d1c1c2eedede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdf53bf7236549a7a4bd6724169b71e1'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:58.516642 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-6fea252b-9dd8-4e81-a7b7-d1c1c2eedede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdf53bf7236549a7a4bd6724169b71e1'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:58.521164 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-840b0efc-faca-4ba5-bcc0-148259e42d94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a312c6f310342c28bbffe826370bbef'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:58.540191 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-840b0efc-faca-4ba5-bcc0-148259e42d94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a312c6f310342c28bbffe826370bbef'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:58.546799 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 949/1903] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:14:58 2021] DELETE /identity/v3/users/9a312c6f310342c28bbffe826370bbef => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:14:58.547797 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b0efc-faca-4ba5-bcc0-148259e42d94 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:58.549188 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-840b0efc-faca-4ba5-bcc0-148259e42d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:58.578905 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-6fea252b-9dd8-4e81-a7b7-d1c1c2eedede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdf53bf7236549a7a4bd6724169b71e1'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:58.602761 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 955/1904] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:14:58 2021] DELETE /identity/v3/users/bdf53bf7236549a7a4bd6724169b71e1 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:14:58.608230 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55ee7f-91c1-4022-982d-05bc2a834dbc None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:58.609043 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55ee7f-91c1-4022-982d-05bc2a834dbc None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:58.609530 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55ee7f-91c1-4022-982d-05bc2a834dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:58.622069 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b0efc-faca-4ba5-bcc0-148259e42d94 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:58.632530 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-ab55ee7f-91c1-4022-982d-05bc2a834dbc None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:14:58.634518 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-ab55ee7f-91c1-4022-982d-05bc2a834dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:58.703202 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc7d5d-47e0-449c-8929-0cb135153244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:58.704137 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc7d5d-47e0-449c-8929-0cb135153244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:58.704425 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc7d5d-47e0-449c-8929-0cb135153244 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:58.704756 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc7d5d-47e0-449c-8929-0cb135153244 admin admin] PATH_INFO: `/v3/projects/6890bc95a89444e396791913437cac11` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:58.706182 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc7d5d-47e0-449c-8929-0cb135153244 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6890bc95a89444e396791913437cac11)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:58.708174 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc7d5d-47e0-449c-8929-0cb135153244 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:58.728668 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 956/1905] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:14:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:14:58.737457 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55ee7f-91c1-4022-982d-05bc2a834dbc None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:58.740282 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-ab55ee7f-91c1-4022-982d-05bc2a834dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:58.816449 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55ee7f-91c1-4022-982d-05bc2a834dbc None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:58.818376 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2ada4-cfba-4d90-a6e7-c2037a01b59d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:58.819044 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2ada4-cfba-4d90-a6e7-c2037a01b59d service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:58.819356 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2ada4-cfba-4d90-a6e7-c2037a01b59d service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:58.819631 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2ada4-cfba-4d90-a6e7-c2037a01b59d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:58.831135 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2ada4-cfba-4d90-a6e7-c2037a01b59d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:58.833287 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2ada4-cfba-4d90-a6e7-c2037a01b59d service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:58.845805 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 957/1906] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:14:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:14:58.864052 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-37fc7d5d-47e0-449c-8929-0cb135153244 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6890bc95a89444e396791913437cac11', 'request_id': 'req-37fc7d5d-47e0-449c-8929-0cb135153244'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:58.967797 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-37fc7d5d-47e0-449c-8929-0cb135153244 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6890bc95a89444e396791913437cac11', 'request_id': 'req-37fc7d5d-47e0-449c-8929-0cb135153244'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:58.981759 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-37fc7d5d-47e0-449c-8929-0cb135153244 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6890bc95a89444e396791913437cac11', 'request_id': 'req-37fc7d5d-47e0-449c-8929-0cb135153244'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:59.004460 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-37fc7d5d-47e0-449c-8929-0cb135153244 admin admin] The token cache is being invalidate because project 6890bc95a89444e396791913437cac11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:14:59.006215 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-37fc7d5d-47e0-449c-8929-0cb135153244 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:59.006383 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-37fc7d5d-47e0-449c-8929-0cb135153244 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:59.008479 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 950/1907] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:14:58 2021] DELETE /identity/v3/projects/6890bc95a89444e396791913437cac11 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:14:59.014928 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10951e48-f1e6-4c30-ad87-db998bb63808 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:59.015372 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10951e48-f1e6-4c30-ad87-db998bb63808 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:59.015753 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10951e48-f1e6-4c30-ad87-db998bb63808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:59.041064 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-10951e48-f1e6-4c30-ad87-db998bb63808 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:14:59.043124 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-10951e48-f1e6-4c30-ad87-db998bb63808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:59.117369 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 958/1908] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:14:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:14:59.125109 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038c48a-cd3f-4df0-bf7e-69d880e4b22c None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:59.126139 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038c48a-cd3f-4df0-bf7e-69d880e4b22c None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:59.126663 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038c48a-cd3f-4df0-bf7e-69d880e4b22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:59.147973 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-6038c48a-cd3f-4df0-bf7e-69d880e4b22c None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:14:59.149287 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-6038c48a-cd3f-4df0-bf7e-69d880e4b22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:59.157680 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 951/1909] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:14:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:14:59.163275 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10951e48-f1e6-4c30-ad87-db998bb63808 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:59.174491 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10951e48-f1e6-4c30-ad87-db998bb63808 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:59.180168 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b16bd-0b1d-48a8-8bc7-47b4083315f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:59.180958 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b16bd-0b1d-48a8-8bc7-47b4083315f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:59.181235 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b16bd-0b1d-48a8-8bc7-47b4083315f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:59.181510 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b16bd-0b1d-48a8-8bc7-47b4083315f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:59.182350 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b16bd-0b1d-48a8-8bc7-47b4083315f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:14:59.182674 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b16bd-0b1d-48a8-8bc7-47b4083315f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:59.192060 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b16bd-0b1d-48a8-8bc7-47b4083315f3 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:59.205218 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 959/1910] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:14:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:14:59.209619 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038c48a-cd3f-4df0-bf7e-69d880e4b22c None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:59.220925 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038c48a-cd3f-4df0-bf7e-69d880e4b22c None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:59.226906 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a74d1b-dac7-43cc-8042-6c33e1be2cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:59.227759 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a74d1b-dac7-43cc-8042-6c33e1be2cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:59.228116 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a74d1b-dac7-43cc-8042-6c33e1be2cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:59.228461 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a74d1b-dac7-43cc-8042-6c33e1be2cb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:59.229330 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a74d1b-dac7-43cc-8042-6c33e1be2cb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:59.231346 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a74d1b-dac7-43cc-8042-6c33e1be2cb4 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:59.318973 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 952/1911] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:14:59 2021] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:14:59.319621 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b16bd-0b1d-48a8-8bc7-47b4083315f3 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:59.331036 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b16bd-0b1d-48a8-8bc7-47b4083315f3 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:59.421019 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576459c-33d8-4a33-9b41-30bcfa381072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:59.422388 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576459c-33d8-4a33-9b41-30bcfa381072 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:59.422679 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576459c-33d8-4a33-9b41-30bcfa381072 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:59.423085 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576459c-33d8-4a33-9b41-30bcfa381072 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:59.423810 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576459c-33d8-4a33-9b41-30bcfa381072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:59.425959 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576459c-33d8-4a33-9b41-30bcfa381072 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:59.552028 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 960/1912] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:14:59 2021] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:14:59.556186 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a74d1b-dac7-43cc-8042-6c33e1be2cb4 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:59.568386 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a74d1b-dac7-43cc-8042-6c33e1be2cb4 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:59.583531 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576459c-33d8-4a33-9b41-30bcfa381072 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:59.585481 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-1576459c-33d8-4a33-9b41-30bcfa381072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:59.585805 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cf5a3-1e43-4391-ab25-e83df7d529ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:59.587063 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cf5a3-1e43-4391-ab25-e83df7d529ef admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:59.587562 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cf5a3-1e43-4391-ab25-e83df7d529ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:59.588183 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cf5a3-1e43-4391-ab25-e83df7d529ef admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:59.589155 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cf5a3-1e43-4391-ab25-e83df7d529ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:59.609269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576459c-33d8-4a33-9b41-30bcfa381072 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:59.614964 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cf5a3-1e43-4391-ab25-e83df7d529ef admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:59.616174 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a820e48-d1b1-4477-b702-2ef2d32bfc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:59.617099 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a820e48-d1b1-4477-b702-2ef2d32bfc9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:59.617889 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a820e48-d1b1-4477-b702-2ef2d32bfc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:59.618335 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a820e48-d1b1-4477-b702-2ef2d32bfc9f admin admin] PATH_INFO: `/v3/projects/e1ec2df5083745b796d8f38b3d808717` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:59.620072 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a820e48-d1b1-4477-b702-2ef2d32bfc9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1ec2df5083745b796d8f38b3d808717)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:59.622548 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a820e48-d1b1-4477-b702-2ef2d32bfc9f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:59.639878 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 953/1913] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:14:59 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:14:59.641473 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cf5a3-1e43-4391-ab25-e83df7d529ef admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:59.651261 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cf5a3-1e43-4391-ab25-e83df7d529ef admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:59.657594 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf607c1-6ad6-4f8c-91dc-ce2d4c9406d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:59.665643 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf607c1-6ad6-4f8c-91dc-ce2d4c9406d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:59.665643 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf607c1-6ad6-4f8c-91dc-ce2d4c9406d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:59.665643 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf607c1-6ad6-4f8c-91dc-ce2d4c9406d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:59.665643 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf607c1-6ad6-4f8c-91dc-ce2d4c9406d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:59.665643 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf607c1-6ad6-4f8c-91dc-ce2d4c9406d8 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:59.671352 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 954/1914] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:14:59 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:14:59.676365 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf607c1-6ad6-4f8c-91dc-ce2d4c9406d8 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:59.686099 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf607c1-6ad6-4f8c-91dc-ce2d4c9406d8 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:59.691400 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6b77e-7008-40ac-97c5-1f71af7fb754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:59.692930 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6b77e-7008-40ac-97c5-1f71af7fb754 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:59.693215 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6b77e-7008-40ac-97c5-1f71af7fb754 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:59.693490 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6b77e-7008-40ac-97c5-1f71af7fb754 admin admin] PATH_INFO: `/v3/projects/805ce7ebaf794c63b7466e977b855bf2/users/718cf842c8db4953a8bac5a665f4afc1/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:59.711566 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6b77e-7008-40ac-97c5-1f71af7fb754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=805ce7ebaf794c63b7466e977b855bf2, user_id=718cf842c8db4953a8bac5a665f4afc1, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:59.714367 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6b77e-7008-40ac-97c5-1f71af7fb754 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:14:59.841552 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 955/1915] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:14:59 2021] PUT /identity/v3/projects/805ce7ebaf794c63b7466e977b855bf2/users/718cf842c8db4953a8bac5a665f4afc1/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:14:59.842466 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6b77e-7008-40ac-97c5-1f71af7fb754 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:14:59.844085 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-20c6b77e-7008-40ac-97c5-1f71af7fb754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:14:59.872733 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-5a820e48-d1b1-4477-b702-2ef2d32bfc9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1ec2df5083745b796d8f38b3d808717', 'request_id': 'req-5a820e48-d1b1-4477-b702-2ef2d32bfc9f'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:14:59.918803 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6b77e-7008-40ac-97c5-1f71af7fb754 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:14:59.973901 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d07df-c938-458f-969e-386f1ffc7b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:14:59.974790 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d07df-c938-458f-969e-386f1ffc7b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:14:59.975079 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d07df-c938-458f-969e-386f1ffc7b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:14:59.975360 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d07df-c938-458f-969e-386f1ffc7b92 admin admin] PATH_INFO: `/v3/projects/f3af3e9c0afd405db0a5bef07dd610e6` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:14:59.976731 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d07df-c938-458f-969e-386f1ffc7b92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3af3e9c0afd405db0a5bef07dd610e6)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:14:59.978651 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d07df-c938-458f-969e-386f1ffc7b92 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:00.013663 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-5a820e48-d1b1-4477-b702-2ef2d32bfc9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1ec2df5083745b796d8f38b3d808717', 'request_id': 'req-5a820e48-d1b1-4477-b702-2ef2d32bfc9f'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:00.021041 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-5a820e48-d1b1-4477-b702-2ef2d32bfc9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1ec2df5083745b796d8f38b3d808717', 'request_id': 'req-5a820e48-d1b1-4477-b702-2ef2d32bfc9f'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:00.033680 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-5a820e48-d1b1-4477-b702-2ef2d32bfc9f admin admin] The token cache is being invalidate because project e1ec2df5083745b796d8f38b3d808717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:15:00.033973 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-5a820e48-d1b1-4477-b702-2ef2d32bfc9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:00.034640 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-5a820e48-d1b1-4477-b702-2ef2d32bfc9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:00.036519 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 961/1916] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:14:59 2021] DELETE /identity/v3/projects/e1ec2df5083745b796d8f38b3d808717 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:15:00.037775 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e1a9c-3cad-4dec-851c-d67e6ef16346 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:00.038067 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e1a9c-3cad-4dec-851c-d67e6ef16346 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:00.038350 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e1a9c-3cad-4dec-851c-d67e6ef16346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:00.080122 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-f79e1a9c-3cad-4dec-851c-d67e6ef16346 None None] MFA Rules not processed for user `718cf842c8db4953a8bac5a665f4afc1`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:00.081993 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-f79e1a9c-3cad-4dec-851c-d67e6ef16346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:00.187558 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 962/1917] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:00 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:00.190116 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f621e-76df-447e-b86f-95737981b3dc None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:00.190512 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f621e-76df-447e-b86f-95737981b3dc None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:00.190944 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f621e-76df-447e-b86f-95737981b3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:00.215329 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-496f621e-76df-447e-b86f-95737981b3dc None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:00.216880 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-496f621e-76df-447e-b86f-95737981b3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:00.220246 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-5e7d07df-c938-458f-969e-386f1ffc7b92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3af3e9c0afd405db0a5bef07dd610e6', 'request_id': 'req-5e7d07df-c938-458f-969e-386f1ffc7b92'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:00.288642 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 963/1918] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:00.289581 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f621e-76df-447e-b86f-95737981b3dc None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:00.291162 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-496f621e-76df-447e-b86f-95737981b3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:00.305998 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f621e-76df-447e-b86f-95737981b3dc None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:00.313552 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66829412-e66e-40d3-8614-8d628355a45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:00.316163 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66829412-e66e-40d3-8614-8d628355a45a admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:00.316163 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66829412-e66e-40d3-8614-8d628355a45a admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:00.316163 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66829412-e66e-40d3-8614-8d628355a45a admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:00.316163 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66829412-e66e-40d3-8614-8d628355a45a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:00.317956 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66829412-e66e-40d3-8614-8d628355a45a admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:00.333000 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-5e7d07df-c938-458f-969e-386f1ffc7b92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3af3e9c0afd405db0a5bef07dd610e6', 'request_id': 'req-5e7d07df-c938-458f-969e-386f1ffc7b92'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:00.341460 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-5e7d07df-c938-458f-969e-386f1ffc7b92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3af3e9c0afd405db0a5bef07dd610e6', 'request_id': 'req-5e7d07df-c938-458f-969e-386f1ffc7b92'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:00.354828 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-5e7d07df-c938-458f-969e-386f1ffc7b92 admin admin] The token cache is being invalidate because project f3af3e9c0afd405db0a5bef07dd610e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:15:00.355809 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-5e7d07df-c938-458f-969e-386f1ffc7b92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:00.356477 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-5e7d07df-c938-458f-969e-386f1ffc7b92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:00.359528 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 956/1919] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:14:59 2021] DELETE /identity/v3/projects/f3af3e9c0afd405db0a5bef07dd610e6 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:00.360773 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936d166-de0e-4969-87fe-7edb977854b5 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:00.361109 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936d166-de0e-4969-87fe-7edb977854b5 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:00.361393 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936d166-de0e-4969-87fe-7edb977854b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:00.395097 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-f936d166-de0e-4969-87fe-7edb977854b5 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:00.396086 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-f936d166-de0e-4969-87fe-7edb977854b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:00.405180 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 957/1920] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:00.406473 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89624fcb-0dfe-4d69-8797-a9d26d174187 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:00.406759 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89624fcb-0dfe-4d69-8797-a9d26d174187 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:00.407033 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89624fcb-0dfe-4d69-8797-a9d26d174187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:00.425450 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-89624fcb-0dfe-4d69-8797-a9d26d174187 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:00.427189 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-89624fcb-0dfe-4d69-8797-a9d26d174187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:00.435605 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 958/1921] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:00.436502 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89624fcb-0dfe-4d69-8797-a9d26d174187 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:00.446482 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89624fcb-0dfe-4d69-8797-a9d26d174187 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:00.451267 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5387e-1b6c-44e8-83b7-5e35522e324f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:00.451933 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5387e-1b6c-44e8-83b7-5e35522e324f admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:00.452228 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 964/1922] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:15:00 2021] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:15:00.453959 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9f02c-8d85-4362-ae82-05e4cafce6e4 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:00.454256 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9f02c-8d85-4362-ae82-05e4cafce6e4 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:00.455354 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5387e-1b6c-44e8-83b7-5e35522e324f admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:00.455566 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9f02c-8d85-4362-ae82-05e4cafce6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:00.455677 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5387e-1b6c-44e8-83b7-5e35522e324f admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:00.456414 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac5387e-1b6c-44e8-83b7-5e35522e324f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:15:00.456755 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac5387e-1b6c-44e8-83b7-5e35522e324f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:00.458883 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac5387e-1b6c-44e8-83b7-5e35522e324f admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:00.474398 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 959/1923] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:15:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:15:00.474398 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5387e-1b6c-44e8-83b7-5e35522e324f admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:00.474398 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-8ac5387e-1b6c-44e8-83b7-5e35522e324f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:00.479609 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-cbc9f02c-8d85-4362-ae82-05e4cafce6e4 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:00.481064 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-cbc9f02c-8d85-4362-ae82-05e4cafce6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:00.486443 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5387e-1b6c-44e8-83b7-5e35522e324f admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:00.576069 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 965/1924] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:00.578785 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9f02c-8d85-4362-ae82-05e4cafce6e4 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:00.600944 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9f02c-8d85-4362-ae82-05e4cafce6e4 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:00.607386 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e863ff7-404d-43c4-b096-fd2e35543b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:00.608984 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e863ff7-404d-43c4-b096-fd2e35543b16 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:00.609620 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e863ff7-404d-43c4-b096-fd2e35543b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:00.610437 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e863ff7-404d-43c4-b096-fd2e35543b16 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:00.611543 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54856358-ee79-4e03-80e6-e37dc5c1844d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:00.612119 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e863ff7-404d-43c4-b096-fd2e35543b16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:00.612235 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54856358-ee79-4e03-80e6-e37dc5c1844d admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:00.612514 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54856358-ee79-4e03-80e6-e37dc5c1844d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:00.612821 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54856358-ee79-4e03-80e6-e37dc5c1844d admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:00.613598 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54856358-ee79-4e03-80e6-e37dc5c1844d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:00.616534 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54856358-ee79-4e03-80e6-e37dc5c1844d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:00.617730 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e863ff7-404d-43c4-b096-fd2e35543b16 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:00.785723 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 960/1925] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:15:00 2021] POST /identity/v3/users => generated 289 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:15:00.786894 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e863ff7-404d-43c4-b096-fd2e35543b16 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:00.793441 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 966/1926] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:15:00 2021] POST /identity/v3/projects => generated 359 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:15:00.798044 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54856358-ee79-4e03-80e6-e37dc5c1844d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:00.824793 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e863ff7-404d-43c4-b096-fd2e35543b16 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:00.890829 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54856358-ee79-4e03-80e6-e37dc5c1844d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:00.896477 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01e43c-8ac9-43d0-99ac-006ad3a6485a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:00.897369 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01e43c-8ac9-43d0-99ac-006ad3a6485a admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:00.897652 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01e43c-8ac9-43d0-99ac-006ad3a6485a admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:00.897932 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01e43c-8ac9-43d0-99ac-006ad3a6485a admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:00.898665 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01e43c-8ac9-43d0-99ac-006ad3a6485a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:00.900274 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01e43c-8ac9-43d0-99ac-006ad3a6485a admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:00.912009 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 967/1927] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:00 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:00.913121 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01e43c-8ac9-43d0-99ac-006ad3a6485a admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:00.922703 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10483cb7-644b-4af1-8543-37677592775a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:00.924607 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01e43c-8ac9-43d0-99ac-006ad3a6485a admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:00.924728 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10483cb7-644b-4af1-8543-37677592775a admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:00.924728 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10483cb7-644b-4af1-8543-37677592775a admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:00.924728 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10483cb7-644b-4af1-8543-37677592775a admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:00.924997 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10483cb7-644b-4af1-8543-37677592775a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:15:00.925183 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10483cb7-644b-4af1-8543-37677592775a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:00.927005 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10483cb7-644b-4af1-8543-37677592775a admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:00.927975 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5114ff6-f2e0-498b-80db-b19e8cc094b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:00.928784 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5114ff6-f2e0-498b-80db-b19e8cc094b5 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:00.928964 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5114ff6-f2e0-498b-80db-b19e8cc094b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:00.929235 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5114ff6-f2e0-498b-80db-b19e8cc094b5 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:00.930191 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5114ff6-f2e0-498b-80db-b19e8cc094b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:00.931830 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5114ff6-f2e0-498b-80db-b19e8cc094b5 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:00.940049 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 961/1928] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:15:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:15:00.944778 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10483cb7-644b-4af1-8543-37677592775a admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:00.956372 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10483cb7-644b-4af1-8543-37677592775a admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:00.961382 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d12ac-e5d6-4c94-bf9b-ecf721fe701d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:00.970411 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d12ac-e5d6-4c94-bf9b-ecf721fe701d admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:00.970411 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d12ac-e5d6-4c94-bf9b-ecf721fe701d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:00.970411 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d12ac-e5d6-4c94-bf9b-ecf721fe701d admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:00.970411 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d12ac-e5d6-4c94-bf9b-ecf721fe701d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:00.970411 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d12ac-e5d6-4c94-bf9b-ecf721fe701d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:00.976778 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 962/1929] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:00 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:00.977835 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d12ac-e5d6-4c94-bf9b-ecf721fe701d admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:00.990046 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d12ac-e5d6-4c94-bf9b-ecf721fe701d admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:00.994844 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1d3c8-7cb8-4c9f-9541-e7852448a735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:00.995538 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1d3c8-7cb8-4c9f-9541-e7852448a735 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:00.995828 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1d3c8-7cb8-4c9f-9541-e7852448a735 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:00.996115 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1d3c8-7cb8-4c9f-9541-e7852448a735 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:00.996841 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1d3c8-7cb8-4c9f-9541-e7852448a735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:00.998736 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1d3c8-7cb8-4c9f-9541-e7852448a735 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:01.062275 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 968/1930] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:15:00 2021] POST /identity/v3/users => generated 280 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:15:01.062467 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5114ff6-f2e0-498b-80db-b19e8cc094b5 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:01.074134 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5114ff6-f2e0-498b-80db-b19e8cc094b5 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:01.079558 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42357c45-2f1b-4acd-bc35-311cf2441074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:01.080684 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42357c45-2f1b-4acd-bc35-311cf2441074 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:01.082548 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42357c45-2f1b-4acd-bc35-311cf2441074 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:01.082838 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42357c45-2f1b-4acd-bc35-311cf2441074 admin admin] PATH_INFO: `/v3/projects/b0936db76944455e83ce5f2fd11ee160/users/a5adf334fc7445b2adf85af9deaae7b9/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:01.089838 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 963/1931] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:15:00 2021] POST /identity/v3/projects => generated 363 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:15:01.090530 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1d3c8-7cb8-4c9f-9541-e7852448a735 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:01.098689 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42357c45-2f1b-4acd-bc35-311cf2441074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0936db76944455e83ce5f2fd11ee160, user_id=a5adf334fc7445b2adf85af9deaae7b9, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:01.103462 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42357c45-2f1b-4acd-bc35-311cf2441074 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:01.155135 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1d3c8-7cb8-4c9f-9541-e7852448a735 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:01.160099 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96a510-b4f4-4688-a011-e849fccb69bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:01.169848 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96a510-b4f4-4688-a011-e849fccb69bb admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:01.169848 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96a510-b4f4-4688-a011-e849fccb69bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:01.169848 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96a510-b4f4-4688-a011-e849fccb69bb admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:01.169848 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96a510-b4f4-4688-a011-e849fccb69bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:01.169848 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96a510-b4f4-4688-a011-e849fccb69bb admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:01.174190 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 964/1932] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:01 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:01.174821 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96a510-b4f4-4688-a011-e849fccb69bb admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:01.184797 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96a510-b4f4-4688-a011-e849fccb69bb admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:01.189915 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cfb6f-bc23-4215-bcaa-b9fa72d61fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:01.190229 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cfb6f-bc23-4215-bcaa-b9fa72d61fab admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:01.190457 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cfb6f-bc23-4215-bcaa-b9fa72d61fab admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:01.190736 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cfb6f-bc23-4215-bcaa-b9fa72d61fab admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:01.191948 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cfb6f-bc23-4215-bcaa-b9fa72d61fab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:01.193944 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cfb6f-bc23-4215-bcaa-b9fa72d61fab admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:01.212470 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 969/1933] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:15:01 2021] PUT /identity/v3/projects/b0936db76944455e83ce5f2fd11ee160/users/a5adf334fc7445b2adf85af9deaae7b9/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:01.212470 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42357c45-2f1b-4acd-bc35-311cf2441074 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:01.277211 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 965/1934] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:15:01 2021] POST /identity/v3/users => generated 282 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:15:01.281395 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a66bb-3784-4658-88a2-eaa39e9bc022 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:01.281395 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a66bb-3784-4658-88a2-eaa39e9bc022 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:01.281395 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a66bb-3784-4658-88a2-eaa39e9bc022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:01.281597 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42357c45-2f1b-4acd-bc35-311cf2441074 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:01.286101 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93accb-ef99-46d5-8fa5-b3873ec0397d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:01.286907 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93accb-ef99-46d5-8fa5-b3873ec0397d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:01.287252 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93accb-ef99-46d5-8fa5-b3873ec0397d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:01.287622 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93accb-ef99-46d5-8fa5-b3873ec0397d admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:01.288396 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93accb-ef99-46d5-8fa5-b3873ec0397d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:01.290077 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93accb-ef99-46d5-8fa5-b3873ec0397d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:01.301366 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 970/1935] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:01 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:01.302203 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93accb-ef99-46d5-8fa5-b3873ec0397d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:01.311893 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-e50a66bb-3784-4658-88a2-eaa39e9bc022 None None] MFA Rules not processed for user `a5adf334fc7445b2adf85af9deaae7b9`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:01.312854 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93accb-ef99-46d5-8fa5-b3873ec0397d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:01.313601 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-e50a66bb-3784-4658-88a2-eaa39e9bc022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:01.318666 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed40db1-f03d-4e5f-89c7-61b90eaf7506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:01.319453 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed40db1-f03d-4e5f-89c7-61b90eaf7506 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:01.319994 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed40db1-f03d-4e5f-89c7-61b90eaf7506 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:01.320195 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed40db1-f03d-4e5f-89c7-61b90eaf7506 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:01.321888 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed40db1-f03d-4e5f-89c7-61b90eaf7506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:01.323956 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed40db1-f03d-4e5f-89c7-61b90eaf7506 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:01.341018 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 971/1936] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:01 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:01.341018 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed40db1-f03d-4e5f-89c7-61b90eaf7506 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:01.350975 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed40db1-f03d-4e5f-89c7-61b90eaf7506 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:01.356580 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ab572-3cf0-4b87-a708-e508548b9060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:01.361720 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ab572-3cf0-4b87-a708-e508548b9060 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:01.361720 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ab572-3cf0-4b87-a708-e508548b9060 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:01.361720 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ab572-3cf0-4b87-a708-e508548b9060 admin admin] PATH_INFO: `/v3/projects/1b60612349c64a5c8e8c64c566a1c3ca/users/3bee2e919c084396ac7994345cb072e1/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:01.373007 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ab572-3cf0-4b87-a708-e508548b9060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b60612349c64a5c8e8c64c566a1c3ca, user_id=3bee2e919c084396ac7994345cb072e1, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:01.375756 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ab572-3cf0-4b87-a708-e508548b9060 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:01.383918 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 966/1937] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:01 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:01.387977 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a66bb-3784-4658-88a2-eaa39e9bc022 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:01.395774 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a66bb-3784-4658-88a2-eaa39e9bc022 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:01.402101 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d1d2c-d1eb-474d-aef8-a5beeec9f2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:01.402525 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d1d2c-d1eb-474d-aef8-a5beeec9f2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:01.402806 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d1d2c-d1eb-474d-aef8-a5beeec9f2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:01.403081 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d1d2c-d1eb-474d-aef8-a5beeec9f2b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:01.403803 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d1d2c-d1eb-474d-aef8-a5beeec9f2b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:01.405433 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d1d2c-d1eb-474d-aef8-a5beeec9f2b9 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:01.415138 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 967/1938] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:01 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:01.423269 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d1d2c-d1eb-474d-aef8-a5beeec9f2b9 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:01.425488 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d1d2c-d1eb-474d-aef8-a5beeec9f2b9 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:01.430324 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333724db-b66d-486c-9b3d-2c5f42ece241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:01.430969 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333724db-b66d-486c-9b3d-2c5f42ece241 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:01.431256 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333724db-b66d-486c-9b3d-2c5f42ece241 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:01.431537 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333724db-b66d-486c-9b3d-2c5f42ece241 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:01.432218 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333724db-b66d-486c-9b3d-2c5f42ece241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:01.434170 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333724db-b66d-486c-9b3d-2c5f42ece241 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:01.490116 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 972/1939] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:15:01 2021] PUT /identity/v3/projects/1b60612349c64a5c8e8c64c566a1c3ca/users/3bee2e919c084396ac7994345cb072e1/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:01.490116 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ab572-3cf0-4b87-a708-e508548b9060 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:01.571358 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 968/1940] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:15:01 2021] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:15:01.573387 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c2f0f-6620-4696-87a7-0282af5b153e None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:01.573864 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c2f0f-6620-4696-87a7-0282af5b153e None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:01.574339 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c2f0f-6620-4696-87a7-0282af5b153e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:01.595615 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ab572-3cf0-4b87-a708-e508548b9060 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:01.623096 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-c22c2f0f-6620-4696-87a7-0282af5b153e None None] MFA Rules not processed for user `3bee2e919c084396ac7994345cb072e1`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:01.624386 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-c22c2f0f-6620-4696-87a7-0282af5b153e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:01.675357 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1439d-e4fa-4c1d-82c6-c73021252371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:01.676674 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1439d-e4fa-4c1d-82c6-c73021252371 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:01.677057 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1439d-e4fa-4c1d-82c6-c73021252371 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:01.677440 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1439d-e4fa-4c1d-82c6-c73021252371 admin admin] PATH_INFO: `/v3/projects/3ac03f27b6b748f18418d6c676bdba69/users/4bf6db4c98574ff380bbbfae07e2a03a/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:01.699180 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1439d-e4fa-4c1d-82c6-c73021252371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ac03f27b6b748f18418d6c676bdba69, user_id=4bf6db4c98574ff380bbbfae07e2a03a, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:01.702277 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1439d-e4fa-4c1d-82c6-c73021252371 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:01.713730 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 969/1941] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:01 2021] POST /identity/v3/auth/tokens => generated 3379 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:01.714670 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c2f0f-6620-4696-87a7-0282af5b153e None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:01.730214 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c2f0f-6620-4696-87a7-0282af5b153e None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:01.753655 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8bce5-b72c-45bf-b62a-68df3bc2fdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:01.754879 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8bce5-b72c-45bf-b62a-68df3bc2fdf7 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:01.754879 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8bce5-b72c-45bf-b62a-68df3bc2fdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:01.754879 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8bce5-b72c-45bf-b62a-68df3bc2fdf7 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:01.755787 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8bce5-b72c-45bf-b62a-68df3bc2fdf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:01.758584 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8bce5-b72c-45bf-b62a-68df3bc2fdf7 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:01.853155 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 973/1942] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:15:01 2021] PUT /identity/v3/projects/3ac03f27b6b748f18418d6c676bdba69/users/4bf6db4c98574ff380bbbfae07e2a03a/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:01.853442 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1439d-e4fa-4c1d-82c6-c73021252371 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:01.855589 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-9bd1439d-e4fa-4c1d-82c6-c73021252371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:01.890149 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 970/1943] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:15:01 2021] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:15:01.890149 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30f76d-64db-42db-b161-e255aa92ad43 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:01.890149 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30f76d-64db-42db-b161-e255aa92ad43 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:01.890149 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30f76d-64db-42db-b161-e255aa92ad43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:01.938846 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-0e30f76d-64db-42db-b161-e255aa92ad43 None None] MFA Rules not processed for user `4bf6db4c98574ff380bbbfae07e2a03a`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:01.944088 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-0e30f76d-64db-42db-b161-e255aa92ad43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:01.956402 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1439d-e4fa-4c1d-82c6-c73021252371 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:01.964222 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86ba6e-628a-4ec7-ba3b-40c0d68b76d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:01.964222 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86ba6e-628a-4ec7-ba3b-40c0d68b76d9 service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:01.964222 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86ba6e-628a-4ec7-ba3b-40c0d68b76d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:01.964222 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86ba6e-628a-4ec7-ba3b-40c0d68b76d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:02.052759 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86ba6e-628a-4ec7-ba3b-40c0d68b76d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:02.054356 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86ba6e-628a-4ec7-ba3b-40c0d68b76d9 service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:02.058052 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 971/1944] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:01 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:02.059287 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30f76d-64db-42db-b161-e255aa92ad43 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:02.067477 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 974/1945] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:15:01 2021] GET /identity/v3/auth/tokens => generated 3379 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:15:02.067477 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86ba6e-628a-4ec7-ba3b-40c0d68b76d9 service cinder] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:02.157392 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86ba6e-628a-4ec7-ba3b-40c0d68b76d9 service cinder] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:02.170805 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee552038-418c-4971-b285-52fe92c44776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:02.170805 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee552038-418c-4971-b285-52fe92c44776 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:02.170805 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee552038-418c-4971-b285-52fe92c44776 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:02.170805 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee552038-418c-4971-b285-52fe92c44776 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:02.171622 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30f76d-64db-42db-b161-e255aa92ad43 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:02.171715 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee552038-418c-4971-b285-52fe92c44776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:02.171715 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee552038-418c-4971-b285-52fe92c44776 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:02.171881 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ab5e8-849f-444b-874f-ff9bb79192f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:02.171881 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ab5e8-849f-444b-874f-ff9bb79192f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:02.172139 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ab5e8-849f-444b-874f-ff9bb79192f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:02.172288 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ab5e8-849f-444b-874f-ff9bb79192f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:02.173070 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ab5e8-849f-444b-874f-ff9bb79192f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:02.174660 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ab5e8-849f-444b-874f-ff9bb79192f1 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:02.184916 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 972/1946] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:02 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:02.185634 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ab5e8-849f-444b-874f-ff9bb79192f1 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:02.195661 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ab5e8-849f-444b-874f-ff9bb79192f1 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:02.200404 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605e916-1c8e-4b10-aa2f-4c2789b424bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:02.201254 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605e916-1c8e-4b10-aa2f-4c2789b424bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:02.201534 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605e916-1c8e-4b10-aa2f-4c2789b424bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:02.201807 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605e916-1c8e-4b10-aa2f-4c2789b424bb admin admin] PATH_INFO: `/v3/users/3bee2e919c084396ac7994345cb072e1` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:02.203004 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605e916-1c8e-4b10-aa2f-4c2789b424bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bee2e919c084396ac7994345cb072e1)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:02.204935 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605e916-1c8e-4b10-aa2f-4c2789b424bb admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:02.263039 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 975/1947] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:15:02 2021] POST /identity/v3/projects => generated 365 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:15:02.264174 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee552038-418c-4971-b285-52fe92c44776 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:02.364338 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee552038-418c-4971-b285-52fe92c44776 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:02.370976 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeed38b-5802-44a5-a085-f0f8f83ebaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:02.371539 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeed38b-5802-44a5-a085-f0f8f83ebaee admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:02.371872 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeed38b-5802-44a5-a085-f0f8f83ebaee admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:02.372151 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeed38b-5802-44a5-a085-f0f8f83ebaee admin admin] PATH_INFO: `/v3/projects/a819e6e675c1473ca6ae55c2e5af0557/users/b570bbee91af48fbbf41fe8dcacf83a0/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:02.388874 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeed38b-5802-44a5-a085-f0f8f83ebaee admin admin] RBAC: Authorizing `identity:create_grant(project_id=a819e6e675c1473ca6ae55c2e5af0557, user_id=b570bbee91af48fbbf41fe8dcacf83a0, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:02.391532 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeed38b-5802-44a5-a085-f0f8f83ebaee admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:02.408670 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-a605e916-1c8e-4b10-aa2f-4c2789b424bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bee2e919c084396ac7994345cb072e1'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:02.409313 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-a605e916-1c8e-4b10-aa2f-4c2789b424bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bee2e919c084396ac7994345cb072e1'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:02.416505 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-a605e916-1c8e-4b10-aa2f-4c2789b424bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bee2e919c084396ac7994345cb072e1'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:02.488176 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-a605e916-1c8e-4b10-aa2f-4c2789b424bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bee2e919c084396ac7994345cb072e1'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:02.498464 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 976/1948] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:15:02 2021] PUT /identity/v3/projects/a819e6e675c1473ca6ae55c2e5af0557/users/b570bbee91af48fbbf41fe8dcacf83a0/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:02.500175 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeed38b-5802-44a5-a085-f0f8f83ebaee admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:02.509716 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-a605e916-1c8e-4b10-aa2f-4c2789b424bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bee2e919c084396ac7994345cb072e1'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:02.515867 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 973/1949] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:15:02 2021] DELETE /identity/v3/users/3bee2e919c084396ac7994345cb072e1 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:02.516693 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605e916-1c8e-4b10-aa2f-4c2789b424bb admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:02.518053 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-a605e916-1c8e-4b10-aa2f-4c2789b424bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:02.577069 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeed38b-5802-44a5-a085-f0f8f83ebaee admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:02.583056 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605e916-1c8e-4b10-aa2f-4c2789b424bb admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:02.583781 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d933f2a-0dd0-4649-8f4c-f5c54f88f523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:02.584711 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d933f2a-0dd0-4649-8f4c-f5c54f88f523 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:02.590194 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d933f2a-0dd0-4649-8f4c-f5c54f88f523 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:02.590194 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d933f2a-0dd0-4649-8f4c-f5c54f88f523 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:02.590194 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d933f2a-0dd0-4649-8f4c-f5c54f88f523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:02.590551 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed330ad-8a55-45f9-aeab-3f713e6a90bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:02.590551 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed330ad-8a55-45f9-aeab-3f713e6a90bd admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:02.590728 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d933f2a-0dd0-4649-8f4c-f5c54f88f523 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:02.590814 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed330ad-8a55-45f9-aeab-3f713e6a90bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:02.590814 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed330ad-8a55-45f9-aeab-3f713e6a90bd admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:02.590814 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed330ad-8a55-45f9-aeab-3f713e6a90bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:02.591431 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed330ad-8a55-45f9-aeab-3f713e6a90bd admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:02.601148 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 974/1950] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:02 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:02.602387 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404fa24-21a5-418f-8130-e1214382b7a9 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:02.602695 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404fa24-21a5-418f-8130-e1214382b7a9 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:02.602947 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404fa24-21a5-418f-8130-e1214382b7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:02.622964 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-b404fa24-21a5-418f-8130-e1214382b7a9 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:02.624189 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-b404fa24-21a5-418f-8130-e1214382b7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:02.633694 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 975/1951] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:02.633694 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404fa24-21a5-418f-8130-e1214382b7a9 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:02.643686 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404fa24-21a5-418f-8130-e1214382b7a9 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:02.649711 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f84e1b-90fb-4d28-bed6-419f5f61a565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:02.650607 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f84e1b-90fb-4d28-bed6-419f5f61a565 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:02.650888 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f84e1b-90fb-4d28-bed6-419f5f61a565 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:02.651163 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f84e1b-90fb-4d28-bed6-419f5f61a565 admin admin] PATH_INFO: `/v3/projects/a819e6e675c1473ca6ae55c2e5af0557/users/b570bbee91af48fbbf41fe8dcacf83a0/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:02.653278 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f84e1b-90fb-4d28-bed6-419f5f61a565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a819e6e675c1473ca6ae55c2e5af0557, user_id=b570bbee91af48fbbf41fe8dcacf83a0, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:02.655757 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f84e1b-90fb-4d28-bed6-419f5f61a565 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:02.666092 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 976/1952] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:15:02 2021] PUT /identity/v3/projects/a819e6e675c1473ca6ae55c2e5af0557/users/b570bbee91af48fbbf41fe8dcacf83a0/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:02.666883 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f84e1b-90fb-4d28-bed6-419f5f61a565 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:02.668968 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-20f84e1b-90fb-4d28-bed6-419f5f61a565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:02.695893 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 977/1953] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:15:02 2021] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:15:02.698674 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311542a-d218-4480-b529-214de251b8a6 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:02.699831 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311542a-d218-4480-b529-214de251b8a6 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:02.700351 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311542a-d218-4480-b529-214de251b8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:02.739227 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f84e1b-90fb-4d28-bed6-419f5f61a565 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:02.742631 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-6311542a-d218-4480-b529-214de251b8a6 None None] MFA Rules not processed for user `b570bbee91af48fbbf41fe8dcacf83a0`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:02.743841 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d481c-71f3-48da-9026-aa13ce3f3f0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:02.744693 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d481c-71f3-48da-9026-aa13ce3f3f0b service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:02.745117 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d481c-71f3-48da-9026-aa13ce3f3f0b service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:02.745309 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d481c-71f3-48da-9026-aa13ce3f3f0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:02.746145 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-6311542a-d218-4480-b529-214de251b8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:02.831096 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d481c-71f3-48da-9026-aa13ce3f3f0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:02.833170 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d481c-71f3-48da-9026-aa13ce3f3f0b service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:02.847608 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 977/1954] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:15:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:15:02.848387 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 978/1955] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:02 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:02.848532 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d481c-71f3-48da-9026-aa13ce3f3f0b service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:02.852073 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-7a4d481c-71f3-48da-9026-aa13ce3f3f0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:02.859988 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311542a-d218-4480-b529-214de251b8a6 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:02.861514 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-6311542a-d218-4480-b529-214de251b8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:02.895174 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d481c-71f3-48da-9026-aa13ce3f3f0b service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:02.901480 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360acc7-fde0-4c7a-a92d-3f3863fe944b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:02.902286 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360acc7-fde0-4c7a-a92d-3f3863fe944b admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:02.902580 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360acc7-fde0-4c7a-a92d-3f3863fe944b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:02.902972 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360acc7-fde0-4c7a-a92d-3f3863fe944b admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:02.904993 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360acc7-fde0-4c7a-a92d-3f3863fe944b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:02.907007 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360acc7-fde0-4c7a-a92d-3f3863fe944b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:02.923319 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 978/1956] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:02 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:02.924952 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360acc7-fde0-4c7a-a92d-3f3863fe944b admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:02.936248 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360acc7-fde0-4c7a-a92d-3f3863fe944b admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:02.943242 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92341af-7366-4d90-ac13-e2ee8f137437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:02.944220 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92341af-7366-4d90-ac13-e2ee8f137437 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:02.944790 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92341af-7366-4d90-ac13-e2ee8f137437 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:02.945490 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92341af-7366-4d90-ac13-e2ee8f137437 admin admin] PATH_INFO: `/v3/projects/2cc09695617a4955a83fbb0069244022/users/bb0b325cfe66402f97255955dd9f9142/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:02.948303 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311542a-d218-4480-b529-214de251b8a6 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:02.953451 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c56a42-9891-4137-9720-7c67d1d18311 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:02.955313 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c56a42-9891-4137-9720-7c67d1d18311 service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:02.955313 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c56a42-9891-4137-9720-7c67d1d18311 service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:02.955313 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c56a42-9891-4137-9720-7c67d1d18311 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:02.957185 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-36c56a42-9891-4137-9720-7c67d1d18311 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:02.981364 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92341af-7366-4d90-ac13-e2ee8f137437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cc09695617a4955a83fbb0069244022, user_id=bb0b325cfe66402f97255955dd9f9142, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:02.986685 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92341af-7366-4d90-ac13-e2ee8f137437 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:03.039037 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c56a42-9891-4137-9720-7c67d1d18311 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:03.041007 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c56a42-9891-4137-9720-7c67d1d18311 service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:03.052988 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 979/1957] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:15:02 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:15:03.056545 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 979/1958] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:15:02 2021] PUT /identity/v3/projects/2cc09695617a4955a83fbb0069244022/users/bb0b325cfe66402f97255955dd9f9142/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:03.061769 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c56a42-9891-4137-9720-7c67d1d18311 service cinder] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:03.079811 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c56a42-9891-4137-9720-7c67d1d18311 service cinder] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:03.176430 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de1d49-6eec-4dcb-ab10-bd7b198042a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:03.177163 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de1d49-6eec-4dcb-ab10-bd7b198042a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:03.177493 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de1d49-6eec-4dcb-ab10-bd7b198042a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:03.177774 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de1d49-6eec-4dcb-ab10-bd7b198042a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:03.178510 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de1d49-6eec-4dcb-ab10-bd7b198042a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:03.180365 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de1d49-6eec-4dcb-ab10-bd7b198042a8 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:03.197099 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 980/1959] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:03 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:03.202928 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92341af-7366-4d90-ac13-e2ee8f137437 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:03.218213 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92341af-7366-4d90-ac13-e2ee8f137437 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:03.234913 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19043cd-b240-43e8-b920-9e0c2b0f183e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:03.234913 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19043cd-b240-43e8-b920-9e0c2b0f183e admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:03.234913 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19043cd-b240-43e8-b920-9e0c2b0f183e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:03.234913 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19043cd-b240-43e8-b920-9e0c2b0f183e admin admin] PATH_INFO: `/v3/projects/2cc09695617a4955a83fbb0069244022/users/bb0b325cfe66402f97255955dd9f9142/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:03.236047 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19043cd-b240-43e8-b920-9e0c2b0f183e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cc09695617a4955a83fbb0069244022, user_id=bb0b325cfe66402f97255955dd9f9142, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:03.239370 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19043cd-b240-43e8-b920-9e0c2b0f183e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:03.257050 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 980/1960] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:15:03 2021] PUT /identity/v3/projects/2cc09695617a4955a83fbb0069244022/users/bb0b325cfe66402f97255955dd9f9142/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:15:03.277713 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920613a2-6a43-4de7-af3d-d5a97ec5acb9 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:03.278027 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920613a2-6a43-4de7-af3d-d5a97ec5acb9 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:03.278276 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920613a2-6a43-4de7-af3d-d5a97ec5acb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:03.320912 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-920613a2-6a43-4de7-af3d-d5a97ec5acb9 None None] MFA Rules not processed for user `bb0b325cfe66402f97255955dd9f9142`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:03.322297 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-920613a2-6a43-4de7-af3d-d5a97ec5acb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:03.438656 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 981/1961] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:03 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:03.491583 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19043cd-b240-43e8-b920-9e0c2b0f183e admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:03.495692 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-a19043cd-b240-43e8-b920-9e0c2b0f183e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:03.570167 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19043cd-b240-43e8-b920-9e0c2b0f183e admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:03.576133 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbaa473-a781-401b-9eca-106c185c35b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:03.576842 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbaa473-a781-401b-9eca-106c185c35b3 service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:03.577130 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbaa473-a781-401b-9eca-106c185c35b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:03.577410 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbaa473-a781-401b-9eca-106c185c35b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:03.586809 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbaa473-a781-401b-9eca-106c185c35b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:03.588255 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbaa473-a781-401b-9eca-106c185c35b3 service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:03.598286 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 981/1962] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:15:03 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:15:03.930379 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920613a2-6a43-4de7-af3d-d5a97ec5acb9 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:03.931814 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-920613a2-6a43-4de7-af3d-d5a97ec5acb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:04.009585 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920613a2-6a43-4de7-af3d-d5a97ec5acb9 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:04.023256 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b8a80-617e-4854-aa68-7f1c55cf03d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:04.023256 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b8a80-617e-4854-aa68-7f1c55cf03d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:04.023256 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b8a80-617e-4854-aa68-7f1c55cf03d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:04.023256 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b8a80-617e-4854-aa68-7f1c55cf03d0 admin admin] PATH_INFO: `/v3/projects/1b60612349c64a5c8e8c64c566a1c3ca` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:04.023577 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b8a80-617e-4854-aa68-7f1c55cf03d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b60612349c64a5c8e8c64c566a1c3ca)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:04.024061 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b8a80-617e-4854-aa68-7f1c55cf03d0 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:04.147773 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbaa473-a781-401b-9eca-106c185c35b3 service cinder] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:04.156519 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbaa473-a781-401b-9eca-106c185c35b3 service cinder] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:04.169986 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305116cf-36b3-4377-be46-3ca72642a8b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:04.169986 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305116cf-36b3-4377-be46-3ca72642a8b7 service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:04.169986 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305116cf-36b3-4377-be46-3ca72642a8b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:04.169986 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305116cf-36b3-4377-be46-3ca72642a8b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:04.171212 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-305116cf-36b3-4377-be46-3ca72642a8b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:04.181881 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-546b8a80-617e-4854-aa68-7f1c55cf03d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b60612349c64a5c8e8c64c566a1c3ca', 'request_id': 'req-546b8a80-617e-4854-aa68-7f1c55cf03d0'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:04.241083 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305116cf-36b3-4377-be46-3ca72642a8b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:04.243064 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305116cf-36b3-4377-be46-3ca72642a8b7 service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:04.247813 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-546b8a80-617e-4854-aa68-7f1c55cf03d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b60612349c64a5c8e8c64c566a1c3ca', 'request_id': 'req-546b8a80-617e-4854-aa68-7f1c55cf03d0'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:04.254557 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 982/1963] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:15:04 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:15:04.255420 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-546b8a80-617e-4854-aa68-7f1c55cf03d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b60612349c64a5c8e8c64c566a1c3ca', 'request_id': 'req-546b8a80-617e-4854-aa68-7f1c55cf03d0'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:04.269966 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-546b8a80-617e-4854-aa68-7f1c55cf03d0 admin admin] The token cache is being invalidate because project 1b60612349c64a5c8e8c64c566a1c3ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:15:04.270255 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-546b8a80-617e-4854-aa68-7f1c55cf03d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:04.271455 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-546b8a80-617e-4854-aa68-7f1c55cf03d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:04.273526 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 982/1964] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:15:03 2021] DELETE /identity/v3/projects/1b60612349c64a5c8e8c64c566a1c3ca => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:04.281080 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbb3c1-3447-4b6b-9cfe-34f0af2570d2 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:04.281384 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbb3c1-3447-4b6b-9cfe-34f0af2570d2 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:04.281671 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbb3c1-3447-4b6b-9cfe-34f0af2570d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:04.305524 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-ccfbb3c1-3447-4b6b-9cfe-34f0af2570d2 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:04.306987 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-ccfbb3c1-3447-4b6b-9cfe-34f0af2570d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:04.365662 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 983/1965] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:04.373601 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba44da-0561-4867-84ac-9cd32988ec45 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:04.374696 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba44da-0561-4867-84ac-9cd32988ec45 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:04.374989 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba44da-0561-4867-84ac-9cd32988ec45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:04.398280 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-feba44da-0561-4867-84ac-9cd32988ec45 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:04.399472 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-feba44da-0561-4867-84ac-9cd32988ec45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:04.407461 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 983/1966] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:15:04.412134 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbb3c1-3447-4b6b-9cfe-34f0af2570d2 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:04.421562 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbb3c1-3447-4b6b-9cfe-34f0af2570d2 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:04.426823 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c457585-e222-4a1b-afd4-d6b0543c190d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:04.427489 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c457585-e222-4a1b-afd4-d6b0543c190d admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:04.427777 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c457585-e222-4a1b-afd4-d6b0543c190d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:04.428056 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c457585-e222-4a1b-afd4-d6b0543c190d admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:04.428824 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c457585-e222-4a1b-afd4-d6b0543c190d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:15:04.429132 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c457585-e222-4a1b-afd4-d6b0543c190d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:04.430724 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c457585-e222-4a1b-afd4-d6b0543c190d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:04.442396 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 984/1967] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:15:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:15:04.446487 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba44da-0561-4867-84ac-9cd32988ec45 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:04.455946 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba44da-0561-4867-84ac-9cd32988ec45 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:04.460661 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1accc3-f40a-4ecc-a010-416b360587b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:04.461399 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1accc3-f40a-4ecc-a010-416b360587b3 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:04.461682 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1accc3-f40a-4ecc-a010-416b360587b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:04.461957 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1accc3-f40a-4ecc-a010-416b360587b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:04.462649 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1accc3-f40a-4ecc-a010-416b360587b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:04.464645 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1accc3-f40a-4ecc-a010-416b360587b3 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:04.554642 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 984/1968] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:15:04 2021] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:15:04.558807 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c457585-e222-4a1b-afd4-d6b0543c190d admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:04.569567 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c457585-e222-4a1b-afd4-d6b0543c190d admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:04.637171 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34006816-6738-4f70-a118-0f8fd01411bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:04.637758 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34006816-6738-4f70-a118-0f8fd01411bb admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:04.638047 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34006816-6738-4f70-a118-0f8fd01411bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:04.638360 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34006816-6738-4f70-a118-0f8fd01411bb admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:04.639197 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34006816-6738-4f70-a118-0f8fd01411bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:04.641707 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34006816-6738-4f70-a118-0f8fd01411bb admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:04.791953 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 985/1969] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:15:04 2021] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:15:04.795821 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1accc3-f40a-4ecc-a010-416b360587b3 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:04.806044 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1accc3-f40a-4ecc-a010-416b360587b3 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:04.810714 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283fff4-b313-4e60-b34b-08a4ee2c295d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:04.811386 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283fff4-b313-4e60-b34b-08a4ee2c295d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:04.811668 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283fff4-b313-4e60-b34b-08a4ee2c295d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:04.811944 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283fff4-b313-4e60-b34b-08a4ee2c295d admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:04.812701 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283fff4-b313-4e60-b34b-08a4ee2c295d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:04.814302 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283fff4-b313-4e60-b34b-08a4ee2c295d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:04.825019 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 985/1970] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:04 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:04.828910 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34006816-6738-4f70-a118-0f8fd01411bb admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:04.839044 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34006816-6738-4f70-a118-0f8fd01411bb admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:04.843822 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7dcf4-a011-4d04-a135-47dca4298dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:04.844476 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7dcf4-a011-4d04-a135-47dca4298dfa admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:04.844789 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7dcf4-a011-4d04-a135-47dca4298dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:04.845174 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7dcf4-a011-4d04-a135-47dca4298dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:04.845998 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7dcf4-a011-4d04-a135-47dca4298dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:04.848156 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7dcf4-a011-4d04-a135-47dca4298dfa admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:04.858521 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 986/1971] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:04 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:04.862628 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283fff4-b313-4e60-b34b-08a4ee2c295d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:04.872571 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283fff4-b313-4e60-b34b-08a4ee2c295d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:04.877245 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452004b-8ab0-412f-965e-584209ee6d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:04.878183 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452004b-8ab0-412f-965e-584209ee6d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:04.878472 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452004b-8ab0-412f-965e-584209ee6d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:04.878760 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452004b-8ab0-412f-965e-584209ee6d83 admin admin] PATH_INFO: `/v3/projects/35231e718e594a2e806bf159d80611cc/users/241c3c8895cf44609f842dff48c08607/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:04.893096 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5452004b-8ab0-412f-965e-584209ee6d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35231e718e594a2e806bf159d80611cc, user_id=241c3c8895cf44609f842dff48c08607, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:04.896228 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5452004b-8ab0-412f-965e-584209ee6d83 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:05.020229 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 986/1972] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:15:04 2021] PUT /identity/v3/projects/35231e718e594a2e806bf159d80611cc/users/241c3c8895cf44609f842dff48c08607/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:15:05.030440 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43ac40-d131-4c72-bfcd-8a08e0d36e5c None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:05.030734 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43ac40-d131-4c72-bfcd-8a08e0d36e5c None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:05.031019 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43ac40-d131-4c72-bfcd-8a08e0d36e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:05.058288 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-ab43ac40-d131-4c72-bfcd-8a08e0d36e5c None None] MFA Rules not processed for user `241c3c8895cf44609f842dff48c08607`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:05.059503 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-ab43ac40-d131-4c72-bfcd-8a08e0d36e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:05.123678 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 987/1973] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:05 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:05.133104 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452004b-8ab0-412f-965e-584209ee6d83 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:05.134915 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-5452004b-8ab0-412f-965e-584209ee6d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:05.220355 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452004b-8ab0-412f-965e-584209ee6d83 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:05.224938 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42292298-790a-4e8c-bad8-1a8e2dc35a2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:05.233312 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42292298-790a-4e8c-bad8-1a8e2dc35a2c service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:05.233674 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42292298-790a-4e8c-bad8-1a8e2dc35a2c service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:05.234024 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42292298-790a-4e8c-bad8-1a8e2dc35a2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:05.244627 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42292298-790a-4e8c-bad8-1a8e2dc35a2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:05.246232 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42292298-790a-4e8c-bad8-1a8e2dc35a2c service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:05.255518 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 987/1974] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:15:05 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:15:06.138596 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43ac40-d131-4c72-bfcd-8a08e0d36e5c None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:06.138596 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-ab43ac40-d131-4c72-bfcd-8a08e0d36e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:06.202093 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43ac40-d131-4c72-bfcd-8a08e0d36e5c None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:06.206809 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82db33-1fa2-4620-85dd-aa6e2836cde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:06.207691 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82db33-1fa2-4620-85dd-aa6e2836cde6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:06.207976 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82db33-1fa2-4620-85dd-aa6e2836cde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:06.208250 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82db33-1fa2-4620-85dd-aa6e2836cde6 admin admin] PATH_INFO: `/v3/users/415880421b3f4b7896e49188e8d1395c` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:06.209484 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82db33-1fa2-4620-85dd-aa6e2836cde6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=415880421b3f4b7896e49188e8d1395c)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:06.211439 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82db33-1fa2-4620-85dd-aa6e2836cde6 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:06.468091 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-9e82db33-1fa2-4620-85dd-aa6e2836cde6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '415880421b3f4b7896e49188e8d1395c'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:06.468888 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-9e82db33-1fa2-4620-85dd-aa6e2836cde6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '415880421b3f4b7896e49188e8d1395c'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:06.476716 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-9e82db33-1fa2-4620-85dd-aa6e2836cde6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '415880421b3f4b7896e49188e8d1395c'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:06.573638 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-9e82db33-1fa2-4620-85dd-aa6e2836cde6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '415880421b3f4b7896e49188e8d1395c'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:06.594580 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-9e82db33-1fa2-4620-85dd-aa6e2836cde6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '415880421b3f4b7896e49188e8d1395c'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:06.598727 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 988/1975] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:15:06 2021] DELETE /identity/v3/users/415880421b3f4b7896e49188e8d1395c => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:06.652088 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42292298-790a-4e8c-bad8-1a8e2dc35a2c service cinder] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:06.661246 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42292298-790a-4e8c-bad8-1a8e2dc35a2c service cinder] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:06.726096 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da4723-bf79-49ba-b26b-7555b548becc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:06.727291 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da4723-bf79-49ba-b26b-7555b548becc service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:06.727719 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da4723-bf79-49ba-b26b-7555b548becc service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:06.728662 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da4723-bf79-49ba-b26b-7555b548becc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:06.731077 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-f0da4723-bf79-49ba-b26b-7555b548becc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:06.793586 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da4723-bf79-49ba-b26b-7555b548becc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:06.795033 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da4723-bf79-49ba-b26b-7555b548becc service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:06.805212 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 988/1976] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:15:06 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:15:06.904767 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82db33-1fa2-4620-85dd-aa6e2836cde6 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:06.906357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-9e82db33-1fa2-4620-85dd-aa6e2836cde6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:06.972274 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82db33-1fa2-4620-85dd-aa6e2836cde6 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:06.977872 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10102f-711e-4616-86f7-4f237f4d1a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:06.978930 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10102f-711e-4616-86f7-4f237f4d1a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:06.979212 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10102f-711e-4616-86f7-4f237f4d1a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:06.979484 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10102f-711e-4616-86f7-4f237f4d1a47 admin admin] PATH_INFO: `/v3/projects/a580adcc8b084ba2b1b657bd1b2a9a1a` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:06.980882 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10102f-711e-4616-86f7-4f237f4d1a47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a580adcc8b084ba2b1b657bd1b2a9a1a)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:06.983047 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10102f-711e-4616-86f7-4f237f4d1a47 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:07.109789 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-ff10102f-711e-4616-86f7-4f237f4d1a47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'request_id': 'req-ff10102f-711e-4616-86f7-4f237f4d1a47'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:07.184646 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-ff10102f-711e-4616-86f7-4f237f4d1a47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'request_id': 'req-ff10102f-711e-4616-86f7-4f237f4d1a47'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:07.190243 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-ff10102f-711e-4616-86f7-4f237f4d1a47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'request_id': 'req-ff10102f-711e-4616-86f7-4f237f4d1a47'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:07.201839 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-ff10102f-711e-4616-86f7-4f237f4d1a47 admin admin] The token cache is being invalidate because project a580adcc8b084ba2b1b657bd1b2a9a1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:15:07.202127 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-ff10102f-711e-4616-86f7-4f237f4d1a47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:07.202748 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-ff10102f-711e-4616-86f7-4f237f4d1a47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:07.204291 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 989/1977] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:15:06 2021] DELETE /identity/v3/projects/a580adcc8b084ba2b1b657bd1b2a9a1a => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:07.210124 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d1650-41df-4595-b768-707c18fef11b None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:07.210485 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d1650-41df-4595-b768-707c18fef11b None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:07.210800 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d1650-41df-4595-b768-707c18fef11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:07.229002 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-3c2d1650-41df-4595-b768-707c18fef11b None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:07.230188 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-3c2d1650-41df-4595-b768-707c18fef11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:07.289523 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 989/1978] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:07.330230 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e991d24-a639-478a-bfa8-12df2a84f88d None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:07.330518 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e991d24-a639-478a-bfa8-12df2a84f88d None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:07.330818 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e991d24-a639-478a-bfa8-12df2a84f88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:07.349212 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-6e991d24-a639-478a-bfa8-12df2a84f88d None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:07.350400 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-6e991d24-a639-478a-bfa8-12df2a84f88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:07.358446 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 990/1979] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:15:07.362726 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d1650-41df-4595-b768-707c18fef11b None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:07.373136 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d1650-41df-4595-b768-707c18fef11b None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:07.377723 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ec8ac-de59-438e-855b-2682bb2271b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:07.378390 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ec8ac-de59-438e-855b-2682bb2271b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:07.378686 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ec8ac-de59-438e-855b-2682bb2271b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:07.378967 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ec8ac-de59-438e-855b-2682bb2271b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:07.379690 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ec8ac-de59-438e-855b-2682bb2271b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:15:07.380002 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ec8ac-de59-438e-855b-2682bb2271b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:07.381619 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ec8ac-de59-438e-855b-2682bb2271b5 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:07.392858 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 990/1980] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:15:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:15:07.396936 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e991d24-a639-478a-bfa8-12df2a84f88d None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:07.406256 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e991d24-a639-478a-bfa8-12df2a84f88d None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:07.411718 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfc488-eb43-4b16-bafc-ca389dacdbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:07.412604 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfc488-eb43-4b16-bafc-ca389dacdbf3 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:07.412893 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfc488-eb43-4b16-bafc-ca389dacdbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:07.413175 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfc488-eb43-4b16-bafc-ca389dacdbf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:07.413882 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cfc488-eb43-4b16-bafc-ca389dacdbf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:07.415866 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cfc488-eb43-4b16-bafc-ca389dacdbf3 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:07.513247 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 991/1981] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:15:07 2021] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:15:07.517089 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ec8ac-de59-438e-855b-2682bb2271b5 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:07.527666 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ec8ac-de59-438e-855b-2682bb2271b5 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:07.595546 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811ec7e-00c9-4f4f-8774-2e717413c973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:07.598984 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811ec7e-00c9-4f4f-8774-2e717413c973 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:07.598984 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811ec7e-00c9-4f4f-8774-2e717413c973 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:07.598984 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811ec7e-00c9-4f4f-8774-2e717413c973 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:07.598984 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811ec7e-00c9-4f4f-8774-2e717413c973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:07.599956 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811ec7e-00c9-4f4f-8774-2e717413c973 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:07.914736 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 991/1982] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:15:07 2021] POST /identity/v3/users => generated 293 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:15:07.921305 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfc488-eb43-4b16-bafc-ca389dacdbf3 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:07.934488 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfc488-eb43-4b16-bafc-ca389dacdbf3 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:07.943752 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16dd1a9-ce70-4030-9536-6149192a019c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:07.944445 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16dd1a9-ce70-4030-9536-6149192a019c admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:07.949584 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16dd1a9-ce70-4030-9536-6149192a019c admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:07.949584 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16dd1a9-ce70-4030-9536-6149192a019c admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:07.949584 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16dd1a9-ce70-4030-9536-6149192a019c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:07.949584 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16dd1a9-ce70-4030-9536-6149192a019c admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:07.960033 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 992/1983] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:07 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:07.964142 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811ec7e-00c9-4f4f-8774-2e717413c973 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:07.974916 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811ec7e-00c9-4f4f-8774-2e717413c973 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:07.978829 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c57784-b402-4724-b24e-52c937f2d563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:07.981094 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c57784-b402-4724-b24e-52c937f2d563 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:07.981094 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c57784-b402-4724-b24e-52c937f2d563 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:07.981094 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c57784-b402-4724-b24e-52c937f2d563 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:07.981094 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c57784-b402-4724-b24e-52c937f2d563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:07.982704 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c57784-b402-4724-b24e-52c937f2d563 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:07.993360 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 992/1984] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:07 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:07.997621 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16dd1a9-ce70-4030-9536-6149192a019c admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:08.008139 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16dd1a9-ce70-4030-9536-6149192a019c admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:08.012904 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac68c6-32d5-4dc3-88ee-dd8eb53e9a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:08.013804 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac68c6-32d5-4dc3-88ee-dd8eb53e9a1a admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:08.014069 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac68c6-32d5-4dc3-88ee-dd8eb53e9a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:08.014346 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac68c6-32d5-4dc3-88ee-dd8eb53e9a1a admin admin] PATH_INFO: `/v3/projects/039e64d8bef041b288c6b7bdc93d4c23/users/3dd396d233694e2eb83cc771b4c49862/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:08.028793 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac68c6-32d5-4dc3-88ee-dd8eb53e9a1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=039e64d8bef041b288c6b7bdc93d4c23, user_id=3dd396d233694e2eb83cc771b4c49862, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:08.031511 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac68c6-32d5-4dc3-88ee-dd8eb53e9a1a admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:08.113079 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 993/1985] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:15:07 2021] PUT /identity/v3/projects/039e64d8bef041b288c6b7bdc93d4c23/users/3dd396d233694e2eb83cc771b4c49862/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:08.121386 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe07c1-aea8-4f63-9f10-1646c5eae825 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:08.121821 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe07c1-aea8-4f63-9f10-1646c5eae825 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:08.122117 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe07c1-aea8-4f63-9f10-1646c5eae825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:08.156541 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-62fe07c1-aea8-4f63-9f10-1646c5eae825 None None] MFA Rules not processed for user `3dd396d233694e2eb83cc771b4c49862`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:08.157900 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-62fe07c1-aea8-4f63-9f10-1646c5eae825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:08.242365 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 993/1986] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:08 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:08.246685 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac68c6-32d5-4dc3-88ee-dd8eb53e9a1a admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:08.325910 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac68c6-32d5-4dc3-88ee-dd8eb53e9a1a admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:08.333075 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685b44a-796b-4239-854b-10e49c6d650c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:08.333765 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685b44a-796b-4239-854b-10e49c6d650c admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:08.334053 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685b44a-796b-4239-854b-10e49c6d650c admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:08.334334 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685b44a-796b-4239-854b-10e49c6d650c admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:08.335034 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685b44a-796b-4239-854b-10e49c6d650c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:08.337028 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685b44a-796b-4239-854b-10e49c6d650c admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:08.428525 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 994/1987] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:15:08 2021] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:15:08.429731 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe07c1-aea8-4f63-9f10-1646c5eae825 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:08.441982 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe07c1-aea8-4f63-9f10-1646c5eae825 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:08.500908 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3ac43-4c7a-43f0-928e-632b565e19ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:08.501593 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3ac43-4c7a-43f0-928e-632b565e19ec admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:08.501873 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3ac43-4c7a-43f0-928e-632b565e19ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:08.502150 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3ac43-4c7a-43f0-928e-632b565e19ec admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:08.502837 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef3ac43-4c7a-43f0-928e-632b565e19ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:08.504796 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef3ac43-4c7a-43f0-928e-632b565e19ec admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:08.536948 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685b44a-796b-4239-854b-10e49c6d650c admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:08.538752 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-0685b44a-796b-4239-854b-10e49c6d650c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:08.607016 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685b44a-796b-4239-854b-10e49c6d650c admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:08.615895 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 994/1988] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:15:08 2021] POST /identity/v3/users => generated 300 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:15:08.619255 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3ac43-4c7a-43f0-928e-632b565e19ec admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:08.620604 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50d18f-5f7a-4ca5-892f-239e489a532a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:08.621289 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50d18f-5f7a-4ca5-892f-239e489a532a service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:08.621577 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50d18f-5f7a-4ca5-892f-239e489a532a service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:08.621858 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50d18f-5f7a-4ca5-892f-239e489a532a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:08.625112 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-bd50d18f-5f7a-4ca5-892f-239e489a532a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:08.631521 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3ac43-4c7a-43f0-928e-632b565e19ec admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:08.638126 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce9ee3-2eaf-4dbd-9797-a82d39f461c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:08.639019 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce9ee3-2eaf-4dbd-9797-a82d39f461c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:08.639626 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce9ee3-2eaf-4dbd-9797-a82d39f461c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:08.640422 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce9ee3-2eaf-4dbd-9797-a82d39f461c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:08.641399 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce9ee3-2eaf-4dbd-9797-a82d39f461c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:08.644360 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce9ee3-2eaf-4dbd-9797-a82d39f461c6 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:08.659028 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 995/1989] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:08 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:08.662854 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce9ee3-2eaf-4dbd-9797-a82d39f461c6 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:08.674684 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce9ee3-2eaf-4dbd-9797-a82d39f461c6 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:08.680636 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5bf28-68e8-4f00-a5b4-2d1fcd9d8614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:08.681782 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5bf28-68e8-4f00-a5b4-2d1fcd9d8614 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:08.683019 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5bf28-68e8-4f00-a5b4-2d1fcd9d8614 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:08.683386 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5bf28-68e8-4f00-a5b4-2d1fcd9d8614 admin admin] PATH_INFO: `/v3/projects/afd619185440445f82b685fe4d5fa430/users/5b6f1bc9115241d7827595202fd1187d/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:08.704154 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5bf28-68e8-4f00-a5b4-2d1fcd9d8614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afd619185440445f82b685fe4d5fa430, user_id=5b6f1bc9115241d7827595202fd1187d, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:08.707748 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5bf28-68e8-4f00-a5b4-2d1fcd9d8614 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:08.715103 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50d18f-5f7a-4ca5-892f-239e489a532a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:08.716210 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50d18f-5f7a-4ca5-892f-239e489a532a service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:08.726617 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 995/1990] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:15:08 2021] GET /identity/v3/auth/tokens => generated 3462 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:15:08.927875 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 996/1991] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:15:08 2021] PUT /identity/v3/projects/afd619185440445f82b685fe4d5fa430/users/5b6f1bc9115241d7827595202fd1187d/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:08.931892 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50d18f-5f7a-4ca5-892f-239e489a532a service cinder] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:08.942054 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50d18f-5f7a-4ca5-892f-239e489a532a service cinder] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:08.996802 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f8668-f1b8-41f3-a77b-2c6b784b5fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:08.997490 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f8668-f1b8-41f3-a77b-2c6b784b5fba admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:08.997774 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f8668-f1b8-41f3-a77b-2c6b784b5fba admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:08.998050 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f8668-f1b8-41f3-a77b-2c6b784b5fba admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:08.998777 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f8668-f1b8-41f3-a77b-2c6b784b5fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:09.000359 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f8668-f1b8-41f3-a77b-2c6b784b5fba admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:09.010263 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 996/1992] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:08 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:09.014435 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5bf28-68e8-4f00-a5b4-2d1fcd9d8614 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:09.024985 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5bf28-68e8-4f00-a5b4-2d1fcd9d8614 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:09.029663 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93299a-3293-45d7-8763-09f9b43b8d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:09.030645 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93299a-3293-45d7-8763-09f9b43b8d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:09.030959 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93299a-3293-45d7-8763-09f9b43b8d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:09.031268 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93299a-3293-45d7-8763-09f9b43b8d35 admin admin] PATH_INFO: `/v3/projects/afd619185440445f82b685fe4d5fa430/users/5b6f1bc9115241d7827595202fd1187d/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:09.033914 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93299a-3293-45d7-8763-09f9b43b8d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afd619185440445f82b685fe4d5fa430, user_id=5b6f1bc9115241d7827595202fd1187d, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:09.037191 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93299a-3293-45d7-8763-09f9b43b8d35 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:09.047742 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 997/1993] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:15:09 2021] PUT /identity/v3/projects/afd619185440445f82b685fe4d5fa430/users/5b6f1bc9115241d7827595202fd1187d/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:09.058534 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d28f4-91de-45ff-ad5a-53e991083ea4 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:09.058827 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d28f4-91de-45ff-ad5a-53e991083ea4 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:09.059132 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d28f4-91de-45ff-ad5a-53e991083ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:09.094524 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-ca8d28f4-91de-45ff-ad5a-53e991083ea4 None None] MFA Rules not processed for user `5b6f1bc9115241d7827595202fd1187d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:09.095823 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-ca8d28f4-91de-45ff-ad5a-53e991083ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:09.190893 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 997/1994] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:09 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:09.264630 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93299a-3293-45d7-8763-09f9b43b8d35 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:09.441203 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93299a-3293-45d7-8763-09f9b43b8d35 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:09.445463 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fbb0a-5ff4-4e36-ae4c-eb2a6ee0eb5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:09.446130 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fbb0a-5ff4-4e36-ae4c-eb2a6ee0eb5a service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:09.446414 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fbb0a-5ff4-4e36-ae4c-eb2a6ee0eb5a service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:09.446692 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fbb0a-5ff4-4e36-ae4c-eb2a6ee0eb5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:09.455597 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13fbb0a-5ff4-4e36-ae4c-eb2a6ee0eb5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:09.457082 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13fbb0a-5ff4-4e36-ae4c-eb2a6ee0eb5a service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:09.466284 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 998/1995] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:15:09 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:15:09.494930 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d28f4-91de-45ff-ad5a-53e991083ea4 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:09.561571 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d28f4-91de-45ff-ad5a-53e991083ea4 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:09.561571 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca586a-e88a-4b65-ade2-2f0f68d2f384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:09.561571 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca586a-e88a-4b65-ade2-2f0f68d2f384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:09.561571 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca586a-e88a-4b65-ade2-2f0f68d2f384 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:09.562570 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca586a-e88a-4b65-ade2-2f0f68d2f384 admin admin] PATH_INFO: `/v3/users/3dd396d233694e2eb83cc771b4c49862` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:09.562570 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca586a-e88a-4b65-ade2-2f0f68d2f384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dd396d233694e2eb83cc771b4c49862)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:09.564047 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca586a-e88a-4b65-ade2-2f0f68d2f384 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:09.917676 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-e8ca586a-e88a-4b65-ade2-2f0f68d2f384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dd396d233694e2eb83cc771b4c49862'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:09.918330 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-e8ca586a-e88a-4b65-ade2-2f0f68d2f384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dd396d233694e2eb83cc771b4c49862'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:09.924870 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-e8ca586a-e88a-4b65-ade2-2f0f68d2f384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dd396d233694e2eb83cc771b4c49862'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:10.064752 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-e8ca586a-e88a-4b65-ade2-2f0f68d2f384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dd396d233694e2eb83cc771b4c49862'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:10.076619 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-e8ca586a-e88a-4b65-ade2-2f0f68d2f384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dd396d233694e2eb83cc771b4c49862'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:10.082787 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 998/1996] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:15:09 2021] DELETE /identity/v3/users/3dd396d233694e2eb83cc771b4c49862 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:15:10.087319 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97343d0-b130-43d4-9be4-fa2b25facb3e None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:10.088121 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97343d0-b130-43d4-9be4-fa2b25facb3e None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:10.088398 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97343d0-b130-43d4-9be4-fa2b25facb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:10.111573 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-f97343d0-b130-43d4-9be4-fa2b25facb3e None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:10.115237 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-f97343d0-b130-43d4-9be4-fa2b25facb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:10.191624 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 999/1997] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:10.201563 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca586a-e88a-4b65-ade2-2f0f68d2f384 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:10.203009 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-e8ca586a-e88a-4b65-ade2-2f0f68d2f384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:10.261359 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca586a-e88a-4b65-ade2-2f0f68d2f384 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:10.266747 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f02ed-4bcf-4258-9d5f-a319fd8d8d6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:10.267442 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f02ed-4bcf-4258-9d5f-a319fd8d8d6d service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:10.267933 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f02ed-4bcf-4258-9d5f-a319fd8d8d6d service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:10.268215 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f02ed-4bcf-4258-9d5f-a319fd8d8d6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:10.279338 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f02ed-4bcf-4258-9d5f-a319fd8d8d6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:10.281578 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f02ed-4bcf-4258-9d5f-a319fd8d8d6d service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:10.292583 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 999/1998] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:15:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:15:10.815235 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97343d0-b130-43d4-9be4-fa2b25facb3e None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:10.817277 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-f97343d0-b130-43d4-9be4-fa2b25facb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:10.829786 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97343d0-b130-43d4-9be4-fa2b25facb3e None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:10.833682 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5349d4d-2c0c-487a-a580-0b8d22dd373d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:10.834543 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5349d4d-2c0c-487a-a580-0b8d22dd373d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:10.834820 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5349d4d-2c0c-487a-a580-0b8d22dd373d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:10.835093 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5349d4d-2c0c-487a-a580-0b8d22dd373d admin admin] PATH_INFO: `/v3/projects/039e64d8bef041b288c6b7bdc93d4c23` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:10.836299 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5349d4d-2c0c-487a-a580-0b8d22dd373d admin admin] RBAC: Authorizing `identity:delete_project(project_id=039e64d8bef041b288c6b7bdc93d4c23)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:10.838221 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5349d4d-2c0c-487a-a580-0b8d22dd373d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:10.980179 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b5349d4d-2c0c-487a-a580-0b8d22dd373d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '039e64d8bef041b288c6b7bdc93d4c23', 'request_id': 'req-b5349d4d-2c0c-487a-a580-0b8d22dd373d'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:11.041817 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b5349d4d-2c0c-487a-a580-0b8d22dd373d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '039e64d8bef041b288c6b7bdc93d4c23', 'request_id': 'req-b5349d4d-2c0c-487a-a580-0b8d22dd373d'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:11.047659 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b5349d4d-2c0c-487a-a580-0b8d22dd373d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '039e64d8bef041b288c6b7bdc93d4c23', 'request_id': 'req-b5349d4d-2c0c-487a-a580-0b8d22dd373d'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:11.059861 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b5349d4d-2c0c-487a-a580-0b8d22dd373d admin admin] The token cache is being invalidate because project 039e64d8bef041b288c6b7bdc93d4c23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:15:11.060221 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b5349d4d-2c0c-487a-a580-0b8d22dd373d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:11.060885 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b5349d4d-2c0c-487a-a580-0b8d22dd373d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:11.062420 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1000/1999] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:15:10 2021] DELETE /identity/v3/projects/039e64d8bef041b288c6b7bdc93d4c23 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:11.072097 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f02ed-4bcf-4258-9d5f-a319fd8d8d6d service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:11.082308 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f02ed-4bcf-4258-9d5f-a319fd8d8d6d service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:11.139812 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ae81a-3aa9-47c3-aa62-d6b51f1d8d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:11.140732 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ae81a-3aa9-47c3-aa62-d6b51f1d8d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:11.141011 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ae81a-3aa9-47c3-aa62-d6b51f1d8d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:11.141286 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ae81a-3aa9-47c3-aa62-d6b51f1d8d65 admin admin] PATH_INFO: `/v3/users/5b6f1bc9115241d7827595202fd1187d` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:11.142457 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ae81a-3aa9-47c3-aa62-d6b51f1d8d65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b6f1bc9115241d7827595202fd1187d)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:11.144357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ae81a-3aa9-47c3-aa62-d6b51f1d8d65 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:11.319471 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-c13ae81a-3aa9-47c3-aa62-d6b51f1d8d65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b6f1bc9115241d7827595202fd1187d'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:11.320714 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-c13ae81a-3aa9-47c3-aa62-d6b51f1d8d65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b6f1bc9115241d7827595202fd1187d'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:11.335268 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-c13ae81a-3aa9-47c3-aa62-d6b51f1d8d65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b6f1bc9115241d7827595202fd1187d'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:11.453275 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-c13ae81a-3aa9-47c3-aa62-d6b51f1d8d65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b6f1bc9115241d7827595202fd1187d'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:11.465252 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-c13ae81a-3aa9-47c3-aa62-d6b51f1d8d65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b6f1bc9115241d7827595202fd1187d'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:11.471000 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1000/2000] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:15:11 2021] DELETE /identity/v3/users/5b6f1bc9115241d7827595202fd1187d => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:11.888337 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5349d4d-2c0c-487a-a580-0b8d22dd373d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:11.890786 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-b5349d4d-2c0c-487a-a580-0b8d22dd373d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:11.918142 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5349d4d-2c0c-487a-a580-0b8d22dd373d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:11.976973 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b066196-7310-4900-b375-04d3307c0b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:11.977869 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b066196-7310-4900-b375-04d3307c0b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:11.978148 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b066196-7310-4900-b375-04d3307c0b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:11.978424 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b066196-7310-4900-b375-04d3307c0b58 admin admin] PATH_INFO: `/v3/projects/afd619185440445f82b685fe4d5fa430` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:11.979605 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b066196-7310-4900-b375-04d3307c0b58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afd619185440445f82b685fe4d5fa430)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:11.981543 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b066196-7310-4900-b375-04d3307c0b58 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:12.095296 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-1b066196-7310-4900-b375-04d3307c0b58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afd619185440445f82b685fe4d5fa430', 'request_id': 'req-1b066196-7310-4900-b375-04d3307c0b58'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:12.161814 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-1b066196-7310-4900-b375-04d3307c0b58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afd619185440445f82b685fe4d5fa430', 'request_id': 'req-1b066196-7310-4900-b375-04d3307c0b58'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:12.167834 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-1b066196-7310-4900-b375-04d3307c0b58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afd619185440445f82b685fe4d5fa430', 'request_id': 'req-1b066196-7310-4900-b375-04d3307c0b58'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:12.179165 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-1b066196-7310-4900-b375-04d3307c0b58 admin admin] The token cache is being invalidate because project afd619185440445f82b685fe4d5fa430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:15:12.179452 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-1b066196-7310-4900-b375-04d3307c0b58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:12.180121 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-1b066196-7310-4900-b375-04d3307c0b58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:12.181723 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1001/2001] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:15:11 2021] DELETE /identity/v3/projects/afd619185440445f82b685fe4d5fa430 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:12.187418 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92815a-de6c-4739-b3d1-1b8c8ca38f8a None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:12.187901 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92815a-de6c-4739-b3d1-1b8c8ca38f8a None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:12.187982 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92815a-de6c-4739-b3d1-1b8c8ca38f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:12.206024 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-ef92815a-de6c-4739-b3d1-1b8c8ca38f8a None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:12.207799 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-ef92815a-de6c-4739-b3d1-1b8c8ca38f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:12.266005 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1001/2002] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:15:12.275382 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea1962-9308-4bfb-85fe-850c62047f3a None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:12.283939 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea1962-9308-4bfb-85fe-850c62047f3a None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:12.283939 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea1962-9308-4bfb-85fe-850c62047f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:12.295768 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-4dea1962-9308-4bfb-85fe-850c62047f3a None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:12.297148 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-4dea1962-9308-4bfb-85fe-850c62047f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:12.305312 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1002/2003] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:12.309926 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92815a-de6c-4739-b3d1-1b8c8ca38f8a None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:12.319624 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92815a-de6c-4739-b3d1-1b8c8ca38f8a None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:12.324197 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c185e-898e-4ff2-8b38-d5f6f24051f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:12.324889 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c185e-898e-4ff2-8b38-d5f6f24051f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:12.325173 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c185e-898e-4ff2-8b38-d5f6f24051f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:12.325450 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c185e-898e-4ff2-8b38-d5f6f24051f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:12.326204 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c185e-898e-4ff2-8b38-d5f6f24051f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:15:12.326542 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c185e-898e-4ff2-8b38-d5f6f24051f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:12.328190 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c185e-898e-4ff2-8b38-d5f6f24051f5 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:12.340181 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1002/2004] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:15:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:15:12.344341 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea1962-9308-4bfb-85fe-850c62047f3a None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:12.354661 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea1962-9308-4bfb-85fe-850c62047f3a None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:12.359713 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d804d-e7c5-4a89-b38c-f7e81ae42c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:12.360364 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d804d-e7c5-4a89-b38c-f7e81ae42c32 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:12.360711 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d804d-e7c5-4a89-b38c-f7e81ae42c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:12.361051 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d804d-e7c5-4a89-b38c-f7e81ae42c32 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:12.361746 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d804d-e7c5-4a89-b38c-f7e81ae42c32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:12.363619 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d804d-e7c5-4a89-b38c-f7e81ae42c32 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:12.524335 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1003/2005] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:15:12 2021] POST /identity/v3/projects => generated 401 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:15:12.528258 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c185e-898e-4ff2-8b38-d5f6f24051f5 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:12.538266 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c185e-898e-4ff2-8b38-d5f6f24051f5 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:12.593049 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c507e2-2244-4571-bc2f-2f22ad4912e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:12.593736 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c507e2-2244-4571-bc2f-2f22ad4912e9 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:12.594020 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c507e2-2244-4571-bc2f-2f22ad4912e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:12.594323 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c507e2-2244-4571-bc2f-2f22ad4912e9 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:12.595039 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c507e2-2244-4571-bc2f-2f22ad4912e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:12.597052 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c507e2-2244-4571-bc2f-2f22ad4912e9 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:12.670866 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1003/2006] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:15:12 2021] POST /identity/v3/users => generated 301 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:15:12.673769 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d804d-e7c5-4a89-b38c-f7e81ae42c32 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:12.685143 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d804d-e7c5-4a89-b38c-f7e81ae42c32 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:12.700006 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746277c6-010f-4069-b5b1-cc8590a08378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:12.700006 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746277c6-010f-4069-b5b1-cc8590a08378 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:12.700006 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746277c6-010f-4069-b5b1-cc8590a08378 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:12.700006 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746277c6-010f-4069-b5b1-cc8590a08378 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:12.700962 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746277c6-010f-4069-b5b1-cc8590a08378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:12.700962 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746277c6-010f-4069-b5b1-cc8590a08378 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:12.708306 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1004/2007] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:12 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:12.712410 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c507e2-2244-4571-bc2f-2f22ad4912e9 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:12.724058 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c507e2-2244-4571-bc2f-2f22ad4912e9 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:12.728868 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141306b1-2de4-4e9a-9bf6-6adcbe24b961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:12.729558 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141306b1-2de4-4e9a-9bf6-6adcbe24b961 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:12.729842 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141306b1-2de4-4e9a-9bf6-6adcbe24b961 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:12.730121 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141306b1-2de4-4e9a-9bf6-6adcbe24b961 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:12.730874 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141306b1-2de4-4e9a-9bf6-6adcbe24b961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:12.732817 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141306b1-2de4-4e9a-9bf6-6adcbe24b961 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:12.742684 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1004/2008] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:12 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:15:12.746900 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746277c6-010f-4069-b5b1-cc8590a08378 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:12.757321 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746277c6-010f-4069-b5b1-cc8590a08378 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:12.762203 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cc718-3c44-4e58-aa78-687411739fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:12.763070 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cc718-3c44-4e58-aa78-687411739fd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:12.763349 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cc718-3c44-4e58-aa78-687411739fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:12.763649 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cc718-3c44-4e58-aa78-687411739fd8 admin admin] PATH_INFO: `/v3/projects/64dc16864c8043c789afeeec9e7444e1/users/c655e61d05e94e11bfbc1e09f759b4a6/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:12.778265 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475cc718-3c44-4e58-aa78-687411739fd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64dc16864c8043c789afeeec9e7444e1, user_id=c655e61d05e94e11bfbc1e09f759b4a6, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:12.785722 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475cc718-3c44-4e58-aa78-687411739fd8 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:12.876427 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1005/2009] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:15:12 2021] PUT /identity/v3/projects/64dc16864c8043c789afeeec9e7444e1/users/c655e61d05e94e11bfbc1e09f759b4a6/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:15:12.887224 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6bb49-01ff-4e22-8874-ae6dbaf2e2e8 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:12.887518 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6bb49-01ff-4e22-8874-ae6dbaf2e2e8 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:12.887801 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6bb49-01ff-4e22-8874-ae6dbaf2e2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:12.914293 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-49e6bb49-01ff-4e22-8874-ae6dbaf2e2e8 None None] MFA Rules not processed for user `c655e61d05e94e11bfbc1e09f759b4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:12.917552 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-49e6bb49-01ff-4e22-8874-ae6dbaf2e2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:12.977880 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1005/2010] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:12 2021] POST /identity/v3/auth/tokens => generated 3421 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:12.982727 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cc718-3c44-4e58-aa78-687411739fd8 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:13.042745 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cc718-3c44-4e58-aa78-687411739fd8 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:13.047389 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1dc59-4ffe-4f40-8a36-f9c8e1bc490b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:13.048053 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1dc59-4ffe-4f40-8a36-f9c8e1bc490b admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:13.048337 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1dc59-4ffe-4f40-8a36-f9c8e1bc490b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:13.048646 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1dc59-4ffe-4f40-8a36-f9c8e1bc490b admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:13.049347 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1dc59-4ffe-4f40-8a36-f9c8e1bc490b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:13.051706 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1dc59-4ffe-4f40-8a36-f9c8e1bc490b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:13.140340 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1006/2011] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:15:12 2021] POST /identity/v3/projects => generated 401 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:15:13.144908 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6bb49-01ff-4e22-8874-ae6dbaf2e2e8 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:13.155223 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6bb49-01ff-4e22-8874-ae6dbaf2e2e8 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:13.208990 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c27c0e-8beb-4edd-b175-b1394ab889d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:13.209654 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c27c0e-8beb-4edd-b175-b1394ab889d3 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:13.209939 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c27c0e-8beb-4edd-b175-b1394ab889d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:13.210249 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c27c0e-8beb-4edd-b175-b1394ab889d3 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:13.210962 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c27c0e-8beb-4edd-b175-b1394ab889d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:13.212960 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c27c0e-8beb-4edd-b175-b1394ab889d3 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:13.323045 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1006/2012] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:15:13 2021] POST /identity/v3/users => generated 307 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:15:13.329338 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1dc59-4ffe-4f40-8a36-f9c8e1bc490b admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:13.340022 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1dc59-4ffe-4f40-8a36-f9c8e1bc490b admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:13.346304 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487fd04-62b6-4c15-b659-717e1d6933ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:13.347055 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487fd04-62b6-4c15-b659-717e1d6933ca admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:13.347900 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487fd04-62b6-4c15-b659-717e1d6933ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:13.348232 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487fd04-62b6-4c15-b659-717e1d6933ca admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:13.349129 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487fd04-62b6-4c15-b659-717e1d6933ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:13.350766 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487fd04-62b6-4c15-b659-717e1d6933ca admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:13.362874 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1007/2013] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:13 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:13.367251 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c27c0e-8beb-4edd-b175-b1394ab889d3 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:13.377322 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c27c0e-8beb-4edd-b175-b1394ab889d3 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:13.382686 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2318bd0-0334-4044-8f4c-6368b15e3fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:13.383570 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2318bd0-0334-4044-8f4c-6368b15e3fa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:13.383863 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2318bd0-0334-4044-8f4c-6368b15e3fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:13.384144 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2318bd0-0334-4044-8f4c-6368b15e3fa7 admin admin] PATH_INFO: `/v3/projects/bda6f00070a949d192f70d5dab21ffc4/users/c270ef32cbac4f0f868aa8972cc0f044/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:13.398838 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2318bd0-0334-4044-8f4c-6368b15e3fa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bda6f00070a949d192f70d5dab21ffc4, user_id=c270ef32cbac4f0f868aa8972cc0f044, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:13.401531 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2318bd0-0334-4044-8f4c-6368b15e3fa7 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:13.452762 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1007/2014] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:15:13 2021] PUT /identity/v3/projects/bda6f00070a949d192f70d5dab21ffc4/users/c270ef32cbac4f0f868aa8972cc0f044/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:15:13.456480 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487fd04-62b6-4c15-b659-717e1d6933ca admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:13.467442 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487fd04-62b6-4c15-b659-717e1d6933ca admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:13.524360 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25003350-4ae5-4772-a98c-7a94cc56e3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:13.525062 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25003350-4ae5-4772-a98c-7a94cc56e3f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:13.525337 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25003350-4ae5-4772-a98c-7a94cc56e3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:13.525605 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25003350-4ae5-4772-a98c-7a94cc56e3f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:13.526315 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25003350-4ae5-4772-a98c-7a94cc56e3f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:13.527880 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25003350-4ae5-4772-a98c-7a94cc56e3f9 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:13.537292 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1008/2015] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:13 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:15:13.541427 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2318bd0-0334-4044-8f4c-6368b15e3fa7 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:13.551595 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2318bd0-0334-4044-8f4c-6368b15e3fa7 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:13.556372 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb49129-ee3b-4679-adcd-51641ad84192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:13.557288 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb49129-ee3b-4679-adcd-51641ad84192 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:13.557574 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb49129-ee3b-4679-adcd-51641ad84192 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:13.557853 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb49129-ee3b-4679-adcd-51641ad84192 admin admin] PATH_INFO: `/v3/projects/bda6f00070a949d192f70d5dab21ffc4/users/c270ef32cbac4f0f868aa8972cc0f044/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:13.559822 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb49129-ee3b-4679-adcd-51641ad84192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bda6f00070a949d192f70d5dab21ffc4, user_id=c270ef32cbac4f0f868aa8972cc0f044, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:13.562557 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb49129-ee3b-4679-adcd-51641ad84192 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:13.573589 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1008/2016] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:15:13 2021] PUT /identity/v3/projects/bda6f00070a949d192f70d5dab21ffc4/users/c270ef32cbac4f0f868aa8972cc0f044/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:13.585487 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff79a8-400e-4fb5-98a7-d9c3eb492dd9 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:13.585775 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff79a8-400e-4fb5-98a7-d9c3eb492dd9 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:13.586053 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff79a8-400e-4fb5-98a7-d9c3eb492dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:13.611936 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-5bff79a8-400e-4fb5-98a7-d9c3eb492dd9 None None] MFA Rules not processed for user `c270ef32cbac4f0f868aa8972cc0f044`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:13.613213 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-5bff79a8-400e-4fb5-98a7-d9c3eb492dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:13.677554 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1009/2017] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:13 2021] POST /identity/v3/auth/tokens => generated 3488 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:13.687283 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb49129-ee3b-4679-adcd-51641ad84192 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:13.689166 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-8eb49129-ee3b-4679-adcd-51641ad84192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:13.747052 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb49129-ee3b-4679-adcd-51641ad84192 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:13.750832 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc82c1f-e78c-452d-8aa5-bfff50d15ea4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:13.751482 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc82c1f-e78c-452d-8aa5-bfff50d15ea4 service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:13.751761 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc82c1f-e78c-452d-8aa5-bfff50d15ea4 service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:13.752036 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc82c1f-e78c-452d-8aa5-bfff50d15ea4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:13.760857 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc82c1f-e78c-452d-8aa5-bfff50d15ea4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:13.762274 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc82c1f-e78c-452d-8aa5-bfff50d15ea4 service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:13.771915 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1009/2018] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:15:13 2021] GET /identity/v3/auth/tokens => generated 3488 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:15:13.973652 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff79a8-400e-4fb5-98a7-d9c3eb492dd9 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:13.983269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff79a8-400e-4fb5-98a7-d9c3eb492dd9 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:13.986813 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194bfeb-7a94-432e-8bfb-c098cb674747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:13.987457 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194bfeb-7a94-432e-8bfb-c098cb674747 service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:13.987738 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194bfeb-7a94-432e-8bfb-c098cb674747 service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:13.988035 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194bfeb-7a94-432e-8bfb-c098cb674747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:14.050041 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194bfeb-7a94-432e-8bfb-c098cb674747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:14.051660 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194bfeb-7a94-432e-8bfb-c098cb674747 service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:14.063446 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1010/2019] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:15:13 2021] GET /identity/v3/auth/tokens => generated 3421 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:15:17.612156 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c8672-ab30-457c-8ad2-727c404d7b9e None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:17.612699 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c8672-ab30-457c-8ad2-727c404d7b9e None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:17.612814 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c8672-ab30-457c-8ad2-727c404d7b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:17.630477 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-eb9c8672-ab30-457c-8ad2-727c404d7b9e None None] MFA Rules not processed for user `36893da01a1845f5af4921a298abb9eb`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:17.631825 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-eb9c8672-ab30-457c-8ad2-727c404d7b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:17.689421 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1010/2020] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:17 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:19.610191 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194bfeb-7a94-432e-8bfb-c098cb674747 service cinder] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:19.611622 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-a194bfeb-7a94-432e-8bfb-c098cb674747 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:19.691528 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194bfeb-7a94-432e-8bfb-c098cb674747 service cinder] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:19.696378 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532350a-afdb-4d9e-86cc-87ff369601c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:19.697278 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532350a-afdb-4d9e-86cc-87ff369601c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:19.697612 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532350a-afdb-4d9e-86cc-87ff369601c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:19.697903 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532350a-afdb-4d9e-86cc-87ff369601c3 admin admin] PATH_INFO: `/v3/users/718cf842c8db4953a8bac5a665f4afc1` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:19.699087 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532350a-afdb-4d9e-86cc-87ff369601c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=718cf842c8db4953a8bac5a665f4afc1)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:19.701060 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532350a-afdb-4d9e-86cc-87ff369601c3 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:19.948932 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-1532350a-afdb-4d9e-86cc-87ff369601c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '718cf842c8db4953a8bac5a665f4afc1'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:19.949688 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-1532350a-afdb-4d9e-86cc-87ff369601c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '718cf842c8db4953a8bac5a665f4afc1'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:19.951198 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-1532350a-afdb-4d9e-86cc-87ff369601c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '718cf842c8db4953a8bac5a665f4afc1'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:19.960618 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-1532350a-afdb-4d9e-86cc-87ff369601c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '718cf842c8db4953a8bac5a665f4afc1'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:20.059125 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-1532350a-afdb-4d9e-86cc-87ff369601c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '718cf842c8db4953a8bac5a665f4afc1'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:20.079370 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1011/2021] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:15:19 2021] DELETE /identity/v3/users/718cf842c8db4953a8bac5a665f4afc1 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:20.084137 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd9ffd-3ffd-49a5-b946-7055bcd7f7c1 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:20.084810 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd9ffd-3ffd-49a5-b946-7055bcd7f7c1 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:20.084922 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd9ffd-3ffd-49a5-b946-7055bcd7f7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:20.104144 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-90dd9ffd-3ffd-49a5-b946-7055bcd7f7c1 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:20.105335 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-90dd9ffd-3ffd-49a5-b946-7055bcd7f7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:20.173412 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1011/2022] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:20.184961 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532350a-afdb-4d9e-86cc-87ff369601c3 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:20.186462 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-1532350a-afdb-4d9e-86cc-87ff369601c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:20.254778 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532350a-afdb-4d9e-86cc-87ff369601c3 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:20.258911 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef66ffe-d964-4aef-a72b-6c52e3bc7d3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:20.259714 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef66ffe-d964-4aef-a72b-6c52e3bc7d3e service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:20.259986 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef66ffe-d964-4aef-a72b-6c52e3bc7d3e service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:20.260259 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef66ffe-d964-4aef-a72b-6c52e3bc7d3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:20.271946 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef66ffe-d964-4aef-a72b-6c52e3bc7d3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:20.273539 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef66ffe-d964-4aef-a72b-6c52e3bc7d3e service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:20.283932 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1012/2023] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:15:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:15:20.732210 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd9ffd-3ffd-49a5-b946-7055bcd7f7c1 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:20.734665 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-90dd9ffd-3ffd-49a5-b946-7055bcd7f7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:20.757133 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd9ffd-3ffd-49a5-b946-7055bcd7f7c1 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:20.767372 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0481fc-d2de-4924-84ab-13b4ed2bf157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:20.767372 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0481fc-d2de-4924-84ab-13b4ed2bf157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:20.767372 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0481fc-d2de-4924-84ab-13b4ed2bf157 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:20.767372 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0481fc-d2de-4924-84ab-13b4ed2bf157 admin admin] PATH_INFO: `/v3/projects/805ce7ebaf794c63b7466e977b855bf2` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:20.768451 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0481fc-d2de-4924-84ab-13b4ed2bf157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=805ce7ebaf794c63b7466e977b855bf2)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:20.768451 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0481fc-d2de-4924-84ab-13b4ed2bf157 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:20.901111 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-5a0481fc-d2de-4924-84ab-13b4ed2bf157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '805ce7ebaf794c63b7466e977b855bf2', 'request_id': 'req-5a0481fc-d2de-4924-84ab-13b4ed2bf157'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:21.003028 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-5a0481fc-d2de-4924-84ab-13b4ed2bf157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '805ce7ebaf794c63b7466e977b855bf2', 'request_id': 'req-5a0481fc-d2de-4924-84ab-13b4ed2bf157'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:21.010614 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-5a0481fc-d2de-4924-84ab-13b4ed2bf157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '805ce7ebaf794c63b7466e977b855bf2', 'request_id': 'req-5a0481fc-d2de-4924-84ab-13b4ed2bf157'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:21.033173 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-5a0481fc-d2de-4924-84ab-13b4ed2bf157 admin admin] The token cache is being invalidate because project 805ce7ebaf794c63b7466e977b855bf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:15:21.033173 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-5a0481fc-d2de-4924-84ab-13b4ed2bf157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:21.036129 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-5a0481fc-d2de-4924-84ab-13b4ed2bf157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:21.040072 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1012/2024] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:15:20 2021] DELETE /identity/v3/projects/805ce7ebaf794c63b7466e977b855bf2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:21.047338 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef66ffe-d964-4aef-a72b-6c52e3bc7d3e service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:21.062396 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef66ffe-d964-4aef-a72b-6c52e3bc7d3e service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:21.130831 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff424d-e41d-4c75-942f-148e888d9345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:21.131894 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff424d-e41d-4c75-942f-148e888d9345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:21.132241 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff424d-e41d-4c75-942f-148e888d9345 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:21.132672 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff424d-e41d-4c75-942f-148e888d9345 admin admin] PATH_INFO: `/v3/users/a5adf334fc7445b2adf85af9deaae7b9` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:21.134975 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff424d-e41d-4c75-942f-148e888d9345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5adf334fc7445b2adf85af9deaae7b9)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:21.138674 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff424d-e41d-4c75-942f-148e888d9345 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:21.370522 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-49ff424d-e41d-4c75-942f-148e888d9345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5adf334fc7445b2adf85af9deaae7b9'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:21.371086 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-49ff424d-e41d-4c75-942f-148e888d9345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5adf334fc7445b2adf85af9deaae7b9'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:21.372093 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-49ff424d-e41d-4c75-942f-148e888d9345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5adf334fc7445b2adf85af9deaae7b9'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:21.380694 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-49ff424d-e41d-4c75-942f-148e888d9345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5adf334fc7445b2adf85af9deaae7b9'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:21.488357 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-49ff424d-e41d-4c75-942f-148e888d9345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5adf334fc7445b2adf85af9deaae7b9'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:21.519752 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1013/2025] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:15:21 2021] DELETE /identity/v3/users/a5adf334fc7445b2adf85af9deaae7b9 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:15:22.311203 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0481fc-d2de-4924-84ab-13b4ed2bf157 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:22.313989 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-5a0481fc-d2de-4924-84ab-13b4ed2bf157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:22.338874 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0481fc-d2de-4924-84ab-13b4ed2bf157 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:22.427605 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e6b3e-5c3f-4c28-9b91-4df0e3554efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:22.428202 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e6b3e-5c3f-4c28-9b91-4df0e3554efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:22.428657 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e6b3e-5c3f-4c28-9b91-4df0e3554efd admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:22.428885 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e6b3e-5c3f-4c28-9b91-4df0e3554efd admin admin] PATH_INFO: `/v3/projects/b0936db76944455e83ce5f2fd11ee160` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:22.430256 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e6b3e-5c3f-4c28-9b91-4df0e3554efd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0936db76944455e83ce5f2fd11ee160)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:22.432180 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e6b3e-5c3f-4c28-9b91-4df0e3554efd admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:22.552366 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-8e5e6b3e-5c3f-4c28-9b91-4df0e3554efd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0936db76944455e83ce5f2fd11ee160', 'request_id': 'req-8e5e6b3e-5c3f-4c28-9b91-4df0e3554efd'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:22.624764 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-8e5e6b3e-5c3f-4c28-9b91-4df0e3554efd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0936db76944455e83ce5f2fd11ee160', 'request_id': 'req-8e5e6b3e-5c3f-4c28-9b91-4df0e3554efd'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:22.630828 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-8e5e6b3e-5c3f-4c28-9b91-4df0e3554efd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0936db76944455e83ce5f2fd11ee160', 'request_id': 'req-8e5e6b3e-5c3f-4c28-9b91-4df0e3554efd'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:22.642648 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-8e5e6b3e-5c3f-4c28-9b91-4df0e3554efd admin admin] The token cache is being invalidate because project b0936db76944455e83ce5f2fd11ee160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:15:22.642934 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-8e5e6b3e-5c3f-4c28-9b91-4df0e3554efd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:22.643577 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-8e5e6b3e-5c3f-4c28-9b91-4df0e3554efd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:22.645186 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1013/2026] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:15:22 2021] DELETE /identity/v3/projects/b0936db76944455e83ce5f2fd11ee160 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:22.649137 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff424d-e41d-4c75-942f-148e888d9345 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:22.650584 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-49ff424d-e41d-4c75-942f-148e888d9345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:22.663874 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff424d-e41d-4c75-942f-148e888d9345 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:22.728911 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17f813-cc8c-4594-940d-462314c6e03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:22.729817 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17f813-cc8c-4594-940d-462314c6e03d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:22.730456 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17f813-cc8c-4594-940d-462314c6e03d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:22.730748 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17f813-cc8c-4594-940d-462314c6e03d admin admin] PATH_INFO: `/v3/users/b570bbee91af48fbbf41fe8dcacf83a0` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:22.732280 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e17f813-cc8c-4594-940d-462314c6e03d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b570bbee91af48fbbf41fe8dcacf83a0)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:22.734546 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e17f813-cc8c-4594-940d-462314c6e03d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:22.853313 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e6b3e-5c3f-4c28-9b91-4df0e3554efd admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:22.854919 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-8e5e6b3e-5c3f-4c28-9b91-4df0e3554efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:22.871873 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e6b3e-5c3f-4c28-9b91-4df0e3554efd admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:22.877723 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccec98-0ef3-40d7-9578-bd3e2612c352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:22.879129 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccec98-0ef3-40d7-9578-bd3e2612c352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:22.879572 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccec98-0ef3-40d7-9578-bd3e2612c352 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:22.898127 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccec98-0ef3-40d7-9578-bd3e2612c352 admin admin] PATH_INFO: `/v3/users/c655e61d05e94e11bfbc1e09f759b4a6` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:22.899866 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ccec98-0ef3-40d7-9578-bd3e2612c352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c655e61d05e94e11bfbc1e09f759b4a6)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:22.902321 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ccec98-0ef3-40d7-9578-bd3e2612c352 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:22.984239 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-3e17f813-cc8c-4594-940d-462314c6e03d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b570bbee91af48fbbf41fe8dcacf83a0'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:22.985416 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-3e17f813-cc8c-4594-940d-462314c6e03d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b570bbee91af48fbbf41fe8dcacf83a0'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:22.986265 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-3e17f813-cc8c-4594-940d-462314c6e03d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b570bbee91af48fbbf41fe8dcacf83a0'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:22.996684 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-3e17f813-cc8c-4594-940d-462314c6e03d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b570bbee91af48fbbf41fe8dcacf83a0'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:23.094279 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-3e17f813-cc8c-4594-940d-462314c6e03d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b570bbee91af48fbbf41fe8dcacf83a0'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:23.111588 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-93ccec98-0ef3-40d7-9578-bd3e2612c352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c655e61d05e94e11bfbc1e09f759b4a6'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:23.112836 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-93ccec98-0ef3-40d7-9578-bd3e2612c352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c655e61d05e94e11bfbc1e09f759b4a6'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:23.119228 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1014/2027] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:15:22 2021] DELETE /identity/v3/users/b570bbee91af48fbbf41fe8dcacf83a0 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:15:23.123392 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-93ccec98-0ef3-40d7-9578-bd3e2612c352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c655e61d05e94e11bfbc1e09f759b4a6'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:23.179256 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-93ccec98-0ef3-40d7-9578-bd3e2612c352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c655e61d05e94e11bfbc1e09f759b4a6'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:23.195477 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-93ccec98-0ef3-40d7-9578-bd3e2612c352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c655e61d05e94e11bfbc1e09f759b4a6'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:23.210904 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1014/2028] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:15:22 2021] DELETE /identity/v3/users/c655e61d05e94e11bfbc1e09f759b4a6 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:23.215447 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97258a3-dc39-413a-8ea7-e74c1f61868d None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:23.215736 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97258a3-dc39-413a-8ea7-e74c1f61868d None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:23.216020 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97258a3-dc39-413a-8ea7-e74c1f61868d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:23.235720 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-e97258a3-dc39-413a-8ea7-e74c1f61868d None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:23.238759 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-e97258a3-dc39-413a-8ea7-e74c1f61868d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:23.345572 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1015/2029] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:23.355908 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccec98-0ef3-40d7-9578-bd3e2612c352 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:23.357761 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-93ccec98-0ef3-40d7-9578-bd3e2612c352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:23.416885 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccec98-0ef3-40d7-9578-bd3e2612c352 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:23.420835 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ed51f-efc6-406f-99e4-2d5fb2991149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:23.421576 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ed51f-efc6-406f-99e4-2d5fb2991149 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:23.421860 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ed51f-efc6-406f-99e4-2d5fb2991149 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:23.422137 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ed51f-efc6-406f-99e4-2d5fb2991149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:23.432160 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ed51f-efc6-406f-99e4-2d5fb2991149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:23.433676 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ed51f-efc6-406f-99e4-2d5fb2991149 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:23.443413 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1015/2030] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:15:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:15:23.913308 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97258a3-dc39-413a-8ea7-e74c1f61868d None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:23.915093 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-e97258a3-dc39-413a-8ea7-e74c1f61868d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:23.927006 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ed51f-efc6-406f-99e4-2d5fb2991149 service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:23.929542 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-765ed51f-efc6-406f-99e4-2d5fb2991149 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:23.940397 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97258a3-dc39-413a-8ea7-e74c1f61868d None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:23.943902 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ed51f-efc6-406f-99e4-2d5fb2991149 service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:23.945545 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a05994-f922-45cd-b71c-9aba4cdbdd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:23.946949 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a05994-f922-45cd-b71c-9aba4cdbdd5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:23.947230 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a05994-f922-45cd-b71c-9aba4cdbdd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:23.947511 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a05994-f922-45cd-b71c-9aba4cdbdd5a admin admin] PATH_INFO: `/v3/projects/64dc16864c8043c789afeeec9e7444e1` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:23.948994 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a05994-f922-45cd-b71c-9aba4cdbdd5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=64dc16864c8043c789afeeec9e7444e1)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:23.949368 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039879e-7e91-4b66-b390-783f54dc8ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:23.951098 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a05994-f922-45cd-b71c-9aba4cdbdd5a admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:23.951752 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039879e-7e91-4b66-b390-783f54dc8ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:23.952544 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039879e-7e91-4b66-b390-783f54dc8ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:23.953245 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039879e-7e91-4b66-b390-783f54dc8ab9 admin admin] PATH_INFO: `/v3/projects/a819e6e675c1473ca6ae55c2e5af0557` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:23.955438 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039879e-7e91-4b66-b390-783f54dc8ab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a819e6e675c1473ca6ae55c2e5af0557)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:23.957441 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039879e-7e91-4b66-b390-783f54dc8ab9 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:24.111453 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-52a05994-f922-45cd-b71c-9aba4cdbdd5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64dc16864c8043c789afeeec9e7444e1', 'request_id': 'req-52a05994-f922-45cd-b71c-9aba4cdbdd5a'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:24.111992 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-9039879e-7e91-4b66-b390-783f54dc8ab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a819e6e675c1473ca6ae55c2e5af0557', 'request_id': 'req-9039879e-7e91-4b66-b390-783f54dc8ab9'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:24.213584 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-52a05994-f922-45cd-b71c-9aba4cdbdd5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64dc16864c8043c789afeeec9e7444e1', 'request_id': 'req-52a05994-f922-45cd-b71c-9aba4cdbdd5a'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:24.220316 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-52a05994-f922-45cd-b71c-9aba4cdbdd5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64dc16864c8043c789afeeec9e7444e1', 'request_id': 'req-52a05994-f922-45cd-b71c-9aba4cdbdd5a'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:24.234985 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-52a05994-f922-45cd-b71c-9aba4cdbdd5a admin admin] The token cache is being invalidate because project 64dc16864c8043c789afeeec9e7444e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:15:24.235632 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-52a05994-f922-45cd-b71c-9aba4cdbdd5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:24.236142 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-52a05994-f922-45cd-b71c-9aba4cdbdd5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:24.239110 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1016/2031] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:15:23 2021] DELETE /identity/v3/projects/64dc16864c8043c789afeeec9e7444e1 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:24.240432 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a05994-f922-45cd-b71c-9aba4cdbdd5a admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:24.243224 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-52a05994-f922-45cd-b71c-9aba4cdbdd5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:24.264941 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-9039879e-7e91-4b66-b390-783f54dc8ab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a819e6e675c1473ca6ae55c2e5af0557', 'request_id': 'req-9039879e-7e91-4b66-b390-783f54dc8ab9'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:24.271612 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-9039879e-7e91-4b66-b390-783f54dc8ab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a819e6e675c1473ca6ae55c2e5af0557', 'request_id': 'req-9039879e-7e91-4b66-b390-783f54dc8ab9'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:24.283272 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-9039879e-7e91-4b66-b390-783f54dc8ab9 admin admin] The token cache is being invalidate because project a819e6e675c1473ca6ae55c2e5af0557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:15:24.283558 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-9039879e-7e91-4b66-b390-783f54dc8ab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:24.284207 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-9039879e-7e91-4b66-b390-783f54dc8ab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:24.285893 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1016/2032] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:15:23 2021] DELETE /identity/v3/projects/a819e6e675c1473ca6ae55c2e5af0557 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:24.286775 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039879e-7e91-4b66-b390-783f54dc8ab9 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:24.288097 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-9039879e-7e91-4b66-b390-783f54dc8ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:24.325486 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a05994-f922-45cd-b71c-9aba4cdbdd5a admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:24.330210 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c8bc9-68a5-45bf-a1a8-b8cfaf97a35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:24.331112 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c8bc9-68a5-45bf-a1a8-b8cfaf97a35f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:24.331393 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c8bc9-68a5-45bf-a1a8-b8cfaf97a35f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:24.332196 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c8bc9-68a5-45bf-a1a8-b8cfaf97a35f admin admin] PATH_INFO: `/v3/users/4bf6db4c98574ff380bbbfae07e2a03a` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:24.334210 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c8bc9-68a5-45bf-a1a8-b8cfaf97a35f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bf6db4c98574ff380bbbfae07e2a03a)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:24.336664 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c8bc9-68a5-45bf-a1a8-b8cfaf97a35f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:24.473669 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039879e-7e91-4b66-b390-783f54dc8ab9 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:24.488406 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacd70d-496e-457d-87ee-e4404de33734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:24.489978 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacd70d-496e-457d-87ee-e4404de33734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:24.490530 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacd70d-496e-457d-87ee-e4404de33734 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:24.490988 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacd70d-496e-457d-87ee-e4404de33734 admin admin] PATH_INFO: `/v3/users/c270ef32cbac4f0f868aa8972cc0f044` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:24.492670 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffacd70d-496e-457d-87ee-e4404de33734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c270ef32cbac4f0f868aa8972cc0f044)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:24.495722 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffacd70d-496e-457d-87ee-e4404de33734 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:24.610227 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-319c8bc9-68a5-45bf-a1a8-b8cfaf97a35f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bf6db4c98574ff380bbbfae07e2a03a'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:24.610883 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-319c8bc9-68a5-45bf-a1a8-b8cfaf97a35f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bf6db4c98574ff380bbbfae07e2a03a'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:24.611509 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-319c8bc9-68a5-45bf-a1a8-b8cfaf97a35f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bf6db4c98574ff380bbbfae07e2a03a'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:24.619698 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-319c8bc9-68a5-45bf-a1a8-b8cfaf97a35f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bf6db4c98574ff380bbbfae07e2a03a'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:24.706122 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-319c8bc9-68a5-45bf-a1a8-b8cfaf97a35f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bf6db4c98574ff380bbbfae07e2a03a'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:24.725783 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1017/2033] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:15:24 2021] DELETE /identity/v3/users/4bf6db4c98574ff380bbbfae07e2a03a => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:24.730097 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023cb7a-d2ac-4909-bf68-1473bde94dc8 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:24.730626 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023cb7a-d2ac-4909-bf68-1473bde94dc8 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:24.730912 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023cb7a-d2ac-4909-bf68-1473bde94dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:24.748404 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-9023cb7a-d2ac-4909-bf68-1473bde94dc8 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:24.749647 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-9023cb7a-d2ac-4909-bf68-1473bde94dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:24.777546 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-ffacd70d-496e-457d-87ee-e4404de33734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c270ef32cbac4f0f868aa8972cc0f044'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:24.778223 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-ffacd70d-496e-457d-87ee-e4404de33734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c270ef32cbac4f0f868aa8972cc0f044'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:24.785227 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-ffacd70d-496e-457d-87ee-e4404de33734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c270ef32cbac4f0f868aa8972cc0f044'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:24.805899 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1018/2034] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:15:24.816450 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023cb7a-d2ac-4909-bf68-1473bde94dc8 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:24.817848 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-9023cb7a-d2ac-4909-bf68-1473bde94dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:24.872003 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023cb7a-d2ac-4909-bf68-1473bde94dc8 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:24.875591 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76541e3-8efe-423d-bc87-3be2ed853565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:24.876258 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76541e3-8efe-423d-bc87-3be2ed853565 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:24.879971 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76541e3-8efe-423d-bc87-3be2ed853565 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:24.879971 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76541e3-8efe-423d-bc87-3be2ed853565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:24.886681 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76541e3-8efe-423d-bc87-3be2ed853565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:24.888143 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76541e3-8efe-423d-bc87-3be2ed853565 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:24.897887 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1019/2035] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:15:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:15:24.899166 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-ffacd70d-496e-457d-87ee-e4404de33734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c270ef32cbac4f0f868aa8972cc0f044'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:24.912445 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-ffacd70d-496e-457d-87ee-e4404de33734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c270ef32cbac4f0f868aa8972cc0f044'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:24.918911 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1017/2036] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:15:24 2021] DELETE /identity/v3/users/c270ef32cbac4f0f868aa8972cc0f044 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:25.393424 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76541e3-8efe-423d-bc87-3be2ed853565 service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:25.398431 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-a76541e3-8efe-423d-bc87-3be2ed853565 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:25.431317 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76541e3-8efe-423d-bc87-3be2ed853565 service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:25.487207 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf75306-56e6-4e62-b61d-43fd312a6f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:25.488095 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf75306-56e6-4e62-b61d-43fd312a6f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:25.488374 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf75306-56e6-4e62-b61d-43fd312a6f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:25.488687 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf75306-56e6-4e62-b61d-43fd312a6f94 admin admin] PATH_INFO: `/v3/projects/3ac03f27b6b748f18418d6c676bdba69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:25.489854 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf75306-56e6-4e62-b61d-43fd312a6f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ac03f27b6b748f18418d6c676bdba69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:25.491771 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf75306-56e6-4e62-b61d-43fd312a6f94 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:25.536584 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacd70d-496e-457d-87ee-e4404de33734 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:25.538038 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-ffacd70d-496e-457d-87ee-e4404de33734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:25.551119 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacd70d-496e-457d-87ee-e4404de33734 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:25.556149 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace727a-960f-4355-9cba-15151f97f3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:25.557071 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace727a-960f-4355-9cba-15151f97f3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:25.557352 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace727a-960f-4355-9cba-15151f97f3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:25.557631 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace727a-960f-4355-9cba-15151f97f3d3 admin admin] PATH_INFO: `/v3/users/241c3c8895cf44609f842dff48c08607` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:25.558824 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace727a-960f-4355-9cba-15151f97f3d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=241c3c8895cf44609f842dff48c08607)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:25.560828 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace727a-960f-4355-9cba-15151f97f3d3 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:25.636759 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-baf75306-56e6-4e62-b61d-43fd312a6f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ac03f27b6b748f18418d6c676bdba69', 'request_id': 'req-baf75306-56e6-4e62-b61d-43fd312a6f94'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:25.728136 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-baf75306-56e6-4e62-b61d-43fd312a6f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ac03f27b6b748f18418d6c676bdba69', 'request_id': 'req-baf75306-56e6-4e62-b61d-43fd312a6f94'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:25.741641 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-baf75306-56e6-4e62-b61d-43fd312a6f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ac03f27b6b748f18418d6c676bdba69', 'request_id': 'req-baf75306-56e6-4e62-b61d-43fd312a6f94'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:25.750681 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-5ace727a-960f-4355-9cba-15151f97f3d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '241c3c8895cf44609f842dff48c08607'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:25.751891 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-5ace727a-960f-4355-9cba-15151f97f3d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '241c3c8895cf44609f842dff48c08607'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:25.760783 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-5ace727a-960f-4355-9cba-15151f97f3d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '241c3c8895cf44609f842dff48c08607'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:25.763191 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-baf75306-56e6-4e62-b61d-43fd312a6f94 admin admin] The token cache is being invalidate because project 3ac03f27b6b748f18418d6c676bdba69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:15:25.765452 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-baf75306-56e6-4e62-b61d-43fd312a6f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:25.765886 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-baf75306-56e6-4e62-b61d-43fd312a6f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:25.770047 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1020/2037] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:15:25 2021] DELETE /identity/v3/projects/3ac03f27b6b748f18418d6c676bdba69 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:25.771749 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b754bd-d778-4f52-8f0b-e496291fa75e None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:25.771749 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b754bd-d778-4f52-8f0b-e496291fa75e None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:25.771938 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b754bd-d778-4f52-8f0b-e496291fa75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:25.794588 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-d4b754bd-d778-4f52-8f0b-e496291fa75e None None] MFA Rules not processed for user `96c9b76133d74b79a0d2da9a884651e1`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:25.794588 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-d4b754bd-d778-4f52-8f0b-e496291fa75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:25.850453 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1021/2038] 10.222.0.23 () {58 vars in 1010 bytes} [Thu Sep 23 03:15:25 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:25.851184 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b754bd-d778-4f52-8f0b-e496291fa75e None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:25.852434 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-d4b754bd-d778-4f52-8f0b-e496291fa75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:25.855601 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-5ace727a-960f-4355-9cba-15151f97f3d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '241c3c8895cf44609f842dff48c08607'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:25.872619 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-5ace727a-960f-4355-9cba-15151f97f3d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '241c3c8895cf44609f842dff48c08607'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:25.876823 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1018/2039] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:15:25 2021] DELETE /identity/v3/users/241c3c8895cf44609f842dff48c08607 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:15:25.877962 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace727a-960f-4355-9cba-15151f97f3d3 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:25.880013 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-5ace727a-960f-4355-9cba-15151f97f3d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:25.927223 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b754bd-d778-4f52-8f0b-e496291fa75e None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:25.986522 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff65e56-e975-4081-9c06-50002bfd8c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:25.987414 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff65e56-e975-4081-9c06-50002bfd8c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:25.987729 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff65e56-e975-4081-9c06-50002bfd8c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:25.988009 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff65e56-e975-4081-9c06-50002bfd8c32 admin admin] PATH_INFO: `/v3/projects/bda6f00070a949d192f70d5dab21ffc4` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:25.989277 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff65e56-e975-4081-9c06-50002bfd8c32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bda6f00070a949d192f70d5dab21ffc4)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:25.991205 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff65e56-e975-4081-9c06-50002bfd8c32 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:26.065749 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace727a-960f-4355-9cba-15151f97f3d3 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:26.070484 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c74cf7-c609-4e9c-bf39-4ab7fc938663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:26.071360 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c74cf7-c609-4e9c-bf39-4ab7fc938663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:26.071643 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c74cf7-c609-4e9c-bf39-4ab7fc938663 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:26.071921 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c74cf7-c609-4e9c-bf39-4ab7fc938663 admin admin] PATH_INFO: `/v3/users/bb0b325cfe66402f97255955dd9f9142` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:26.073136 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c74cf7-c609-4e9c-bf39-4ab7fc938663 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb0b325cfe66402f97255955dd9f9142)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:26.075080 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c74cf7-c609-4e9c-bf39-4ab7fc938663 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:26.099512 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-dff65e56-e975-4081-9c06-50002bfd8c32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bda6f00070a949d192f70d5dab21ffc4', 'request_id': 'req-dff65e56-e975-4081-9c06-50002bfd8c32'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:26.190242 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-dff65e56-e975-4081-9c06-50002bfd8c32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bda6f00070a949d192f70d5dab21ffc4', 'request_id': 'req-dff65e56-e975-4081-9c06-50002bfd8c32'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:26.196300 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-dff65e56-e975-4081-9c06-50002bfd8c32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bda6f00070a949d192f70d5dab21ffc4', 'request_id': 'req-dff65e56-e975-4081-9c06-50002bfd8c32'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:26.207559 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-dff65e56-e975-4081-9c06-50002bfd8c32 admin admin] The token cache is being invalidate because project bda6f00070a949d192f70d5dab21ffc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:15:26.207839 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-dff65e56-e975-4081-9c06-50002bfd8c32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:26.208503 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-dff65e56-e975-4081-9c06-50002bfd8c32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:26.210079 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1022/2040] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:15:25 2021] DELETE /identity/v3/projects/bda6f00070a949d192f70d5dab21ffc4 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:26.211491 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309d95c-09e8-4f78-a534-82ca35cc260f None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:26.211776 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309d95c-09e8-4f78-a534-82ca35cc260f None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:26.212051 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309d95c-09e8-4f78-a534-82ca35cc260f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:26.229213 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-3309d95c-09e8-4f78-a534-82ca35cc260f None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:26.230388 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-3309d95c-09e8-4f78-a534-82ca35cc260f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:26.267026 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-21c74cf7-c609-4e9c-bf39-4ab7fc938663 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb0b325cfe66402f97255955dd9f9142'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:26.267690 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-21c74cf7-c609-4e9c-bf39-4ab7fc938663 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb0b325cfe66402f97255955dd9f9142'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:26.274933 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-21c74cf7-c609-4e9c-bf39-4ab7fc938663 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb0b325cfe66402f97255955dd9f9142'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:26.286554 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1023/2041] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:26.287379 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309d95c-09e8-4f78-a534-82ca35cc260f None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:26.288643 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-3309d95c-09e8-4f78-a534-82ca35cc260f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:26.350587 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-21c74cf7-c609-4e9c-bf39-4ab7fc938663 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb0b325cfe66402f97255955dd9f9142'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:26.354289 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309d95c-09e8-4f78-a534-82ca35cc260f None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:26.360445 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0b480-4b3d-4c29-b76f-33395ffb140d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df051fd059b34fe0993f501546d1610f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:26.361149 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0b480-4b3d-4c29-b76f-33395ffb140d service swift] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:26.361427 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0b480-4b3d-4c29-b76f-33395ffb140d service swift] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:26.361703 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0b480-4b3d-4c29-b76f-33395ffb140d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:26.364052 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-d5a0b480-4b3d-4c29-b76f-33395ffb140d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:26.364265 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-21c74cf7-c609-4e9c-bf39-4ab7fc938663 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb0b325cfe66402f97255955dd9f9142'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:26.370822 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1019/2042] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:15:25 2021] DELETE /identity/v3/users/bb0b325cfe66402f97255955dd9f9142 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:26.375292 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f552d0-f585-4f5d-8e65-6fc658ea596b None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:26.375762 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f552d0-f585-4f5d-8e65-6fc658ea596b None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:26.376427 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f552d0-f585-4f5d-8e65-6fc658ea596b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:26.396038 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-90f552d0-f585-4f5d-8e65-6fc658ea596b None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:26.397268 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-90f552d0-f585-4f5d-8e65-6fc658ea596b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:26.429236 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0b480-4b3d-4c29-b76f-33395ffb140d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:26.430839 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0b480-4b3d-4c29-b76f-33395ffb140d service swift] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:26.440413 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1024/2043] 10.222.0.23 () {60 vars in 1385 bytes} [Thu Sep 23 03:15:26 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 03:15:26.441646 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0b480-4b3d-4c29-b76f-33395ffb140d service swift] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:26.443098 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-d5a0b480-4b3d-4c29-b76f-33395ffb140d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:26.470321 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1020/2044] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:26.473421 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f7396-9348-489f-8138-050979b2d409 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:26.473715 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f7396-9348-489f-8138-050979b2d409 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:26.473996 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f7396-9348-489f-8138-050979b2d409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:26.500971 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-3b7f7396-9348-489f-8138-050979b2d409 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:26.502267 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-3b7f7396-9348-489f-8138-050979b2d409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:26.511074 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0b480-4b3d-4c29-b76f-33395ffb140d service swift] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:26.511604 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1021/2045] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:26.515815 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f7396-9348-489f-8138-050979b2d409 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:26.526320 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f7396-9348-489f-8138-050979b2d409 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:26.532007 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a5bcc-7d91-4c17-9c2a-cd0df623b077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:26.532194 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a5bcc-7d91-4c17-9c2a-cd0df623b077 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:26.532474 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a5bcc-7d91-4c17-9c2a-cd0df623b077 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:26.532788 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a5bcc-7d91-4c17-9c2a-cd0df623b077 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:26.533528 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a5bcc-7d91-4c17-9c2a-cd0df623b077 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:15:26.533836 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a5bcc-7d91-4c17-9c2a-cd0df623b077 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:26.535876 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a5bcc-7d91-4c17-9c2a-cd0df623b077 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:26.552270 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1022/2046] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:15:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 03:15:26.554504 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a5bcc-7d91-4c17-9c2a-cd0df623b077 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:26.565188 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a5bcc-7d91-4c17-9c2a-cd0df623b077 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:26.576478 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babfaa4-461b-4297-bba3-fba5c4f3fccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:26.577607 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babfaa4-461b-4297-bba3-fba5c4f3fccd admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:26.578070 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babfaa4-461b-4297-bba3-fba5c4f3fccd admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:26.578495 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babfaa4-461b-4297-bba3-fba5c4f3fccd admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:26.579352 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1babfaa4-461b-4297-bba3-fba5c4f3fccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:26.582042 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8581d3-63a1-4765-b4de-01988f06ca66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:26.582520 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1babfaa4-461b-4297-bba3-fba5c4f3fccd admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:26.582899 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8581d3-63a1-4765-b4de-01988f06ca66 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:26.583252 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8581d3-63a1-4765-b4de-01988f06ca66 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:26.583607 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8581d3-63a1-4765-b4de-01988f06ca66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:26.587280 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-dc8581d3-63a1-4765-b4de-01988f06ca66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:26.602599 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8581d3-63a1-4765-b4de-01988f06ca66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:26.604119 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8581d3-63a1-4765-b4de-01988f06ca66 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:26.617367 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1025/2047] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:15:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:15:26.678583 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1023/2048] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:15:26 2021] POST /identity/v3/projects => generated 409 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:15:26.682686 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8581d3-63a1-4765-b4de-01988f06ca66 service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:26.693090 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8581d3-63a1-4765-b4de-01988f06ca66 service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:26.764861 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46baf793-9192-4391-a214-aeb8e336ebc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:26.765561 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46baf793-9192-4391-a214-aeb8e336ebc6 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:26.765839 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46baf793-9192-4391-a214-aeb8e336ebc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:26.766637 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46baf793-9192-4391-a214-aeb8e336ebc6 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:26.766829 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46baf793-9192-4391-a214-aeb8e336ebc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:26.769515 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46baf793-9192-4391-a214-aeb8e336ebc6 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:26.900458 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1026/2049] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:15:26 2021] POST /identity/v3/users => generated 305 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:15:26.905977 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babfaa4-461b-4297-bba3-fba5c4f3fccd admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:26.931117 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babfaa4-461b-4297-bba3-fba5c4f3fccd admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:26.938007 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f44c8-9085-40a6-8293-0650b07b3e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:26.938387 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f44c8-9085-40a6-8293-0650b07b3e84 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:26.938672 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f44c8-9085-40a6-8293-0650b07b3e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:26.939034 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f44c8-9085-40a6-8293-0650b07b3e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:26.939824 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f44c8-9085-40a6-8293-0650b07b3e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:26.943829 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f44c8-9085-40a6-8293-0650b07b3e84 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:26.958150 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1024/2050] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:26 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:26.959125 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46baf793-9192-4391-a214-aeb8e336ebc6 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:26.983408 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46baf793-9192-4391-a214-aeb8e336ebc6 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:26.993922 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134182b-0582-4b23-b3e7-fdaee584327a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:26.994602 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134182b-0582-4b23-b3e7-fdaee584327a admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:26.994885 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134182b-0582-4b23-b3e7-fdaee584327a admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:26.995160 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134182b-0582-4b23-b3e7-fdaee584327a admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:26.996652 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134182b-0582-4b23-b3e7-fdaee584327a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:26.997572 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134182b-0582-4b23-b3e7-fdaee584327a admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:27.034933 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1027/2051] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:26 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:27.039283 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f44c8-9085-40a6-8293-0650b07b3e84 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:27.061394 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f44c8-9085-40a6-8293-0650b07b3e84 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:27.077082 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae9d5a-d7ed-43b2-b0d7-bd21650e7fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:27.078005 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae9d5a-d7ed-43b2-b0d7-bd21650e7fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:27.078304 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae9d5a-d7ed-43b2-b0d7-bd21650e7fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:27.078562 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae9d5a-d7ed-43b2-b0d7-bd21650e7fc8 admin admin] PATH_INFO: `/v3/projects/226da48e480b4ad0a576f5f47c3e3d00/users/1917432f35dd4da8ac85ff5e4df0c4c5/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:27.096898 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae9d5a-d7ed-43b2-b0d7-bd21650e7fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=226da48e480b4ad0a576f5f47c3e3d00, user_id=1917432f35dd4da8ac85ff5e4df0c4c5, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:27.100845 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae9d5a-d7ed-43b2-b0d7-bd21650e7fc8 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:27.250254 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1025/2052] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:15:27 2021] PUT /identity/v3/projects/226da48e480b4ad0a576f5f47c3e3d00/users/1917432f35dd4da8ac85ff5e4df0c4c5/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:15:27.267468 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6a241-9006-4de3-8c49-c47a908af62b None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:27.268016 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6a241-9006-4de3-8c49-c47a908af62b None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:27.268364 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6a241-9006-4de3-8c49-c47a908af62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:27.282477 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae9d5a-d7ed-43b2-b0d7-bd21650e7fc8 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:27.288841 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-92ae9d5a-d7ed-43b2-b0d7-bd21650e7fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:27.344478 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-29b6a241-9006-4de3-8c49-c47a908af62b None None] MFA Rules not processed for user `1917432f35dd4da8ac85ff5e4df0c4c5`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:27.345739 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-29b6a241-9006-4de3-8c49-c47a908af62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:27.423889 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae9d5a-d7ed-43b2-b0d7-bd21650e7fc8 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:27.426819 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1028/2053] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:27 2021] POST /identity/v3/auth/tokens => generated 3429 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:27.429253 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41eb26-c44b-4f84-b810-2afa04bb105a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:27.430207 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41eb26-c44b-4f84-b810-2afa04bb105a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:27.430473 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41eb26-c44b-4f84-b810-2afa04bb105a admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:27.430751 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41eb26-c44b-4f84-b810-2afa04bb105a admin admin] PATH_INFO: `/v3/projects/2cc09695617a4955a83fbb0069244022` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:27.431016 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6a241-9006-4de3-8c49-c47a908af62b None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:27.431928 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41eb26-c44b-4f84-b810-2afa04bb105a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cc09695617a4955a83fbb0069244022)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:27.433836 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41eb26-c44b-4f84-b810-2afa04bb105a admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:27.441771 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6a241-9006-4de3-8c49-c47a908af62b None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:27.446477 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfc556-075a-4189-b5d2-cf316334b0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:27.447150 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfc556-075a-4189-b5d2-cf316334b0d9 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:27.447432 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfc556-075a-4189-b5d2-cf316334b0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:27.447707 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfc556-075a-4189-b5d2-cf316334b0d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:27.448404 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfc556-075a-4189-b5d2-cf316334b0d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:27.450347 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfc556-075a-4189-b5d2-cf316334b0d9 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:27.553988 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1029/2054] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:15:27 2021] POST /identity/v3/projects => generated 407 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:15:27.559203 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfc556-075a-4189-b5d2-cf316334b0d9 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:27.560990 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-a8dfc556-075a-4189-b5d2-cf316334b0d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:27.568784 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-dc41eb26-c44b-4f84-b810-2afa04bb105a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cc09695617a4955a83fbb0069244022', 'request_id': 'req-dc41eb26-c44b-4f84-b810-2afa04bb105a'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:27.632118 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfc556-075a-4189-b5d2-cf316334b0d9 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:27.636182 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-dc41eb26-c44b-4f84-b810-2afa04bb105a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cc09695617a4955a83fbb0069244022', 'request_id': 'req-dc41eb26-c44b-4f84-b810-2afa04bb105a'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:27.636889 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8d5cc-58f3-4c7a-bc64-1ba6e53c3fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:27.637756 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8d5cc-58f3-4c7a-bc64-1ba6e53c3fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:27.638038 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8d5cc-58f3-4c7a-bc64-1ba6e53c3fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:27.638667 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8d5cc-58f3-4c7a-bc64-1ba6e53c3fa4 admin admin] PATH_INFO: `/v3/projects/35231e718e594a2e806bf159d80611cc` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:27.639544 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8d5cc-58f3-4c7a-bc64-1ba6e53c3fa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35231e718e594a2e806bf159d80611cc)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:27.641500 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8d5cc-58f3-4c7a-bc64-1ba6e53c3fa4 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:27.647412 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-dc41eb26-c44b-4f84-b810-2afa04bb105a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cc09695617a4955a83fbb0069244022', 'request_id': 'req-dc41eb26-c44b-4f84-b810-2afa04bb105a'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:27.656353 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-dc41eb26-c44b-4f84-b810-2afa04bb105a admin admin] The token cache is being invalidate because project 2cc09695617a4955a83fbb0069244022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:15:27.656738 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-dc41eb26-c44b-4f84-b810-2afa04bb105a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:27.657650 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-dc41eb26-c44b-4f84-b810-2afa04bb105a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:27.659271 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1026/2055] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:15:27 2021] DELETE /identity/v3/projects/2cc09695617a4955a83fbb0069244022 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:27.660786 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41eb26-c44b-4f84-b810-2afa04bb105a admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:27.662304 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-dc41eb26-c44b-4f84-b810-2afa04bb105a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:27.729864 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41eb26-c44b-4f84-b810-2afa04bb105a admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:27.734992 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daddd07-b97d-4dfb-8950-c74ff926d3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:27.735648 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daddd07-b97d-4dfb-8950-c74ff926d3f8 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:27.735931 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daddd07-b97d-4dfb-8950-c74ff926d3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:27.736208 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daddd07-b97d-4dfb-8950-c74ff926d3f8 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:27.736985 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daddd07-b97d-4dfb-8950-c74ff926d3f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:27.738967 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daddd07-b97d-4dfb-8950-c74ff926d3f8 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:27.801759 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-cae8d5cc-58f3-4c7a-bc64-1ba6e53c3fa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35231e718e594a2e806bf159d80611cc', 'request_id': 'req-cae8d5cc-58f3-4c7a-bc64-1ba6e53c3fa4'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:27.888312 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1027/2056] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:15:27 2021] POST /identity/v3/users => generated 310 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:15:27.888312 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5c65b-7151-41b7-8c50-bfa77ff1488f None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:27.888312 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5c65b-7151-41b7-8c50-bfa77ff1488f None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:27.888312 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5c65b-7151-41b7-8c50-bfa77ff1488f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:27.910817 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-cae8d5cc-58f3-4c7a-bc64-1ba6e53c3fa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35231e718e594a2e806bf159d80611cc', 'request_id': 'req-cae8d5cc-58f3-4c7a-bc64-1ba6e53c3fa4'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:27.916852 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-cae8d5cc-58f3-4c7a-bc64-1ba6e53c3fa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35231e718e594a2e806bf159d80611cc', 'request_id': 'req-cae8d5cc-58f3-4c7a-bc64-1ba6e53c3fa4'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:27.927884 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-cae8d5cc-58f3-4c7a-bc64-1ba6e53c3fa4 admin admin] The token cache is being invalidate because project 35231e718e594a2e806bf159d80611cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:15:27.928168 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-cae8d5cc-58f3-4c7a-bc64-1ba6e53c3fa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:27.928879 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-cae8d5cc-58f3-4c7a-bc64-1ba6e53c3fa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:27.930466 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1030/2057] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:15:27 2021] DELETE /identity/v3/projects/35231e718e594a2e806bf159d80611cc => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:27.934755 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-b6c5c65b-7151-41b7-8c50-bfa77ff1488f None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:27.934871 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8d5cc-58f3-4c7a-bc64-1ba6e53c3fa4 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:27.934956 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-b6c5c65b-7151-41b7-8c50-bfa77ff1488f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:27.935030 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-cae8d5cc-58f3-4c7a-bc64-1ba6e53c3fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:27.989481 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1028/2058] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:27.990974 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c2ce3-a5d9-49bf-aa2d-1abbc26d228e None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:27.991255 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c2ce3-a5d9-49bf-aa2d-1abbc26d228e None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:27.991528 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c2ce3-a5d9-49bf-aa2d-1abbc26d228e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:27.993968 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8d5cc-58f3-4c7a-bc64-1ba6e53c3fa4 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:27.999944 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d32688-897d-4f43-bbd3-ca279d80b876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:28.003408 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d32688-897d-4f43-bbd3-ca279d80b876 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:28.003408 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d32688-897d-4f43-bbd3-ca279d80b876 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:28.003408 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d32688-897d-4f43-bbd3-ca279d80b876 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:28.003408 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d32688-897d-4f43-bbd3-ca279d80b876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:28.004201 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d32688-897d-4f43-bbd3-ca279d80b876 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:28.012032 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-8a8c2ce3-a5d9-49bf-aa2d-1abbc26d228e None None] MFA Rules not processed for user `96c9b76133d74b79a0d2da9a884651e1`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:28.013256 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-8a8c2ce3-a5d9-49bf-aa2d-1abbc26d228e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:28.015694 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1031/2059] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:27 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:28.019674 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630e50b-f86d-4835-b0d1-8906677fdc67 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:28.019989 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630e50b-f86d-4835-b0d1-8906677fdc67 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:28.020328 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630e50b-f86d-4835-b0d1-8906677fdc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:28.039379 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-9630e50b-f86d-4835-b0d1-8906677fdc67 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:28.040616 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-9630e50b-f86d-4835-b0d1-8906677fdc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:28.058957 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1032/2060] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:28.058957 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d9097-68e5-4dd0-a8ac-a02e5ea8f1f9 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:28.058957 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d9097-68e5-4dd0-a8ac-a02e5ea8f1f9 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:28.058957 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d9097-68e5-4dd0-a8ac-a02e5ea8f1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:28.076831 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-cb6d9097-68e5-4dd0-a8ac-a02e5ea8f1f9 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:28.078069 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-cb6d9097-68e5-4dd0-a8ac-a02e5ea8f1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:28.086802 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1033/2061] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:28.090433 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d9097-68e5-4dd0-a8ac-a02e5ea8f1f9 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:28.099914 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d9097-68e5-4dd0-a8ac-a02e5ea8f1f9 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:28.105410 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c849b-8781-4c1e-8f06-5ca846a3bfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:28.106304 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c849b-8781-4c1e-8f06-5ca846a3bfdb admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:28.106846 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c849b-8781-4c1e-8f06-5ca846a3bfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:28.107129 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c849b-8781-4c1e-8f06-5ca846a3bfdb admin admin] PATH_INFO: `/v3/projects/82682ef5e3ca4e5d98caddb6d2d49ce6/users/ee2275d368584a94a5daf1b2bb469eb6/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:28.113327 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1029/2062] 10.222.0.23 () {58 vars in 1010 bytes} [Thu Sep 23 03:15:27 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:28.114771 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d756ebf-91e6-4395-946b-5409392ae552 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:28.115057 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d756ebf-91e6-4395-946b-5409392ae552 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:28.115337 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d756ebf-91e6-4395-946b-5409392ae552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:28.124442 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c849b-8781-4c1e-8f06-5ca846a3bfdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=82682ef5e3ca4e5d98caddb6d2d49ce6, user_id=ee2275d368584a94a5daf1b2bb469eb6, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:28.128538 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c849b-8781-4c1e-8f06-5ca846a3bfdb admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:28.134111 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-0d756ebf-91e6-4395-946b-5409392ae552 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:28.135320 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-0d756ebf-91e6-4395-946b-5409392ae552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:28.145941 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1030/2063] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:28.145941 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d756ebf-91e6-4395-946b-5409392ae552 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:28.153808 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d756ebf-91e6-4395-946b-5409392ae552 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:28.158388 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52a2a3-4c9e-4f61-8b85-2cd5a18a5c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:28.159036 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52a2a3-4c9e-4f61-8b85-2cd5a18a5c91 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:28.159320 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52a2a3-4c9e-4f61-8b85-2cd5a18a5c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:28.159718 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52a2a3-4c9e-4f61-8b85-2cd5a18a5c91 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:28.160507 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52a2a3-4c9e-4f61-8b85-2cd5a18a5c91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:15:28.160818 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52a2a3-4c9e-4f61-8b85-2cd5a18a5c91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:28.162387 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52a2a3-4c9e-4f61-8b85-2cd5a18a5c91 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:28.174238 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1031/2064] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:15:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:15:28.174509 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52a2a3-4c9e-4f61-8b85-2cd5a18a5c91 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:28.176632 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-2f52a2a3-4c9e-4f61-8b85-2cd5a18a5c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:28.196936 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1034/2065] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:15:28 2021] PUT /identity/v3/projects/82682ef5e3ca4e5d98caddb6d2d49ce6/users/ee2275d368584a94a5daf1b2bb469eb6/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:28.196936 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c849b-8781-4c1e-8f06-5ca846a3bfdb admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:28.244775 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52a2a3-4c9e-4f61-8b85-2cd5a18a5c91 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:28.258640 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c849b-8781-4c1e-8f06-5ca846a3bfdb admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:28.263711 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1f452-00d2-4907-ae64-693e5d5046e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:28.264506 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1f452-00d2-4907-ae64-693e5d5046e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:28.264813 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1f452-00d2-4907-ae64-693e5d5046e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:28.265090 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1f452-00d2-4907-ae64-693e5d5046e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:28.265821 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1f452-00d2-4907-ae64-693e5d5046e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:15:28.266130 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1f452-00d2-4907-ae64-693e5d5046e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:28.267709 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1f452-00d2-4907-ae64-693e5d5046e7 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:28.283163 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1035/2066] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:15:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:15:28.284782 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1f452-00d2-4907-ae64-693e5d5046e7 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:28.293677 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1f452-00d2-4907-ae64-693e5d5046e7 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:28.298331 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83437396-0a8e-43fa-b5fe-d069f93d2c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:28.298982 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83437396-0a8e-43fa-b5fe-d069f93d2c93 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:28.299291 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83437396-0a8e-43fa-b5fe-d069f93d2c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:28.299538 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83437396-0a8e-43fa-b5fe-d069f93d2c93 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:28.300863 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83437396-0a8e-43fa-b5fe-d069f93d2c93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:28.303246 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83437396-0a8e-43fa-b5fe-d069f93d2c93 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:28.310054 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00707259-5ce3-46d0-800e-62b0b5c37d40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df051fd059b34fe0993f501546d1610f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:28.310716 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00707259-5ce3-46d0-800e-62b0b5c37d40 service swift] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:28.311002 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00707259-5ce3-46d0-800e-62b0b5c37d40 service swift] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:28.311787 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00707259-5ce3-46d0-800e-62b0b5c37d40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:28.369190 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00707259-5ce3-46d0-800e-62b0b5c37d40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:28.370758 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00707259-5ce3-46d0-800e-62b0b5c37d40 service swift] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:28.379284 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1032/2067] 10.222.0.23 () {60 vars in 1385 bytes} [Thu Sep 23 03:15:28 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 03:15:28.380084 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00707259-5ce3-46d0-800e-62b0b5c37d40 service swift] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:28.396771 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1036/2068] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:15:28 2021] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:15:28.396771 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83437396-0a8e-43fa-b5fe-d069f93d2c93 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:28.400792 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00707259-5ce3-46d0-800e-62b0b5c37d40 service swift] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:28.456767 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83437396-0a8e-43fa-b5fe-d069f93d2c93 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:28.461661 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af30969-e1dd-4a30-bb10-b99f48ca96bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:28.462332 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af30969-e1dd-4a30-bb10-b99f48ca96bf admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:28.462621 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af30969-e1dd-4a30-bb10-b99f48ca96bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:28.462906 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af30969-e1dd-4a30-bb10-b99f48ca96bf admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:28.463633 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af30969-e1dd-4a30-bb10-b99f48ca96bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:28.465525 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af30969-e1dd-4a30-bb10-b99f48ca96bf admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:28.466708 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17edb0-9b78-4c71-973e-2f74f4afc2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:28.470122 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17edb0-9b78-4c71-973e-2f74f4afc2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:28.470122 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17edb0-9b78-4c71-973e-2f74f4afc2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:28.470122 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17edb0-9b78-4c71-973e-2f74f4afc2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:28.470122 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17edb0-9b78-4c71-973e-2f74f4afc2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:28.470469 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17edb0-9b78-4c71-973e-2f74f4afc2b6 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:28.481778 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1033/2069] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:28 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:28.482924 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17edb0-9b78-4c71-973e-2f74f4afc2b6 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:28.496256 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17edb0-9b78-4c71-973e-2f74f4afc2b6 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:28.505285 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2095421-9df9-4944-9c83-ba73d848e8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:28.506154 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2095421-9df9-4944-9c83-ba73d848e8ce admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:28.506436 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2095421-9df9-4944-9c83-ba73d848e8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:28.506714 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2095421-9df9-4944-9c83-ba73d848e8ce admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:28.507408 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2095421-9df9-4944-9c83-ba73d848e8ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:28.509397 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2095421-9df9-4944-9c83-ba73d848e8ce admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:28.577856 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1037/2070] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:15:28 2021] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:15:28.577856 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af30969-e1dd-4a30-bb10-b99f48ca96bf admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:28.636906 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af30969-e1dd-4a30-bb10-b99f48ca96bf admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:28.641733 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77be827-54df-49a2-af45-f9bebcf92ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:28.642638 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77be827-54df-49a2-af45-f9bebcf92ca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:28.642909 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77be827-54df-49a2-af45-f9bebcf92ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:28.643186 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77be827-54df-49a2-af45-f9bebcf92ca6 admin admin] PATH_INFO: `/v3/projects/82682ef5e3ca4e5d98caddb6d2d49ce6/users/ee2275d368584a94a5daf1b2bb469eb6/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:28.645215 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77be827-54df-49a2-af45-f9bebcf92ca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82682ef5e3ca4e5d98caddb6d2d49ce6, user_id=ee2275d368584a94a5daf1b2bb469eb6, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:28.652231 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77be827-54df-49a2-af45-f9bebcf92ca6 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:28.658637 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1038/2071] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:15:28 2021] PUT /identity/v3/projects/82682ef5e3ca4e5d98caddb6d2d49ce6/users/ee2275d368584a94a5daf1b2bb469eb6/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:28.661323 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77be827-54df-49a2-af45-f9bebcf92ca6 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:28.677693 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1034/2072] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:15:28 2021] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:15:28.679153 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105170f-7d4e-45b8-b409-2d5a1cff47e4 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:28.679475 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105170f-7d4e-45b8-b409-2d5a1cff47e4 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:28.679758 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105170f-7d4e-45b8-b409-2d5a1cff47e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:28.707576 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-0105170f-7d4e-45b8-b409-2d5a1cff47e4 None None] MFA Rules not processed for user `ee2275d368584a94a5daf1b2bb469eb6`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:28.708995 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-0105170f-7d4e-45b8-b409-2d5a1cff47e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:28.729478 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77be827-54df-49a2-af45-f9bebcf92ca6 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:28.734696 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d994961-edf6-45d3-b67e-e124b91f5b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:28.735369 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d994961-edf6-45d3-b67e-e124b91f5b2c admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:28.735643 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d994961-edf6-45d3-b67e-e124b91f5b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:28.735913 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d994961-edf6-45d3-b67e-e124b91f5b2c admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:28.736971 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d994961-edf6-45d3-b67e-e124b91f5b2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:28.739042 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d994961-edf6-45d3-b67e-e124b91f5b2c admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:28.776086 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1035/2073] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:28 2021] POST /identity/v3/auth/tokens => generated 3494 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:28.777088 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105170f-7d4e-45b8-b409-2d5a1cff47e4 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:28.787380 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105170f-7d4e-45b8-b409-2d5a1cff47e4 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:28.791905 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf4cf8-864f-459c-b017-63018108babe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:28.792576 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf4cf8-864f-459c-b017-63018108babe admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:28.792860 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf4cf8-864f-459c-b017-63018108babe admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:28.793134 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf4cf8-864f-459c-b017-63018108babe admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:28.793845 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf4cf8-864f-459c-b017-63018108babe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:28.795419 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf4cf8-864f-459c-b017-63018108babe admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:28.805221 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1036/2074] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:28 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:28.807663 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf4cf8-864f-459c-b017-63018108babe admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:28.809072 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-c7bf4cf8-864f-459c-b017-63018108babe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:28.833412 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1039/2075] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:15:28 2021] POST /identity/v3/users => generated 294 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:15:28.835100 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d994961-edf6-45d3-b67e-e124b91f5b2c admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:28.850349 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d994961-edf6-45d3-b67e-e124b91f5b2c admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:28.856035 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb354692-af2d-4a63-b7d6-78fb1c0f2e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:28.856743 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb354692-af2d-4a63-b7d6-78fb1c0f2e1d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:28.858215 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb354692-af2d-4a63-b7d6-78fb1c0f2e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:28.858215 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb354692-af2d-4a63-b7d6-78fb1c0f2e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:28.858390 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb354692-af2d-4a63-b7d6-78fb1c0f2e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:28.859928 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb354692-af2d-4a63-b7d6-78fb1c0f2e1d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:28.870076 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1040/2076] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:28 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:28.870870 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb354692-af2d-4a63-b7d6-78fb1c0f2e1d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:28.875446 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf4cf8-864f-459c-b017-63018108babe admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:28.879592 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d713a7-4025-4682-8265-74ddebc469b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:28.880277 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d713a7-4025-4682-8265-74ddebc469b6 service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:28.880623 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d713a7-4025-4682-8265-74ddebc469b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:28.886890 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb354692-af2d-4a63-b7d6-78fb1c0f2e1d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:28.887036 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d713a7-4025-4682-8265-74ddebc469b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:28.887135 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1170d51-2f62-4ac8-a423-db727a94d433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:28.887135 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1170d51-2f62-4ac8-a423-db727a94d433 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:28.887135 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1170d51-2f62-4ac8-a423-db727a94d433 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:28.887135 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1170d51-2f62-4ac8-a423-db727a94d433 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:28.887476 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1170d51-2f62-4ac8-a423-db727a94d433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:28.888793 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1170d51-2f62-4ac8-a423-db727a94d433 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:28.890898 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d713a7-4025-4682-8265-74ddebc469b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:28.892381 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d713a7-4025-4682-8265-74ddebc469b6 service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:28.901799 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1041/2077] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:28 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:28.901799 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1170d51-2f62-4ac8-a423-db727a94d433 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:28.903954 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1037/2078] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:15:28 2021] GET /identity/v3/auth/tokens => generated 3494 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:15:28.904724 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d713a7-4025-4682-8265-74ddebc469b6 service cinder] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:28.908812 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1170d51-2f62-4ac8-a423-db727a94d433 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:28.914120 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a24fc8a-8a6e-4115-ab80-de85a879e215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:28.914865 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24fc8a-8a6e-4115-ab80-de85a879e215 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:28.915146 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24fc8a-8a6e-4115-ab80-de85a879e215 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:28.915420 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24fc8a-8a6e-4115-ab80-de85a879e215 admin admin] PATH_INFO: `/v3/projects/2b9abb17bb2549bbae29a77fafaed4c2/users/0213eda9e60e48e5b72c17b6553a2221/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:28.915718 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d713a7-4025-4682-8265-74ddebc469b6 service cinder] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:28.921431 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72ec84-0bc7-4938-8310-b98a0436048f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:28.922530 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72ec84-0bc7-4938-8310-b98a0436048f admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:28.922530 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72ec84-0bc7-4938-8310-b98a0436048f admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:28.922765 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72ec84-0bc7-4938-8310-b98a0436048f admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:28.923623 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72ec84-0bc7-4938-8310-b98a0436048f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:28.925286 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72ec84-0bc7-4938-8310-b98a0436048f admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:28.931569 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a24fc8a-8a6e-4115-ab80-de85a879e215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b9abb17bb2549bbae29a77fafaed4c2, user_id=0213eda9e60e48e5b72c17b6553a2221, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:28.934232 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a24fc8a-8a6e-4115-ab80-de85a879e215 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:28.936680 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1038/2079] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:28 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:28.941708 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72ec84-0bc7-4938-8310-b98a0436048f admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:28.951976 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72ec84-0bc7-4938-8310-b98a0436048f admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:28.957309 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3dcdc7-cb1d-440a-b254-92345ef5edec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:28.958212 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dcdc7-cb1d-440a-b254-92345ef5edec admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:28.958488 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dcdc7-cb1d-440a-b254-92345ef5edec admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:28.958760 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dcdc7-cb1d-440a-b254-92345ef5edec admin admin] PATH_INFO: `/v3/projects/9a6b0205c6ec43968349bf8d34e40a58/users/3ca4df8f171144d19cddde28227404b1/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:28.974342 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3dcdc7-cb1d-440a-b254-92345ef5edec admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6b0205c6ec43968349bf8d34e40a58, user_id=3ca4df8f171144d19cddde28227404b1, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:28.977092 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3dcdc7-cb1d-440a-b254-92345ef5edec admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:29.002452 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1042/2080] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:15:28 2021] PUT /identity/v3/projects/2b9abb17bb2549bbae29a77fafaed4c2/users/0213eda9e60e48e5b72c17b6553a2221/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:29.012676 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab8910-ff39-42d4-af76-3cec7076a7c7 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:29.012960 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab8910-ff39-42d4-af76-3cec7076a7c7 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:29.013232 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab8910-ff39-42d4-af76-3cec7076a7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:29.040781 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-7fab8910-ff39-42d4-af76-3cec7076a7c7 None None] MFA Rules not processed for user `0213eda9e60e48e5b72c17b6553a2221`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:29.041972 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-7fab8910-ff39-42d4-af76-3cec7076a7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:29.106088 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1039/2081] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:15:28 2021] PUT /identity/v3/projects/9a6b0205c6ec43968349bf8d34e40a58/users/3ca4df8f171144d19cddde28227404b1/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:29.108440 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a4678-81a4-4fc2-ab96-ee46face20f3 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:29.108925 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a4678-81a4-4fc2-ab96-ee46face20f3 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:29.109162 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a4678-81a4-4fc2-ab96-ee46face20f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:29.125076 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1043/2082] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:29 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:15:29.131036 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab8910-ff39-42d4-af76-3cec7076a7c7 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:29.158234 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-f70a4678-81a4-4fc2-ab96-ee46face20f3 None None] MFA Rules not processed for user `3ca4df8f171144d19cddde28227404b1`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:29.158990 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-f70a4678-81a4-4fc2-ab96-ee46face20f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:29.229132 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab8910-ff39-42d4-af76-3cec7076a7c7 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:29.273781 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1040/2083] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:29 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:29.275159 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad4133-6066-4fb4-9833-f89e0b46cf63 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:29.275449 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad4133-6066-4fb4-9833-f89e0b46cf63 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:29.275755 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad4133-6066-4fb4-9833-f89e0b46cf63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:29.296649 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-53ad4133-6066-4fb4-9833-f89e0b46cf63 None None] MFA Rules not processed for user `96c9b76133d74b79a0d2da9a884651e1`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:29.298122 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-53ad4133-6066-4fb4-9833-f89e0b46cf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:29.310094 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90bc52-593e-4aa6-b0e7-4f6d29fa9116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:29.310767 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90bc52-593e-4aa6-b0e7-4f6d29fa9116 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:29.311221 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90bc52-593e-4aa6-b0e7-4f6d29fa9116 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:29.311691 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90bc52-593e-4aa6-b0e7-4f6d29fa9116 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:29.312680 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90bc52-593e-4aa6-b0e7-4f6d29fa9116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:29.314577 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90bc52-593e-4aa6-b0e7-4f6d29fa9116 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:29.364207 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1041/2084] 10.222.0.23 () {58 vars in 968 bytes} [Thu Sep 23 03:15:29 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:29.365093 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad4133-6066-4fb4-9833-f89e0b46cf63 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:29.366330 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-53ad4133-6066-4fb4-9833-f89e0b46cf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:29.421410 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad4133-6066-4fb4-9833-f89e0b46cf63 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:29.426246 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b5312-136a-49f9-b038-67279d30acb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:29.426650 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1044/2085] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:15:29 2021] POST /identity/v3/projects => generated 383 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:15:29.432045 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90bc52-593e-4aa6-b0e7-4f6d29fa9116 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:29.432164 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b5312-136a-49f9-b038-67279d30acb7 service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:29.432164 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b5312-136a-49f9-b038-67279d30acb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:29.432164 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b5312-136a-49f9-b038-67279d30acb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:29.439503 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b5312-136a-49f9-b038-67279d30acb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:29.441522 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b5312-136a-49f9-b038-67279d30acb7 service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:29.450021 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1042/2086] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:15:29 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:15:29.450781 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b5312-136a-49f9-b038-67279d30acb7 service cinder] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:29.461256 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b5312-136a-49f9-b038-67279d30acb7 service cinder] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:29.500158 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90bc52-593e-4aa6-b0e7-4f6d29fa9116 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:29.505878 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63bf0c-1679-49ed-8ddf-56041f060949 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df051fd059b34fe0993f501546d1610f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:29.506532 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63bf0c-1679-49ed-8ddf-56041f060949 service swift] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:29.506810 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63bf0c-1679-49ed-8ddf-56041f060949 service swift] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:29.507085 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63bf0c-1679-49ed-8ddf-56041f060949 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:29.526101 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e6d32-3539-40d4-a99c-1a2131d40571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:29.526782 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e6d32-3539-40d4-a99c-1a2131d40571 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:29.527077 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e6d32-3539-40d4-a99c-1a2131d40571 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:29.527352 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e6d32-3539-40d4-a99c-1a2131d40571 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:29.528319 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e6d32-3539-40d4-a99c-1a2131d40571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:29.530697 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e6d32-3539-40d4-a99c-1a2131d40571 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:29.577330 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63bf0c-1679-49ed-8ddf-56041f060949 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:29.579008 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63bf0c-1679-49ed-8ddf-56041f060949 service swift] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:29.588182 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1045/2087] 10.222.0.23 () {60 vars in 1385 bytes} [Thu Sep 23 03:15:29 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 03:15:29.589326 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63bf0c-1679-49ed-8ddf-56041f060949 service swift] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:29.620231 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1043/2088] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:15:29 2021] POST /identity/v3/users => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:15:29.624103 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e6d32-3539-40d4-a99c-1a2131d40571 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:29.635163 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e6d32-3539-40d4-a99c-1a2131d40571 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:29.639896 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ed078-fcd5-4f2e-bfe0-ae2b7e02afcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:29.640597 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ed078-fcd5-4f2e-bfe0-ae2b7e02afcb admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:29.640885 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ed078-fcd5-4f2e-bfe0-ae2b7e02afcb admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:29.641163 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ed078-fcd5-4f2e-bfe0-ae2b7e02afcb admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:29.642973 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ed078-fcd5-4f2e-bfe0-ae2b7e02afcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:29.643456 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ed078-fcd5-4f2e-bfe0-ae2b7e02afcb admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:29.643670 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63bf0c-1679-49ed-8ddf-56041f060949 service swift] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:29.647888 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f5e9b-e825-4f24-8b37-01b243bf8cd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:29.648555 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f5e9b-e825-4f24-8b37-01b243bf8cd9 service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:29.648838 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f5e9b-e825-4f24-8b37-01b243bf8cd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:29.649119 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f5e9b-e825-4f24-8b37-01b243bf8cd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:29.650971 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-8a8f5e9b-e825-4f24-8b37-01b243bf8cd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:29.654173 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1044/2089] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:29 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:15:29.658160 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ed078-fcd5-4f2e-bfe0-ae2b7e02afcb admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:29.668676 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ed078-fcd5-4f2e-bfe0-ae2b7e02afcb admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:29.674147 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454ef26-bb51-42de-b158-a722909853fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:29.674997 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454ef26-bb51-42de-b158-a722909853fe admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:29.675793 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454ef26-bb51-42de-b158-a722909853fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:29.676068 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454ef26-bb51-42de-b158-a722909853fe admin admin] PATH_INFO: `/v3/projects/32c66ddd88bb4d529f17d8b81366f654/users/18d8f6692d124b7980473dc01df69969/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:29.690946 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454ef26-bb51-42de-b158-a722909853fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c66ddd88bb4d529f17d8b81366f654, user_id=18d8f6692d124b7980473dc01df69969, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:29.693777 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454ef26-bb51-42de-b158-a722909853fe admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:29.713105 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f5e9b-e825-4f24-8b37-01b243bf8cd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:29.714572 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f5e9b-e825-4f24-8b37-01b243bf8cd9 service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:29.723839 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1046/2090] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:15:29 2021] GET /identity/v3/auth/tokens => generated 3429 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:15:29.853892 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1045/2091] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:15:29 2021] PUT /identity/v3/projects/32c66ddd88bb4d529f17d8b81366f654/users/18d8f6692d124b7980473dc01df69969/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:15:29.858144 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f5e9b-e825-4f24-8b37-01b243bf8cd9 service cinder] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:29.869231 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f5e9b-e825-4f24-8b37-01b243bf8cd9 service cinder] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:29.922703 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf98e5-cc4f-46c5-b08a-52b9ee449cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:29.923359 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf98e5-cc4f-46c5-b08a-52b9ee449cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:29.923944 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf98e5-cc4f-46c5-b08a-52b9ee449cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:29.924271 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf98e5-cc4f-46c5-b08a-52b9ee449cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:29.924955 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf98e5-cc4f-46c5-b08a-52b9ee449cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:29.926557 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf98e5-cc4f-46c5-b08a-52b9ee449cf7 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:29.935935 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1047/2092] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:29 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:29.940127 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454ef26-bb51-42de-b158-a722909853fe admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:29.950764 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454ef26-bb51-42de-b158-a722909853fe admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:29.955408 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ce097-4f68-4b81-a1eb-4f5407cb581d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:29.956281 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ce097-4f68-4b81-a1eb-4f5407cb581d admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:29.957123 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ce097-4f68-4b81-a1eb-4f5407cb581d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:29.957405 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ce097-4f68-4b81-a1eb-4f5407cb581d admin admin] PATH_INFO: `/v3/projects/32c66ddd88bb4d529f17d8b81366f654/users/18d8f6692d124b7980473dc01df69969/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:29.959351 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ce097-4f68-4b81-a1eb-4f5407cb581d admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c66ddd88bb4d529f17d8b81366f654, user_id=18d8f6692d124b7980473dc01df69969, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:29.962046 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ce097-4f68-4b81-a1eb-4f5407cb581d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:29.972111 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1046/2093] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:15:29 2021] PUT /identity/v3/projects/32c66ddd88bb4d529f17d8b81366f654/users/18d8f6692d124b7980473dc01df69969/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:15:29.983396 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a80efe-ee0f-4de0-9478-caae6cabc9f0 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:29.983811 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a80efe-ee0f-4de0-9478-caae6cabc9f0 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:29.984711 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a80efe-ee0f-4de0-9478-caae6cabc9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:30.011062 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-75a80efe-ee0f-4de0-9478-caae6cabc9f0 None None] MFA Rules not processed for user `18d8f6692d124b7980473dc01df69969`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:30.012283 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-75a80efe-ee0f-4de0-9478-caae6cabc9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:30.081365 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1048/2094] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:29 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:30.306282 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ce097-4f68-4b81-a1eb-4f5407cb581d admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:30.359223 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ce097-4f68-4b81-a1eb-4f5407cb581d admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:30.364055 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72449e0-9be2-4b43-9e16-6aec2ea45faa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:30.364847 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72449e0-9be2-4b43-9e16-6aec2ea45faa service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:30.365211 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72449e0-9be2-4b43-9e16-6aec2ea45faa service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:30.365559 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72449e0-9be2-4b43-9e16-6aec2ea45faa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:30.375866 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72449e0-9be2-4b43-9e16-6aec2ea45faa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:30.377366 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72449e0-9be2-4b43-9e16-6aec2ea45faa service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:30.387891 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1047/2095] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:15:30 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:15:30.601993 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a80efe-ee0f-4de0-9478-caae6cabc9f0 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:30.616384 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a80efe-ee0f-4de0-9478-caae6cabc9f0 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:30.620742 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a1946-31e8-4926-943e-1449b37447cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:30.621502 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a1946-31e8-4926-943e-1449b37447cb service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:30.624616 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a1946-31e8-4926-943e-1449b37447cb service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:30.624616 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a1946-31e8-4926-943e-1449b37447cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:30.714428 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76a1946-31e8-4926-943e-1449b37447cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:30.714428 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76a1946-31e8-4926-943e-1449b37447cb service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:30.714428 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1049/2096] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:15:30 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:15:31.242776 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72449e0-9be2-4b43-9e16-6aec2ea45faa service cinder] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:31.309639 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72449e0-9be2-4b43-9e16-6aec2ea45faa service cinder] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:31.314170 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf4091-10d7-463c-95fe-5f873c426214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:31.315136 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf4091-10d7-463c-95fe-5f873c426214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:31.315415 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf4091-10d7-463c-95fe-5f873c426214 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:31.315723 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf4091-10d7-463c-95fe-5f873c426214 admin admin] PATH_INFO: `/v3/users/0213eda9e60e48e5b72c17b6553a2221` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:31.317502 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf4091-10d7-463c-95fe-5f873c426214 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0213eda9e60e48e5b72c17b6553a2221)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:31.322291 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf4091-10d7-463c-95fe-5f873c426214 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:31.533721 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-8cbf4091-10d7-463c-95fe-5f873c426214 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0213eda9e60e48e5b72c17b6553a2221'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:31.535406 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-8cbf4091-10d7-463c-95fe-5f873c426214 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0213eda9e60e48e5b72c17b6553a2221'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:31.543613 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-8cbf4091-10d7-463c-95fe-5f873c426214 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0213eda9e60e48e5b72c17b6553a2221'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:31.619453 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-8cbf4091-10d7-463c-95fe-5f873c426214 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0213eda9e60e48e5b72c17b6553a2221'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:31.637818 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-8cbf4091-10d7-463c-95fe-5f873c426214 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0213eda9e60e48e5b72c17b6553a2221'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:31.644764 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1048/2097] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:15:31 2021] DELETE /identity/v3/users/0213eda9e60e48e5b72c17b6553a2221 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:31.648838 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72642b47-c333-4108-9b14-74009924bf3e None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:31.649249 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72642b47-c333-4108-9b14-74009924bf3e None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:31.649505 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72642b47-c333-4108-9b14-74009924bf3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:31.667460 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-72642b47-c333-4108-9b14-74009924bf3e None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:31.668861 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-72642b47-c333-4108-9b14-74009924bf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:31.764290 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1050/2098] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:15:31.774855 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf4091-10d7-463c-95fe-5f873c426214 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:31.778030 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-8cbf4091-10d7-463c-95fe-5f873c426214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:31.885555 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf4091-10d7-463c-95fe-5f873c426214 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:31.889792 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc35d7-02e3-4e14-bc25-bd0168b959b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:31.890468 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc35d7-02e3-4e14-bc25-bd0168b959b3 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:31.890803 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc35d7-02e3-4e14-bc25-bd0168b959b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:31.891089 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc35d7-02e3-4e14-bc25-bd0168b959b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:31.902002 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc35d7-02e3-4e14-bc25-bd0168b959b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:31.903304 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc35d7-02e3-4e14-bc25-bd0168b959b3 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:31.913573 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1049/2099] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:15:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:15:32.318301 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72642b47-c333-4108-9b14-74009924bf3e None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:32.319751 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-72642b47-c333-4108-9b14-74009924bf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:32.340413 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72642b47-c333-4108-9b14-74009924bf3e None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:32.345316 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef9217-2edd-4230-8997-cdfeab654d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:32.346246 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef9217-2edd-4230-8997-cdfeab654d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:32.346529 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef9217-2edd-4230-8997-cdfeab654d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:32.346806 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef9217-2edd-4230-8997-cdfeab654d06 admin admin] PATH_INFO: `/v3/projects/2b9abb17bb2549bbae29a77fafaed4c2` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:32.348285 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef9217-2edd-4230-8997-cdfeab654d06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b9abb17bb2549bbae29a77fafaed4c2)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:32.350277 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef9217-2edd-4230-8997-cdfeab654d06 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:32.464146 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-feef9217-2edd-4230-8997-cdfeab654d06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b9abb17bb2549bbae29a77fafaed4c2', 'request_id': 'req-feef9217-2edd-4230-8997-cdfeab654d06'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:32.550550 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-feef9217-2edd-4230-8997-cdfeab654d06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b9abb17bb2549bbae29a77fafaed4c2', 'request_id': 'req-feef9217-2edd-4230-8997-cdfeab654d06'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:32.556413 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-feef9217-2edd-4230-8997-cdfeab654d06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b9abb17bb2549bbae29a77fafaed4c2', 'request_id': 'req-feef9217-2edd-4230-8997-cdfeab654d06'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:32.567713 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-feef9217-2edd-4230-8997-cdfeab654d06 admin admin] The token cache is being invalidate because project 2b9abb17bb2549bbae29a77fafaed4c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:15:32.568000 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-feef9217-2edd-4230-8997-cdfeab654d06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:32.568692 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-feef9217-2edd-4230-8997-cdfeab654d06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:32.570235 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1051/2100] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:15:32 2021] DELETE /identity/v3/projects/2b9abb17bb2549bbae29a77fafaed4c2 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:32.574330 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc35d7-02e3-4e14-bc25-bd0168b959b3 service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:32.584989 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc35d7-02e3-4e14-bc25-bd0168b959b3 service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:32.648366 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984657b0-de00-4506-aaba-b991e1274063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:32.649192 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984657b0-de00-4506-aaba-b991e1274063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:32.649475 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984657b0-de00-4506-aaba-b991e1274063 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:32.649748 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984657b0-de00-4506-aaba-b991e1274063 admin admin] PATH_INFO: `/v3/users/18d8f6692d124b7980473dc01df69969` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:32.651101 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984657b0-de00-4506-aaba-b991e1274063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18d8f6692d124b7980473dc01df69969)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:32.653256 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984657b0-de00-4506-aaba-b991e1274063 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:32.919774 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-984657b0-de00-4506-aaba-b991e1274063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18d8f6692d124b7980473dc01df69969'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:32.920425 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-984657b0-de00-4506-aaba-b991e1274063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18d8f6692d124b7980473dc01df69969'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:32.934625 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-984657b0-de00-4506-aaba-b991e1274063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18d8f6692d124b7980473dc01df69969'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:33.019427 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-984657b0-de00-4506-aaba-b991e1274063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18d8f6692d124b7980473dc01df69969'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:33.031619 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-984657b0-de00-4506-aaba-b991e1274063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18d8f6692d124b7980473dc01df69969'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:33.037703 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1050/2101] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:15:32 2021] DELETE /identity/v3/users/18d8f6692d124b7980473dc01df69969 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:33.145419 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef9217-2edd-4230-8997-cdfeab654d06 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:33.146928 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-feef9217-2edd-4230-8997-cdfeab654d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:33.165322 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef9217-2edd-4230-8997-cdfeab654d06 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:33.238676 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e94ff6-d021-4366-8a1d-0872875863e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:33.239962 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e94ff6-d021-4366-8a1d-0872875863e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:33.240251 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e94ff6-d021-4366-8a1d-0872875863e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:33.240578 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e94ff6-d021-4366-8a1d-0872875863e1 admin admin] PATH_INFO: `/v3/users/c56e9f5417c743fc938f86802e50b143` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:33.241849 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e94ff6-d021-4366-8a1d-0872875863e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c56e9f5417c743fc938f86802e50b143)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:33.243802 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e94ff6-d021-4366-8a1d-0872875863e1 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:33.489611 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-42e94ff6-d021-4366-8a1d-0872875863e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c56e9f5417c743fc938f86802e50b143'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:33.490322 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-42e94ff6-d021-4366-8a1d-0872875863e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c56e9f5417c743fc938f86802e50b143'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:33.499881 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-42e94ff6-d021-4366-8a1d-0872875863e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c56e9f5417c743fc938f86802e50b143'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:33.499881 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-42e94ff6-d021-4366-8a1d-0872875863e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c56e9f5417c743fc938f86802e50b143'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:33.573340 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-42e94ff6-d021-4366-8a1d-0872875863e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c56e9f5417c743fc938f86802e50b143'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:33.591744 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1052/2102] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:15:33 2021] DELETE /identity/v3/users/c56e9f5417c743fc938f86802e50b143 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:33.596175 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81177e-a63f-4d92-b08b-351c2635cbde None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:33.596663 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81177e-a63f-4d92-b08b-351c2635cbde None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:33.596752 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81177e-a63f-4d92-b08b-351c2635cbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:33.613696 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-ef81177e-a63f-4d92-b08b-351c2635cbde None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:33.614897 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-ef81177e-a63f-4d92-b08b-351c2635cbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:33.670478 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1051/2103] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:33.672522 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e94ff6-d021-4366-8a1d-0872875863e1 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:33.675003 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-42e94ff6-d021-4366-8a1d-0872875863e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:33.684568 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81177e-a63f-4d92-b08b-351c2635cbde None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:33.685990 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-ef81177e-a63f-4d92-b08b-351c2635cbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:33.690499 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e94ff6-d021-4366-8a1d-0872875863e1 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:33.698459 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edd43c-cc68-49fc-bd71-faf835cf7eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:33.699072 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edd43c-cc68-49fc-bd71-faf835cf7eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:33.699381 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edd43c-cc68-49fc-bd71-faf835cf7eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:33.699623 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edd43c-cc68-49fc-bd71-faf835cf7eb2 admin admin] PATH_INFO: `/v3/projects/32c66ddd88bb4d529f17d8b81366f654` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:33.700941 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46edd43c-cc68-49fc-bd71-faf835cf7eb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32c66ddd88bb4d529f17d8b81366f654)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:33.702898 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46edd43c-cc68-49fc-bd71-faf835cf7eb2 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:33.741069 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81177e-a63f-4d92-b08b-351c2635cbde None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:33.744830 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a52794-b6ef-4a93-bfed-c1f424055db8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:33.745475 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a52794-b6ef-4a93-bfed-c1f424055db8 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:33.745765 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a52794-b6ef-4a93-bfed-c1f424055db8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:33.746039 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a52794-b6ef-4a93-bfed-c1f424055db8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:33.755437 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a52794-b6ef-4a93-bfed-c1f424055db8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:33.756898 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a52794-b6ef-4a93-bfed-c1f424055db8 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:33.766009 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1052/2104] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:15:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:15:33.848712 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-46edd43c-cc68-49fc-bd71-faf835cf7eb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32c66ddd88bb4d529f17d8b81366f654', 'request_id': 'req-46edd43c-cc68-49fc-bd71-faf835cf7eb2'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:33.938993 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-46edd43c-cc68-49fc-bd71-faf835cf7eb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32c66ddd88bb4d529f17d8b81366f654', 'request_id': 'req-46edd43c-cc68-49fc-bd71-faf835cf7eb2'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:33.945490 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-46edd43c-cc68-49fc-bd71-faf835cf7eb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32c66ddd88bb4d529f17d8b81366f654', 'request_id': 'req-46edd43c-cc68-49fc-bd71-faf835cf7eb2'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:33.957075 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-46edd43c-cc68-49fc-bd71-faf835cf7eb2 admin admin] The token cache is being invalidate because project 32c66ddd88bb4d529f17d8b81366f654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:15:33.957358 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-46edd43c-cc68-49fc-bd71-faf835cf7eb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:33.958009 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-46edd43c-cc68-49fc-bd71-faf835cf7eb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:33.959552 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1053/2105] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:15:33 2021] DELETE /identity/v3/projects/32c66ddd88bb4d529f17d8b81366f654 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:33.965711 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce135c-afa2-48a1-8ba2-c4fc4b740f95 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:33.966000 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce135c-afa2-48a1-8ba2-c4fc4b740f95 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:33.966363 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce135c-afa2-48a1-8ba2-c4fc4b740f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:33.984216 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-26ce135c-afa2-48a1-8ba2-c4fc4b740f95 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:33.985442 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-26ce135c-afa2-48a1-8ba2-c4fc4b740f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:34.004479 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edd43c-cc68-49fc-bd71-faf835cf7eb2 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:34.006576 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-46edd43c-cc68-49fc-bd71-faf835cf7eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:34.056616 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1053/2106] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:34.064729 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472769a-ac3d-4afb-995a-9c10c0b51d3c None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:34.065301 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472769a-ac3d-4afb-995a-9c10c0b51d3c None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:34.065670 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472769a-ac3d-4afb-995a-9c10c0b51d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:34.083411 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edd43c-cc68-49fc-bd71-faf835cf7eb2 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:34.084939 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-0472769a-ac3d-4afb-995a-9c10c0b51d3c None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:34.086148 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-0472769a-ac3d-4afb-995a-9c10c0b51d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:34.088951 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c101b-6f01-4854-a0bc-7becd3d93fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:34.089815 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c101b-6f01-4854-a0bc-7becd3d93fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:34.090096 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c101b-6f01-4854-a0bc-7becd3d93fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:34.090379 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c101b-6f01-4854-a0bc-7becd3d93fcd admin admin] PATH_INFO: `/v3/projects/6f66ea6efe7a4d2cb84edec8a4b42ad3` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:34.091559 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c101b-6f01-4854-a0bc-7becd3d93fcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f66ea6efe7a4d2cb84edec8a4b42ad3)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:34.093703 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c101b-6f01-4854-a0bc-7becd3d93fcd admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:34.094355 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1054/2107] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:34.098209 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472769a-ac3d-4afb-995a-9c10c0b51d3c None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:34.107364 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472769a-ac3d-4afb-995a-9c10c0b51d3c None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:34.113439 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73af258-eb25-4ff6-8e71-8e95839b3762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:34.115269 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73af258-eb25-4ff6-8e71-8e95839b3762 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:34.115269 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73af258-eb25-4ff6-8e71-8e95839b3762 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:34.115269 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73af258-eb25-4ff6-8e71-8e95839b3762 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:34.115511 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73af258-eb25-4ff6-8e71-8e95839b3762 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:15:34.115630 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73af258-eb25-4ff6-8e71-8e95839b3762 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:34.117398 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73af258-eb25-4ff6-8e71-8e95839b3762 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:34.130458 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1055/2108] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:15:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 03:15:34.134775 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73af258-eb25-4ff6-8e71-8e95839b3762 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:34.144634 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73af258-eb25-4ff6-8e71-8e95839b3762 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:34.149161 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21141b-cd32-4c8e-a640-8e0ddd5e3148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:34.149789 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21141b-cd32-4c8e-a640-8e0ddd5e3148 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:34.150049 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21141b-cd32-4c8e-a640-8e0ddd5e3148 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:34.150322 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21141b-cd32-4c8e-a640-8e0ddd5e3148 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:34.150987 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21141b-cd32-4c8e-a640-8e0ddd5e3148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:34.152883 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21141b-cd32-4c8e-a640-8e0ddd5e3148 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:34.214330 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e50c101b-6f01-4854-a0bc-7becd3d93fcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f66ea6efe7a4d2cb84edec8a4b42ad3', 'request_id': 'req-e50c101b-6f01-4854-a0bc-7becd3d93fcd'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:34.300584 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1056/2109] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:15:34 2021] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:15:34.304575 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21141b-cd32-4c8e-a640-8e0ddd5e3148 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:34.315976 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e50c101b-6f01-4854-a0bc-7becd3d93fcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f66ea6efe7a4d2cb84edec8a4b42ad3', 'request_id': 'req-e50c101b-6f01-4854-a0bc-7becd3d93fcd'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:34.321894 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e50c101b-6f01-4854-a0bc-7becd3d93fcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f66ea6efe7a4d2cb84edec8a4b42ad3', 'request_id': 'req-e50c101b-6f01-4854-a0bc-7becd3d93fcd'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:34.333350 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e50c101b-6f01-4854-a0bc-7becd3d93fcd admin admin] The token cache is being invalidate because project 6f66ea6efe7a4d2cb84edec8a4b42ad3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:15:34.333643 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e50c101b-6f01-4854-a0bc-7becd3d93fcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:34.334331 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e50c101b-6f01-4854-a0bc-7becd3d93fcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:15:34.336141 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1054/2110] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:15:34 2021] DELETE /identity/v3/projects/6f66ea6efe7a4d2cb84edec8a4b42ad3 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:15:34.341514 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a88b7b-8d65-4722-94fc-52604a989d4e None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:34.341805 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a88b7b-8d65-4722-94fc-52604a989d4e None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:34.342088 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a88b7b-8d65-4722-94fc-52604a989d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:34.360139 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-33a88b7b-8d65-4722-94fc-52604a989d4e None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:34.361381 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-33a88b7b-8d65-4722-94fc-52604a989d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:34.364166 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21141b-cd32-4c8e-a640-8e0ddd5e3148 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:34.368795 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc602ccb-c0a2-42c2-9e46-f598610d51af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:34.369294 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1055/2111] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:15:34.369458 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc602ccb-c0a2-42c2-9e46-f598610d51af admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:34.369740 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc602ccb-c0a2-42c2-9e46-f598610d51af admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:34.370014 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc602ccb-c0a2-42c2-9e46-f598610d51af admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:34.370692 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc602ccb-c0a2-42c2-9e46-f598610d51af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:34.372612 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc602ccb-c0a2-42c2-9e46-f598610d51af admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:34.376756 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d007c-aac2-472e-ac11-15e4cdd9ac15 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:34.377059 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d007c-aac2-472e-ac11-15e4cdd9ac15 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:34.377329 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d007c-aac2-472e-ac11-15e4cdd9ac15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:34.401115 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-a03d007c-aac2-472e-ac11-15e4cdd9ac15 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:34.402315 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-a03d007c-aac2-472e-ac11-15e4cdd9ac15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:34.410238 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1056/2112] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:15:34.414295 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d007c-aac2-472e-ac11-15e4cdd9ac15 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:34.422994 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d007c-aac2-472e-ac11-15e4cdd9ac15 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:34.427672 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c5e19-1466-4c01-b113-958cbf743d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:34.428315 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c5e19-1466-4c01-b113-958cbf743d00 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:34.428641 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c5e19-1466-4c01-b113-958cbf743d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:34.428926 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c5e19-1466-4c01-b113-958cbf743d00 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:34.429646 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c5e19-1466-4c01-b113-958cbf743d00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:15:34.429955 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c5e19-1466-4c01-b113-958cbf743d00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:34.431555 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c5e19-1466-4c01-b113-958cbf743d00 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:34.443320 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1057/2113] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:15:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 03:15:34.447513 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c5e19-1466-4c01-b113-958cbf743d00 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:34.457396 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c5e19-1466-4c01-b113-958cbf743d00 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:34.461892 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec912d-58ae-4334-a2a9-be4deb2a8b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:34.462513 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec912d-58ae-4334-a2a9-be4deb2a8b4b admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:34.462799 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec912d-58ae-4334-a2a9-be4deb2a8b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:34.463081 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec912d-58ae-4334-a2a9-be4deb2a8b4b admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:34.463788 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec912d-58ae-4334-a2a9-be4deb2a8b4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:34.465688 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec912d-58ae-4334-a2a9-be4deb2a8b4b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:34.493912 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1057/2114] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:15:34 2021] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:15:34.497874 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc602ccb-c0a2-42c2-9e46-f598610d51af admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:34.499450 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-bc602ccb-c0a2-42c2-9e46-f598610d51af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:34.511743 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc602ccb-c0a2-42c2-9e46-f598610d51af admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:34.516370 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ddfff-598f-456b-a62e-098eecf94378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:34.517038 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ddfff-598f-456b-a62e-098eecf94378 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:34.517321 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ddfff-598f-456b-a62e-098eecf94378 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:34.517598 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ddfff-598f-456b-a62e-098eecf94378 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:34.518306 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ddfff-598f-456b-a62e-098eecf94378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:34.520471 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ddfff-598f-456b-a62e-098eecf94378 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:34.530217 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1058/2115] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:34 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:15:34.533795 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ddfff-598f-456b-a62e-098eecf94378 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:34.542917 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ddfff-598f-456b-a62e-098eecf94378 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:34.547600 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10980ed2-45fa-4265-9f95-8ab3c6e41ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:34.548215 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10980ed2-45fa-4265-9f95-8ab3c6e41ece admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:34.548518 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10980ed2-45fa-4265-9f95-8ab3c6e41ece admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:34.548817 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10980ed2-45fa-4265-9f95-8ab3c6e41ece admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:34.549511 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10980ed2-45fa-4265-9f95-8ab3c6e41ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:34.551033 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10980ed2-45fa-4265-9f95-8ab3c6e41ece admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:34.560216 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1059/2116] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:34 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:15:34.563878 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10980ed2-45fa-4265-9f95-8ab3c6e41ece admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:34.569436 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1058/2117] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:15:34 2021] POST /identity/v3/projects => generated 399 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:15:34.573318 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec912d-58ae-4334-a2a9-be4deb2a8b4b admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:34.573754 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10980ed2-45fa-4265-9f95-8ab3c6e41ece admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:34.629901 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b79e92-cb1d-4544-9f1d-9e24d6c265c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:34.630806 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b79e92-cb1d-4544-9f1d-9e24d6c265c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:34.631093 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b79e92-cb1d-4544-9f1d-9e24d6c265c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:34.631376 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b79e92-cb1d-4544-9f1d-9e24d6c265c3 admin admin] PATH_INFO: `/v3/projects/4f1fc702b735418e940075afcdee2355/users/2a06c70266b54b029e4e124874ac8e54/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:34.635181 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec912d-58ae-4334-a2a9-be4deb2a8b4b admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:34.640027 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d882f56-ba54-4acf-84d0-373dfc9cda6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:34.640857 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d882f56-ba54-4acf-84d0-373dfc9cda6d admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:34.641087 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d882f56-ba54-4acf-84d0-373dfc9cda6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:34.641316 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d882f56-ba54-4acf-84d0-373dfc9cda6d admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:34.642009 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d882f56-ba54-4acf-84d0-373dfc9cda6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:34.644524 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d882f56-ba54-4acf-84d0-373dfc9cda6d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:34.647784 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b79e92-cb1d-4544-9f1d-9e24d6c265c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1fc702b735418e940075afcdee2355, user_id=2a06c70266b54b029e4e124874ac8e54, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:34.650454 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b79e92-cb1d-4544-9f1d-9e24d6c265c3 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:34.746793 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1060/2118] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:15:34 2021] PUT /identity/v3/projects/4f1fc702b735418e940075afcdee2355/users/2a06c70266b54b029e4e124874ac8e54/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:15:34.747006 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1059/2119] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:15:34 2021] POST /identity/v3/users => generated 300 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:15:34.750727 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b79e92-cb1d-4544-9f1d-9e24d6c265c3 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:34.758098 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d05d0d-6a6a-4adb-8d87-126506beb81e None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:34.758480 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d05d0d-6a6a-4adb-8d87-126506beb81e None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:34.758827 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d05d0d-6a6a-4adb-8d87-126506beb81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:34.783918 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-21d05d0d-6a6a-4adb-8d87-126506beb81e None None] MFA Rules not processed for user `2a06c70266b54b029e4e124874ac8e54`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:34.785140 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-21d05d0d-6a6a-4adb-8d87-126506beb81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:34.810486 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b79e92-cb1d-4544-9f1d-9e24d6c265c3 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:34.815665 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee780ae8-22c4-4ed2-8cb2-eabc303853be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:34.816943 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee780ae8-22c4-4ed2-8cb2-eabc303853be admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:34.817231 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee780ae8-22c4-4ed2-8cb2-eabc303853be admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:34.817501 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee780ae8-22c4-4ed2-8cb2-eabc303853be admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:34.818438 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee780ae8-22c4-4ed2-8cb2-eabc303853be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:34.819832 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee780ae8-22c4-4ed2-8cb2-eabc303853be admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:34.830068 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1061/2120] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:34 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:15:34.833954 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee780ae8-22c4-4ed2-8cb2-eabc303853be admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:34.843014 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee780ae8-22c4-4ed2-8cb2-eabc303853be admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:34.847617 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a2c78-d4ac-41b2-a01a-b4494de65481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:34.848257 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a2c78-d4ac-41b2-a01a-b4494de65481 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:34.848566 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a2c78-d4ac-41b2-a01a-b4494de65481 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:34.848798 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1060/2121] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:34 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:34.848907 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a2c78-d4ac-41b2-a01a-b4494de65481 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:34.849536 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a2c78-d4ac-41b2-a01a-b4494de65481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:34.851114 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a2c78-d4ac-41b2-a01a-b4494de65481 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:34.852801 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d05d0d-6a6a-4adb-8d87-126506beb81e None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:34.864449 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1062/2122] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:34 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:15:34.864612 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d05d0d-6a6a-4adb-8d87-126506beb81e None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:34.865538 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a2c78-d4ac-41b2-a01a-b4494de65481 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:34.868691 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72043c-c4e7-4e75-a9ad-3a28d344fe45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:34.869400 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72043c-c4e7-4e75-a9ad-3a28d344fe45 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:34.869689 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72043c-c4e7-4e75-a9ad-3a28d344fe45 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:34.869972 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72043c-c4e7-4e75-a9ad-3a28d344fe45 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:34.870660 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72043c-c4e7-4e75-a9ad-3a28d344fe45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:34.872584 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72043c-c4e7-4e75-a9ad-3a28d344fe45 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:34.874732 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a2c78-d4ac-41b2-a01a-b4494de65481 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:34.879420 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830de90-bea5-4286-bb01-e6949d179e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:34.880277 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830de90-bea5-4286-bb01-e6949d179e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:34.880595 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830de90-bea5-4286-bb01-e6949d179e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:34.880894 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830de90-bea5-4286-bb01-e6949d179e1e admin admin] PATH_INFO: `/v3/projects/61af156aaae545c4a94a96dbbe8ebd16/users/a5ec7022e0cd427dbff60bcea39f7c2b/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:34.897000 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830de90-bea5-4286-bb01-e6949d179e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=61af156aaae545c4a94a96dbbe8ebd16, user_id=a5ec7022e0cd427dbff60bcea39f7c2b, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:34.899591 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830de90-bea5-4286-bb01-e6949d179e1e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:34.956564 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1061/2123] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:15:34 2021] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:15:34.960559 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72043c-c4e7-4e75-a9ad-3a28d344fe45 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:34.978872 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1063/2124] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:15:34 2021] PUT /identity/v3/projects/61af156aaae545c4a94a96dbbe8ebd16/users/a5ec7022e0cd427dbff60bcea39f7c2b/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:34.990672 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9345f0-1d26-4254-be7a-9bef9b421c93 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:34.990957 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9345f0-1d26-4254-be7a-9bef9b421c93 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:34.991234 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9345f0-1d26-4254-be7a-9bef9b421c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:35.017444 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-bd9345f0-1d26-4254-be7a-9bef9b421c93 None None] MFA Rules not processed for user `a5ec7022e0cd427dbff60bcea39f7c2b`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:35.018670 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-bd9345f0-1d26-4254-be7a-9bef9b421c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:35.021065 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72043c-c4e7-4e75-a9ad-3a28d344fe45 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:35.075822 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c33ead-b55c-43aa-a9c5-09f9b5712231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:35.076523 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c33ead-b55c-43aa-a9c5-09f9b5712231 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:35.076807 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c33ead-b55c-43aa-a9c5-09f9b5712231 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:35.077081 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c33ead-b55c-43aa-a9c5-09f9b5712231 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:35.077809 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c33ead-b55c-43aa-a9c5-09f9b5712231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:35.079743 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c33ead-b55c-43aa-a9c5-09f9b5712231 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:35.080887 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1064/2125] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:34 2021] POST /identity/v3/auth/tokens => generated 3419 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:15:35.091319 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9345f0-1d26-4254-be7a-9bef9b421c93 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:35.092722 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-bd9345f0-1d26-4254-be7a-9bef9b421c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:35.147345 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9345f0-1d26-4254-be7a-9bef9b421c93 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:35.151060 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d972f-aab1-4eeb-806b-2878abc75b80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:35.151704 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d972f-aab1-4eeb-806b-2878abc75b80 service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:35.151984 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d972f-aab1-4eeb-806b-2878abc75b80 service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:35.152257 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d972f-aab1-4eeb-806b-2878abc75b80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:35.161033 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d972f-aab1-4eeb-806b-2878abc75b80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:35.162435 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d972f-aab1-4eeb-806b-2878abc75b80 service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:35.171134 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1065/2126] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:15:35 2021] GET /identity/v3/auth/tokens => generated 3419 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:15:35.194432 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1062/2127] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:15:34 2021] POST /identity/v3/users => generated 298 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:15:35.199081 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d972f-aab1-4eeb-806b-2878abc75b80 service cinder] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:35.214983 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d972f-aab1-4eeb-806b-2878abc75b80 service cinder] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:35.220081 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a5805-fb73-4433-9b1a-97667605bb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:35.220817 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a5805-fb73-4433-9b1a-97667605bb6b admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:35.221102 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a5805-fb73-4433-9b1a-97667605bb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:35.221379 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a5805-fb73-4433-9b1a-97667605bb6b admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:35.223118 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a5805-fb73-4433-9b1a-97667605bb6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:35.224400 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a5805-fb73-4433-9b1a-97667605bb6b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:35.236778 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1066/2128] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:35 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:35.241742 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c33ead-b55c-43aa-a9c5-09f9b5712231 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:35.255244 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c33ead-b55c-43aa-a9c5-09f9b5712231 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:35.259130 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2ed1f-65db-449f-9d53-1fbcdf0ca109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:35.260027 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2ed1f-65db-449f-9d53-1fbcdf0ca109 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:35.260314 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2ed1f-65db-449f-9d53-1fbcdf0ca109 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:35.260626 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2ed1f-65db-449f-9d53-1fbcdf0ca109 admin admin] PATH_INFO: `/v3/projects/5dce517e18d047799922ad93b8c33aa1/users/b1b2ea13ffbc401a9cb31ff4049a1290/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:35.281371 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2ed1f-65db-449f-9d53-1fbcdf0ca109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dce517e18d047799922ad93b8c33aa1, user_id=b1b2ea13ffbc401a9cb31ff4049a1290, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:35.284165 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2ed1f-65db-449f-9d53-1fbcdf0ca109 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:35.380323 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1063/2129] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:15:35 2021] PUT /identity/v3/projects/5dce517e18d047799922ad93b8c33aa1/users/b1b2ea13ffbc401a9cb31ff4049a1290/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:35.387656 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a5805-fb73-4433-9b1a-97667605bb6b admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:35.397930 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a5805-fb73-4433-9b1a-97667605bb6b admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:35.452634 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62eb883-f86d-4021-b13b-b7b09d9d2334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:35.453309 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62eb883-f86d-4021-b13b-b7b09d9d2334 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:35.453590 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62eb883-f86d-4021-b13b-b7b09d9d2334 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:35.453867 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62eb883-f86d-4021-b13b-b7b09d9d2334 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:35.454621 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62eb883-f86d-4021-b13b-b7b09d9d2334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:35.456898 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62eb883-f86d-4021-b13b-b7b09d9d2334 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:35.466674 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1067/2130] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:15:35 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:15:35.471056 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2ed1f-65db-449f-9d53-1fbcdf0ca109 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:35.481370 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2ed1f-65db-449f-9d53-1fbcdf0ca109 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:35.486363 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949d42a-5e40-4d58-b216-8837c05ae49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:35.487243 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949d42a-5e40-4d58-b216-8837c05ae49e admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:35.488085 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949d42a-5e40-4d58-b216-8837c05ae49e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:35.488359 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949d42a-5e40-4d58-b216-8837c05ae49e admin admin] PATH_INFO: `/v3/projects/5dce517e18d047799922ad93b8c33aa1/users/b1b2ea13ffbc401a9cb31ff4049a1290/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:35.490559 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949d42a-5e40-4d58-b216-8837c05ae49e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dce517e18d047799922ad93b8c33aa1, user_id=b1b2ea13ffbc401a9cb31ff4049a1290, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:35.493319 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949d42a-5e40-4d58-b216-8837c05ae49e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:35.504084 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1064/2131] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:15:35 2021] PUT /identity/v3/projects/5dce517e18d047799922ad93b8c33aa1/users/b1b2ea13ffbc401a9cb31ff4049a1290/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:15:35.514044 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760e4b5-5c5c-4e25-a890-32e12d185d97 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:35.514337 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760e4b5-5c5c-4e25-a890-32e12d185d97 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:35.514614 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760e4b5-5c5c-4e25-a890-32e12d185d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:35.540819 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-4760e4b5-5c5c-4e25-a890-32e12d185d97 None None] MFA Rules not processed for user `b1b2ea13ffbc401a9cb31ff4049a1290`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:15:35.542069 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-4760e4b5-5c5c-4e25-a890-32e12d185d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:15:35.606462 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1068/2132] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:15:35 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:15:35.935791 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949d42a-5e40-4d58-b216-8837c05ae49e admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:15:35.989412 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949d42a-5e40-4d58-b216-8837c05ae49e admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:15:35.993119 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386d43e-8c8c-4872-93b6-956f614ad137 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:15:35.993763 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386d43e-8c8c-4872-93b6-956f614ad137 service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:15:35.994048 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386d43e-8c8c-4872-93b6-956f614ad137 service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:15:35.994328 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386d43e-8c8c-4872-93b6-956f614ad137 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:15:36.049075 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386d43e-8c8c-4872-93b6-956f614ad137 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:15:36.051152 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386d43e-8c8c-4872-93b6-956f614ad137 service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:15:36.060196 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1065/2133] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:15:35 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:16:05.410570 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4760e4b5-5c5c-4e25-a890-32e12d185d97 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:05.412135 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-4760e4b5-5c5c-4e25-a890-32e12d185d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:05.474995 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4760e4b5-5c5c-4e25-a890-32e12d185d97 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:05.479519 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca570c-436b-48f2-8728-72f369983bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:05.480389 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca570c-436b-48f2-8728-72f369983bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:05.480775 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca570c-436b-48f2-8728-72f369983bef admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:05.481063 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca570c-436b-48f2-8728-72f369983bef admin admin] PATH_INFO: `/v3/users/1917432f35dd4da8ac85ff5e4df0c4c5` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:05.482254 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca570c-436b-48f2-8728-72f369983bef admin admin] RBAC: Authorizing `identity:delete_user(user_id=1917432f35dd4da8ac85ff5e4df0c4c5)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:05.484424 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca570c-436b-48f2-8728-72f369983bef admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:05.695207 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-10ca570c-436b-48f2-8728-72f369983bef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1917432f35dd4da8ac85ff5e4df0c4c5'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:05.695870 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-10ca570c-436b-48f2-8728-72f369983bef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1917432f35dd4da8ac85ff5e4df0c4c5'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:05.702584 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-10ca570c-436b-48f2-8728-72f369983bef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1917432f35dd4da8ac85ff5e4df0c4c5'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:05.836276 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-10ca570c-436b-48f2-8728-72f369983bef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1917432f35dd4da8ac85ff5e4df0c4c5'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:05.848707 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-10ca570c-436b-48f2-8728-72f369983bef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1917432f35dd4da8ac85ff5e4df0c4c5'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:05.854493 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1069/2134] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:16:05 2021] DELETE /identity/v3/users/1917432f35dd4da8ac85ff5e4df0c4c5 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:16:05.859296 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac86148-aa24-4085-b3aa-67e21f150ed1 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:05.859765 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac86148-aa24-4085-b3aa-67e21f150ed1 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:05.859868 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac86148-aa24-4085-b3aa-67e21f150ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:05.877331 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-2ac86148-aa24-4085-b3aa-67e21f150ed1 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:16:05.878520 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-2ac86148-aa24-4085-b3aa-67e21f150ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:05.935792 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1066/2135] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:16:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:16:05.945775 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca570c-436b-48f2-8728-72f369983bef admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:05.947177 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-10ca570c-436b-48f2-8728-72f369983bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:06.001646 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca570c-436b-48f2-8728-72f369983bef admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:06.005289 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008743c-638d-4a57-b9a4-30aa5d6010da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:06.005996 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008743c-638d-4a57-b9a4-30aa5d6010da service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:06.006280 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008743c-638d-4a57-b9a4-30aa5d6010da service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:06.006558 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008743c-638d-4a57-b9a4-30aa5d6010da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:06.015391 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008743c-638d-4a57-b9a4-30aa5d6010da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:06.016791 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008743c-638d-4a57-b9a4-30aa5d6010da service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:06.026042 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1070/2136] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:16:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:16:06.463329 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac86148-aa24-4085-b3aa-67e21f150ed1 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:06.463329 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-2ac86148-aa24-4085-b3aa-67e21f150ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:06.474137 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac86148-aa24-4085-b3aa-67e21f150ed1 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:06.480395 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f2fe9-1053-4227-9c1b-53aee4f081b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:06.481302 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f2fe9-1053-4227-9c1b-53aee4f081b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:06.481582 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f2fe9-1053-4227-9c1b-53aee4f081b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:06.482026 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f2fe9-1053-4227-9c1b-53aee4f081b5 admin admin] PATH_INFO: `/v3/projects/226da48e480b4ad0a576f5f47c3e3d00` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:06.483332 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f2fe9-1053-4227-9c1b-53aee4f081b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=226da48e480b4ad0a576f5f47c3e3d00)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:06.485285 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f2fe9-1053-4227-9c1b-53aee4f081b5 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:06.631355 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-883f2fe9-1053-4227-9c1b-53aee4f081b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '226da48e480b4ad0a576f5f47c3e3d00', 'request_id': 'req-883f2fe9-1053-4227-9c1b-53aee4f081b5'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:06.704657 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-883f2fe9-1053-4227-9c1b-53aee4f081b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '226da48e480b4ad0a576f5f47c3e3d00', 'request_id': 'req-883f2fe9-1053-4227-9c1b-53aee4f081b5'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:06.710657 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-883f2fe9-1053-4227-9c1b-53aee4f081b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '226da48e480b4ad0a576f5f47c3e3d00', 'request_id': 'req-883f2fe9-1053-4227-9c1b-53aee4f081b5'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:06.722344 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-883f2fe9-1053-4227-9c1b-53aee4f081b5 admin admin] The token cache is being invalidate because project 226da48e480b4ad0a576f5f47c3e3d00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:16:06.722650 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-883f2fe9-1053-4227-9c1b-53aee4f081b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:06.723290 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-883f2fe9-1053-4227-9c1b-53aee4f081b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:06.724912 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1067/2137] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:16:06 2021] DELETE /identity/v3/projects/226da48e480b4ad0a576f5f47c3e3d00 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:16:06.729029 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008743c-638d-4a57-b9a4-30aa5d6010da service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:06.739249 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008743c-638d-4a57-b9a4-30aa5d6010da service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:06.794995 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af957e0f-f190-4479-867a-5d0498ba914d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:06.800187 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af957e0f-f190-4479-867a-5d0498ba914d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:06.800187 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af957e0f-f190-4479-867a-5d0498ba914d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:06.800187 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af957e0f-f190-4479-867a-5d0498ba914d admin admin] PATH_INFO: `/v3/users/ee2275d368584a94a5daf1b2bb469eb6` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:06.800187 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af957e0f-f190-4479-867a-5d0498ba914d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee2275d368584a94a5daf1b2bb469eb6)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:06.800187 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af957e0f-f190-4479-867a-5d0498ba914d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:06.992296 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-af957e0f-f190-4479-867a-5d0498ba914d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee2275d368584a94a5daf1b2bb469eb6'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:06.993068 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-af957e0f-f190-4479-867a-5d0498ba914d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee2275d368584a94a5daf1b2bb469eb6'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:06.999630 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-af957e0f-f190-4479-867a-5d0498ba914d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee2275d368584a94a5daf1b2bb469eb6'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:07.082158 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-af957e0f-f190-4479-867a-5d0498ba914d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee2275d368584a94a5daf1b2bb469eb6'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:07.093958 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-af957e0f-f190-4479-867a-5d0498ba914d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee2275d368584a94a5daf1b2bb469eb6'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:07.100631 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1071/2138] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:16:06 2021] DELETE /identity/v3/users/ee2275d368584a94a5daf1b2bb469eb6 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:16:07.292098 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f2fe9-1053-4227-9c1b-53aee4f081b5 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:07.293700 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-883f2fe9-1053-4227-9c1b-53aee4f081b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:07.374529 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f2fe9-1053-4227-9c1b-53aee4f081b5 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:07.422841 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdad4f-9cfc-4561-b696-12d85b99cbad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:07.423073 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af957e0f-f190-4479-867a-5d0498ba914d admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:07.423513 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdad4f-9cfc-4561-b696-12d85b99cbad service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:07.423923 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdad4f-9cfc-4561-b696-12d85b99cbad service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:07.424207 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdad4f-9cfc-4561-b696-12d85b99cbad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:07.424951 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-af957e0f-f190-4479-867a-5d0498ba914d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:07.426049 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-d9bdad4f-9cfc-4561-b696-12d85b99cbad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:07.495834 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bdad4f-9cfc-4561-b696-12d85b99cbad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:07.508019 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bdad4f-9cfc-4561-b696-12d85b99cbad service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:07.508120 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af957e0f-f190-4479-867a-5d0498ba914d admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:07.508214 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1068/2139] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:16:07 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:16:07.508651 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdad4f-9cfc-4561-b696-12d85b99cbad service cinder] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:07.509119 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2ef1c-4fdf-4ad4-a477-2866c7123a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:07.509994 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-d9bdad4f-9cfc-4561-b696-12d85b99cbad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:07.510107 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2ef1c-4fdf-4ad4-a477-2866c7123a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:07.510466 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2ef1c-4fdf-4ad4-a477-2866c7123a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:07.510810 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2ef1c-4fdf-4ad4-a477-2866c7123a2c admin admin] PATH_INFO: `/v3/users/3ca4df8f171144d19cddde28227404b1` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:07.512188 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2ef1c-4fdf-4ad4-a477-2866c7123a2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ca4df8f171144d19cddde28227404b1)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:07.514524 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2ef1c-4fdf-4ad4-a477-2866c7123a2c admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:07.523431 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdad4f-9cfc-4561-b696-12d85b99cbad service cinder] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:07.528044 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796d5f1-20af-4dba-85bb-f0dec67140c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:07.529007 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796d5f1-20af-4dba-85bb-f0dec67140c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:07.529355 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796d5f1-20af-4dba-85bb-f0dec67140c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:07.529702 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796d5f1-20af-4dba-85bb-f0dec67140c8 admin admin] PATH_INFO: `/v3/users/a5ec7022e0cd427dbff60bcea39f7c2b` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:07.531242 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796d5f1-20af-4dba-85bb-f0dec67140c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5ec7022e0cd427dbff60bcea39f7c2b)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:07.533006 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796d5f1-20af-4dba-85bb-f0dec67140c8 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:07.683812 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-ace2ef1c-4fdf-4ad4-a477-2866c7123a2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ca4df8f171144d19cddde28227404b1'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:07.684623 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-ace2ef1c-4fdf-4ad4-a477-2866c7123a2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ca4df8f171144d19cddde28227404b1'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:07.691574 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-ace2ef1c-4fdf-4ad4-a477-2866c7123a2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ca4df8f171144d19cddde28227404b1'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:07.730254 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-f796d5f1-20af-4dba-85bb-f0dec67140c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5ec7022e0cd427dbff60bcea39f7c2b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:07.730949 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-f796d5f1-20af-4dba-85bb-f0dec67140c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5ec7022e0cd427dbff60bcea39f7c2b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:07.731641 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-f796d5f1-20af-4dba-85bb-f0dec67140c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5ec7022e0cd427dbff60bcea39f7c2b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:07.739088 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-f796d5f1-20af-4dba-85bb-f0dec67140c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5ec7022e0cd427dbff60bcea39f7c2b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:07.847907 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-ace2ef1c-4fdf-4ad4-a477-2866c7123a2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ca4df8f171144d19cddde28227404b1'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:07.860341 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-ace2ef1c-4fdf-4ad4-a477-2866c7123a2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ca4df8f171144d19cddde28227404b1'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:07.866322 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1072/2140] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:16:07 2021] DELETE /identity/v3/users/3ca4df8f171144d19cddde28227404b1 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:16:07.867102 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2ef1c-4fdf-4ad4-a477-2866c7123a2c admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:07.868414 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-ace2ef1c-4fdf-4ad4-a477-2866c7123a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:07.929477 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2ef1c-4fdf-4ad4-a477-2866c7123a2c admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:07.935814 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257db67d-efe3-4097-abf7-0548d6c4fc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:07.940849 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257db67d-efe3-4097-abf7-0548d6c4fc2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:07.940849 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257db67d-efe3-4097-abf7-0548d6c4fc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:07.940849 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257db67d-efe3-4097-abf7-0548d6c4fc2b admin admin] PATH_INFO: `/v3/projects/82682ef5e3ca4e5d98caddb6d2d49ce6` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:07.940849 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257db67d-efe3-4097-abf7-0548d6c4fc2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=82682ef5e3ca4e5d98caddb6d2d49ce6)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:07.941162 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257db67d-efe3-4097-abf7-0548d6c4fc2b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:07.962098 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-f796d5f1-20af-4dba-85bb-f0dec67140c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5ec7022e0cd427dbff60bcea39f7c2b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:07.979448 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1069/2141] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:16:07 2021] DELETE /identity/v3/users/a5ec7022e0cd427dbff60bcea39f7c2b => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:16:07.980873 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b484424-ef05-47a8-8559-c8866bae1786 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:07.986800 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b484424-ef05-47a8-8559-c8866bae1786 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:07.986800 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b484424-ef05-47a8-8559-c8866bae1786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:08.000025 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-4b484424-ef05-47a8-8559-c8866bae1786 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:16:08.001276 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-4b484424-ef05-47a8-8559-c8866bae1786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:08.047241 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-257db67d-efe3-4097-abf7-0548d6c4fc2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82682ef5e3ca4e5d98caddb6d2d49ce6', 'request_id': 'req-257db67d-efe3-4097-abf7-0548d6c4fc2b'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:08.058457 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1070/2142] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:16:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:16:08.059766 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ee87c-d407-4f7b-b005-46cbaecf324e None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:08.060059 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ee87c-d407-4f7b-b005-46cbaecf324e None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:08.060419 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ee87c-d407-4f7b-b005-46cbaecf324e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:08.077933 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-a90ee87c-d407-4f7b-b005-46cbaecf324e None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:16:08.084235 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-a90ee87c-d407-4f7b-b005-46cbaecf324e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:08.104913 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-257db67d-efe3-4097-abf7-0548d6c4fc2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82682ef5e3ca4e5d98caddb6d2d49ce6', 'request_id': 'req-257db67d-efe3-4097-abf7-0548d6c4fc2b'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:08.111303 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-257db67d-efe3-4097-abf7-0548d6c4fc2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82682ef5e3ca4e5d98caddb6d2d49ce6', 'request_id': 'req-257db67d-efe3-4097-abf7-0548d6c4fc2b'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:08.122839 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-257db67d-efe3-4097-abf7-0548d6c4fc2b admin admin] The token cache is being invalidate because project 82682ef5e3ca4e5d98caddb6d2d49ce6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:16:08.123117 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-257db67d-efe3-4097-abf7-0548d6c4fc2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:08.123787 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-257db67d-efe3-4097-abf7-0548d6c4fc2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:08.125364 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1073/2143] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:16:07 2021] DELETE /identity/v3/projects/82682ef5e3ca4e5d98caddb6d2d49ce6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:16:08.126130 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257db67d-efe3-4097-abf7-0548d6c4fc2b admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:08.127532 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-257db67d-efe3-4097-abf7-0548d6c4fc2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:08.137928 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1071/2144] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:16:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:16:08.139230 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8aee6-a364-43a3-847e-1c87f9d4938e None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:08.139654 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8aee6-a364-43a3-847e-1c87f9d4938e None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:08.139944 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8aee6-a364-43a3-847e-1c87f9d4938e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:08.167546 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-b2d8aee6-a364-43a3-847e-1c87f9d4938e None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:16:08.168782 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-b2d8aee6-a364-43a3-847e-1c87f9d4938e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:08.177376 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1072/2145] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:16:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:16:08.178155 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8aee6-a364-43a3-847e-1c87f9d4938e None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:08.184701 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257db67d-efe3-4097-abf7-0548d6c4fc2b admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:08.188883 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb989a-b1eb-476e-b6d6-9ad1034b2bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:08.189540 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb989a-b1eb-476e-b6d6-9ad1034b2bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:08.189821 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb989a-b1eb-476e-b6d6-9ad1034b2bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:08.190262 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb989a-b1eb-476e-b6d6-9ad1034b2bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:08.192071 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-75cb989a-b1eb-476e-b6d6-9ad1034b2bb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:08.194133 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8aee6-a364-43a3-847e-1c87f9d4938e None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:08.198139 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e4462-e867-45af-8967-a5c935fdd7ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:08.198925 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e4462-e867-45af-8967-a5c935fdd7ac service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:08.199126 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e4462-e867-45af-8967-a5c935fdd7ac service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:08.199460 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e4462-e867-45af-8967-a5c935fdd7ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:08.210529 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb989a-b1eb-476e-b6d6-9ad1034b2bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:08.210529 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb989a-b1eb-476e-b6d6-9ad1034b2bb4 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:08.210731 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e4462-e867-45af-8967-a5c935fdd7ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:08.212228 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e4462-e867-45af-8967-a5c935fdd7ac service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:08.216369 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1074/2146] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:16:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:16:08.222487 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65c8db-e442-452b-a892-f02bcdf88a73 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:08.222897 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65c8db-e442-452b-a892-f02bcdf88a73 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:08.224018 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65c8db-e442-452b-a892-f02bcdf88a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:08.224149 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1073/2147] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:16:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:16:08.247031 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-1f65c8db-e442-452b-a892-f02bcdf88a73 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:16:08.252661 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-1f65c8db-e442-452b-a892-f02bcdf88a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:08.264407 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1075/2148] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:16:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:16:08.264531 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e4462-e867-45af-8967-a5c935fdd7ac service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:08.272115 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e4462-e867-45af-8967-a5c935fdd7ac service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:08.277111 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b63c38-a45b-4262-aa41-2e8fd6f58415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:08.277771 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b63c38-a45b-4262-aa41-2e8fd6f58415 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:08.278056 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b63c38-a45b-4262-aa41-2e8fd6f58415 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:08.278333 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b63c38-a45b-4262-aa41-2e8fd6f58415 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:08.279061 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b63c38-a45b-4262-aa41-2e8fd6f58415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:16:08.279391 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b63c38-a45b-4262-aa41-2e8fd6f58415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:08.281300 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b63c38-a45b-4262-aa41-2e8fd6f58415 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:08.295627 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1074/2149] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:16:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 03:16:08.302428 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65c8db-e442-452b-a892-f02bcdf88a73 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:08.312422 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65c8db-e442-452b-a892-f02bcdf88a73 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:08.317681 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947fa26-0ae9-4a0a-ae7a-a8915d41d545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:08.318572 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947fa26-0ae9-4a0a-ae7a-a8915d41d545 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:08.318784 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947fa26-0ae9-4a0a-ae7a-a8915d41d545 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:08.319068 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947fa26-0ae9-4a0a-ae7a-a8915d41d545 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:08.319772 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947fa26-0ae9-4a0a-ae7a-a8915d41d545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:08.321867 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947fa26-0ae9-4a0a-ae7a-a8915d41d545 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:08.466071 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1076/2150] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:16:08 2021] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:16:08.470062 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b63c38-a45b-4262-aa41-2e8fd6f58415 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:08.480824 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b63c38-a45b-4262-aa41-2e8fd6f58415 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:08.544520 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5d83f-0171-48b6-8e43-f15ce90a84f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:08.545257 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5d83f-0171-48b6-8e43-f15ce90a84f0 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:08.550768 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5d83f-0171-48b6-8e43-f15ce90a84f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:08.550768 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5d83f-0171-48b6-8e43-f15ce90a84f0 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:08.550768 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5d83f-0171-48b6-8e43-f15ce90a84f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:08.550768 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5d83f-0171-48b6-8e43-f15ce90a84f0 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:08.631177 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1075/2151] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:16:08 2021] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:16:08.635349 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947fa26-0ae9-4a0a-ae7a-a8915d41d545 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:08.645661 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947fa26-0ae9-4a0a-ae7a-a8915d41d545 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:08.650608 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028ae21-8c04-4671-a43c-845d25518e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:08.651275 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028ae21-8c04-4671-a43c-845d25518e75 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:08.651550 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028ae21-8c04-4671-a43c-845d25518e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:08.651819 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028ae21-8c04-4671-a43c-845d25518e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:08.652578 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028ae21-8c04-4671-a43c-845d25518e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:08.654179 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028ae21-8c04-4671-a43c-845d25518e75 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:08.664660 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1077/2152] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:16:08 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:16:08.668242 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5d83f-0171-48b6-8e43-f15ce90a84f0 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:08.678853 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5d83f-0171-48b6-8e43-f15ce90a84f0 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:08.683692 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5086c6-986c-46c3-a136-37fafe7fe8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:08.684360 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5086c6-986c-46c3-a136-37fafe7fe8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:08.684690 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5086c6-986c-46c3-a136-37fafe7fe8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:08.684972 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5086c6-986c-46c3-a136-37fafe7fe8d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:08.685699 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5086c6-986c-46c3-a136-37fafe7fe8d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:08.687298 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5086c6-986c-46c3-a136-37fafe7fe8d7 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:08.697755 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1076/2153] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:16:08 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:16:08.701947 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028ae21-8c04-4671-a43c-845d25518e75 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:08.711628 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028ae21-8c04-4671-a43c-845d25518e75 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:08.716888 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba50f67-7347-4b54-843f-a70e8d453934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:08.717112 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba50f67-7347-4b54-843f-a70e8d453934 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:08.717396 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba50f67-7347-4b54-843f-a70e8d453934 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:08.717669 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba50f67-7347-4b54-843f-a70e8d453934 admin admin] PATH_INFO: `/v3/projects/d8f9c5cdaba14c5fa100855163c373b2/users/779ffac97a8b472087211baf89019a3d/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:08.731425 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba50f67-7347-4b54-843f-a70e8d453934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f9c5cdaba14c5fa100855163c373b2, user_id=779ffac97a8b472087211baf89019a3d, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:08.734842 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba50f67-7347-4b54-843f-a70e8d453934 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:08.747721 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5086c6-986c-46c3-a136-37fafe7fe8d7 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:08.755513 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-1c5086c6-986c-46c3-a136-37fafe7fe8d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:08.776110 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5086c6-986c-46c3-a136-37fafe7fe8d7 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:08.781049 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947dcfff-4758-4638-84af-6d9d9b43651d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:08.781908 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dcfff-4758-4638-84af-6d9d9b43651d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:08.782188 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dcfff-4758-4638-84af-6d9d9b43651d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:08.782462 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dcfff-4758-4638-84af-6d9d9b43651d admin admin] PATH_INFO: `/v3/projects/9a6b0205c6ec43968349bf8d34e40a58` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:08.783718 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947dcfff-4758-4638-84af-6d9d9b43651d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a6b0205c6ec43968349bf8d34e40a58)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:08.786198 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947dcfff-4758-4638-84af-6d9d9b43651d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:08.792531 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1078/2154] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:16:08 2021] PUT /identity/v3/projects/d8f9c5cdaba14c5fa100855163c373b2/users/779ffac97a8b472087211baf89019a3d/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:16:08.803149 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda5a8c-df44-47f5-a184-2d8d247c9f55 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:08.803352 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda5a8c-df44-47f5-a184-2d8d247c9f55 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:08.803605 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda5a8c-df44-47f5-a184-2d8d247c9f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:08.830409 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-3eda5a8c-df44-47f5-a184-2d8d247c9f55 None None] MFA Rules not processed for user `779ffac97a8b472087211baf89019a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:16:08.832138 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-3eda5a8c-df44-47f5-a184-2d8d247c9f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:08.894726 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1079/2155] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:16:08 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:16:08.899184 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda5a8c-df44-47f5-a184-2d8d247c9f55 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:08.927123 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-947dcfff-4758-4638-84af-6d9d9b43651d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a6b0205c6ec43968349bf8d34e40a58', 'request_id': 'req-947dcfff-4758-4638-84af-6d9d9b43651d'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:08.958739 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda5a8c-df44-47f5-a184-2d8d247c9f55 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:08.979477 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-947dcfff-4758-4638-84af-6d9d9b43651d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a6b0205c6ec43968349bf8d34e40a58', 'request_id': 'req-947dcfff-4758-4638-84af-6d9d9b43651d'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:08.987792 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-947dcfff-4758-4638-84af-6d9d9b43651d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a6b0205c6ec43968349bf8d34e40a58', 'request_id': 'req-947dcfff-4758-4638-84af-6d9d9b43651d'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:09.004075 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-947dcfff-4758-4638-84af-6d9d9b43651d admin admin] The token cache is being invalidate because project 9a6b0205c6ec43968349bf8d34e40a58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:16:09.004360 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-947dcfff-4758-4638-84af-6d9d9b43651d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:09.005114 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-947dcfff-4758-4638-84af-6d9d9b43651d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:09.006901 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1077/2156] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:16:08 2021] DELETE /identity/v3/projects/9a6b0205c6ec43968349bf8d34e40a58 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:16:09.031836 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c491a8c-d4a1-4dd1-8c38-66de68eb8d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:09.032693 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c491a8c-d4a1-4dd1-8c38-66de68eb8d0d admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:09.033150 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c491a8c-d4a1-4dd1-8c38-66de68eb8d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:09.033474 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c491a8c-d4a1-4dd1-8c38-66de68eb8d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:09.034890 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c491a8c-d4a1-4dd1-8c38-66de68eb8d0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:09.038065 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c491a8c-d4a1-4dd1-8c38-66de68eb8d0d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:09.136194 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1080/2157] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:16:08 2021] POST /identity/v3/projects => generated 379 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:16:09.136893 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947dcfff-4758-4638-84af-6d9d9b43651d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:09.138474 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-947dcfff-4758-4638-84af-6d9d9b43651d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:09.152512 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947dcfff-4758-4638-84af-6d9d9b43651d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:09.208682 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313da19-b6bd-4605-9f0c-c95d19c17a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:09.209369 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313da19-b6bd-4605-9f0c-c95d19c17a95 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:09.209654 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313da19-b6bd-4605-9f0c-c95d19c17a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:09.209938 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313da19-b6bd-4605-9f0c-c95d19c17a95 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:09.210641 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313da19-b6bd-4605-9f0c-c95d19c17a95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:09.212579 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313da19-b6bd-4605-9f0c-c95d19c17a95 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:09.226216 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c491a8c-d4a1-4dd1-8c38-66de68eb8d0d admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:09.227973 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-0c491a8c-d4a1-4dd1-8c38-66de68eb8d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:09.243176 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c491a8c-d4a1-4dd1-8c38-66de68eb8d0d admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:09.249015 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41345d49-687e-4eb5-98a7-4a1e6d468a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:09.249879 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41345d49-687e-4eb5-98a7-4a1e6d468a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:09.250159 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41345d49-687e-4eb5-98a7-4a1e6d468a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:09.250509 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41345d49-687e-4eb5-98a7-4a1e6d468a51 admin admin] PATH_INFO: `/v3/projects/61af156aaae545c4a94a96dbbe8ebd16` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:09.251621 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41345d49-687e-4eb5-98a7-4a1e6d468a51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61af156aaae545c4a94a96dbbe8ebd16)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:09.254165 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41345d49-687e-4eb5-98a7-4a1e6d468a51 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:09.322669 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1078/2158] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:16:09 2021] POST /identity/v3/users => generated 296 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:16:09.326431 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313da19-b6bd-4605-9f0c-c95d19c17a95 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:09.335995 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313da19-b6bd-4605-9f0c-c95d19c17a95 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:09.346784 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b4c61-0d55-487b-bdb9-ec6d4fad0fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:09.347463 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b4c61-0d55-487b-bdb9-ec6d4fad0fdc admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:09.347748 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b4c61-0d55-487b-bdb9-ec6d4fad0fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:09.348027 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b4c61-0d55-487b-bdb9-ec6d4fad0fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:09.348841 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b4c61-0d55-487b-bdb9-ec6d4fad0fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:09.350436 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b4c61-0d55-487b-bdb9-ec6d4fad0fdc admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:09.356401 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-41345d49-687e-4eb5-98a7-4a1e6d468a51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61af156aaae545c4a94a96dbbe8ebd16', 'request_id': 'req-41345d49-687e-4eb5-98a7-4a1e6d468a51'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:09.360973 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1079/2159] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:16:09 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:16:09.365334 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b4c61-0d55-487b-bdb9-ec6d4fad0fdc admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:09.374571 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b4c61-0d55-487b-bdb9-ec6d4fad0fdc admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:09.425025 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-41345d49-687e-4eb5-98a7-4a1e6d468a51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61af156aaae545c4a94a96dbbe8ebd16', 'request_id': 'req-41345d49-687e-4eb5-98a7-4a1e6d468a51'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:09.428253 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbb758-6f37-45ce-b4f9-95df0d62adec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:09.429167 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbb758-6f37-45ce-b4f9-95df0d62adec admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:09.429452 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbb758-6f37-45ce-b4f9-95df0d62adec admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:09.429729 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbb758-6f37-45ce-b4f9-95df0d62adec admin admin] PATH_INFO: `/v3/projects/9fdbf929cdad466e9bb56747c1caf7d8/users/2a0e2f38de0a4e0a911de51b0a91a896/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:09.431039 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-41345d49-687e-4eb5-98a7-4a1e6d468a51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61af156aaae545c4a94a96dbbe8ebd16', 'request_id': 'req-41345d49-687e-4eb5-98a7-4a1e6d468a51'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:09.444019 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbb758-6f37-45ce-b4f9-95df0d62adec admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fdbf929cdad466e9bb56747c1caf7d8, user_id=2a0e2f38de0a4e0a911de51b0a91a896, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:09.444332 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-41345d49-687e-4eb5-98a7-4a1e6d468a51 admin admin] The token cache is being invalidate because project 61af156aaae545c4a94a96dbbe8ebd16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:16:09.444692 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-41345d49-687e-4eb5-98a7-4a1e6d468a51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:09.445327 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-41345d49-687e-4eb5-98a7-4a1e6d468a51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:09.446688 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbb758-6f37-45ce-b4f9-95df0d62adec admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:09.446883 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1081/2160] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:16:09 2021] DELETE /identity/v3/projects/61af156aaae545c4a94a96dbbe8ebd16 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:16:09.534312 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1080/2161] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:16:09 2021] PUT /identity/v3/projects/9fdbf929cdad466e9bb56747c1caf7d8/users/2a0e2f38de0a4e0a911de51b0a91a896/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:16:09.538920 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41345d49-687e-4eb5-98a7-4a1e6d468a51 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:09.540632 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-41345d49-687e-4eb5-98a7-4a1e6d468a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:09.555434 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41345d49-687e-4eb5-98a7-4a1e6d468a51 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:09.616833 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b6f51-5f9f-4884-a524-4aebab639af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:09.617511 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b6f51-5f9f-4884-a524-4aebab639af2 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:09.617788 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b6f51-5f9f-4884-a524-4aebab639af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:09.618061 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b6f51-5f9f-4884-a524-4aebab639af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:09.618783 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b6f51-5f9f-4884-a524-4aebab639af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:09.620352 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b6f51-5f9f-4884-a524-4aebab639af2 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:09.630341 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1082/2162] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:16:09 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:16:09.634599 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbb758-6f37-45ce-b4f9-95df0d62adec admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:09.644780 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbb758-6f37-45ce-b4f9-95df0d62adec admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:09.649404 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b853f-109d-4dff-9d6d-abacd9ace696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:09.650280 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b853f-109d-4dff-9d6d-abacd9ace696 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:09.650566 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b853f-109d-4dff-9d6d-abacd9ace696 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:09.650872 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b853f-109d-4dff-9d6d-abacd9ace696 admin admin] PATH_INFO: `/v3/projects/9fdbf929cdad466e9bb56747c1caf7d8/users/2a0e2f38de0a4e0a911de51b0a91a896/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:09.652903 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b853f-109d-4dff-9d6d-abacd9ace696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fdbf929cdad466e9bb56747c1caf7d8, user_id=2a0e2f38de0a4e0a911de51b0a91a896, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:09.655504 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b853f-109d-4dff-9d6d-abacd9ace696 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:09.666246 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1081/2163] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:16:09 2021] PUT /identity/v3/projects/9fdbf929cdad466e9bb56747c1caf7d8/users/2a0e2f38de0a4e0a911de51b0a91a896/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:16:09.677001 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283af88-1232-49ae-aa5d-bd4d463545f4 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:09.677373 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283af88-1232-49ae-aa5d-bd4d463545f4 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:09.677649 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283af88-1232-49ae-aa5d-bd4d463545f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:09.702794 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-9283af88-1232-49ae-aa5d-bd4d463545f4 None None] MFA Rules not processed for user `2a0e2f38de0a4e0a911de51b0a91a896`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:16:09.704014 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-9283af88-1232-49ae-aa5d-bd4d463545f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:09.769094 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1083/2164] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:16:09 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:16:09.778917 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b853f-109d-4dff-9d6d-abacd9ace696 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:09.780729 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-d55b853f-109d-4dff-9d6d-abacd9ace696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:09.854715 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b853f-109d-4dff-9d6d-abacd9ace696 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:09.858719 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85366f2-ca05-4a1d-b611-945965dba34e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:09.859404 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85366f2-ca05-4a1d-b611-945965dba34e service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:09.859686 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85366f2-ca05-4a1d-b611-945965dba34e service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:09.859966 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85366f2-ca05-4a1d-b611-945965dba34e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:09.869943 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85366f2-ca05-4a1d-b611-945965dba34e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:09.871431 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85366f2-ca05-4a1d-b611-945965dba34e service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:09.880849 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1082/2165] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:16:09 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:16:10.432470 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283af88-1232-49ae-aa5d-bd4d463545f4 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:10.500667 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283af88-1232-49ae-aa5d-bd4d463545f4 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:10.505281 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67053de-ab64-46dd-b9b8-1d818824a58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:10.506149 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67053de-ab64-46dd-b9b8-1d818824a58a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:10.506434 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67053de-ab64-46dd-b9b8-1d818824a58a admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:10.506713 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67053de-ab64-46dd-b9b8-1d818824a58a admin admin] PATH_INFO: `/v3/users/779ffac97a8b472087211baf89019a3d` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:10.507898 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67053de-ab64-46dd-b9b8-1d818824a58a admin admin] RBAC: Authorizing `identity:delete_user(user_id=779ffac97a8b472087211baf89019a3d)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:10.509832 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67053de-ab64-46dd-b9b8-1d818824a58a admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:10.706698 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d67053de-ab64-46dd-b9b8-1d818824a58a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '779ffac97a8b472087211baf89019a3d'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:10.707352 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d67053de-ab64-46dd-b9b8-1d818824a58a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '779ffac97a8b472087211baf89019a3d'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:10.713870 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d67053de-ab64-46dd-b9b8-1d818824a58a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '779ffac97a8b472087211baf89019a3d'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:10.822731 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d67053de-ab64-46dd-b9b8-1d818824a58a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '779ffac97a8b472087211baf89019a3d'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:10.838261 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d67053de-ab64-46dd-b9b8-1d818824a58a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '779ffac97a8b472087211baf89019a3d'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:10.844381 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1084/2166] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:16:10 2021] DELETE /identity/v3/users/779ffac97a8b472087211baf89019a3d => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:16:10.850839 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e875532-8d15-4328-884f-0852beec1f3d None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:10.851336 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e875532-8d15-4328-884f-0852beec1f3d None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:10.851429 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e875532-8d15-4328-884f-0852beec1f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:10.872541 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-5e875532-8d15-4328-884f-0852beec1f3d None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:16:10.874001 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-5e875532-8d15-4328-884f-0852beec1f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:10.932850 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1083/2167] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:16:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:16:10.942997 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67053de-ab64-46dd-b9b8-1d818824a58a admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:10.944672 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-d67053de-ab64-46dd-b9b8-1d818824a58a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:11.003946 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67053de-ab64-46dd-b9b8-1d818824a58a admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:11.007763 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf2a1a-bfb9-4f4a-b92f-3d1da81d17f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:11.008426 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf2a1a-bfb9-4f4a-b92f-3d1da81d17f7 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:11.008780 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf2a1a-bfb9-4f4a-b92f-3d1da81d17f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:11.009063 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf2a1a-bfb9-4f4a-b92f-3d1da81d17f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:11.018865 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf2a1a-bfb9-4f4a-b92f-3d1da81d17f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:11.020306 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf2a1a-bfb9-4f4a-b92f-3d1da81d17f7 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:11.029984 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1085/2168] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:16:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:16:11.533928 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e875532-8d15-4328-884f-0852beec1f3d None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:11.536001 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-5e875532-8d15-4328-884f-0852beec1f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:11.547767 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e875532-8d15-4328-884f-0852beec1f3d None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:11.552846 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc65c8-c74f-4857-8095-fbfdad7faaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:11.553274 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc65c8-c74f-4857-8095-fbfdad7faaa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:11.553556 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc65c8-c74f-4857-8095-fbfdad7faaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:11.553835 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc65c8-c74f-4857-8095-fbfdad7faaa0 admin admin] PATH_INFO: `/v3/projects/d8f9c5cdaba14c5fa100855163c373b2` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:11.555032 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc65c8-c74f-4857-8095-fbfdad7faaa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8f9c5cdaba14c5fa100855163c373b2)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:11.557010 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc65c8-c74f-4857-8095-fbfdad7faaa0 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:11.734098 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-7fdc65c8-c74f-4857-8095-fbfdad7faaa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8f9c5cdaba14c5fa100855163c373b2', 'request_id': 'req-7fdc65c8-c74f-4857-8095-fbfdad7faaa0'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:11.813933 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-7fdc65c8-c74f-4857-8095-fbfdad7faaa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8f9c5cdaba14c5fa100855163c373b2', 'request_id': 'req-7fdc65c8-c74f-4857-8095-fbfdad7faaa0'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:11.824858 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-7fdc65c8-c74f-4857-8095-fbfdad7faaa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8f9c5cdaba14c5fa100855163c373b2', 'request_id': 'req-7fdc65c8-c74f-4857-8095-fbfdad7faaa0'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:11.839281 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-7fdc65c8-c74f-4857-8095-fbfdad7faaa0 admin admin] The token cache is being invalidate because project d8f9c5cdaba14c5fa100855163c373b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:16:11.839576 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-7fdc65c8-c74f-4857-8095-fbfdad7faaa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:11.840273 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-7fdc65c8-c74f-4857-8095-fbfdad7faaa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:11.841859 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1084/2169] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:16:11 2021] DELETE /identity/v3/projects/d8f9c5cdaba14c5fa100855163c373b2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:16:11.845831 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf2a1a-bfb9-4f4a-b92f-3d1da81d17f7 service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:11.856528 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf2a1a-bfb9-4f4a-b92f-3d1da81d17f7 service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:11.913263 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30464d4c-83c0-449b-85da-c56fd70030cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:11.914318 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30464d4c-83c0-449b-85da-c56fd70030cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:11.916130 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30464d4c-83c0-449b-85da-c56fd70030cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:11.916130 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30464d4c-83c0-449b-85da-c56fd70030cd admin admin] PATH_INFO: `/v3/users/2a0e2f38de0a4e0a911de51b0a91a896` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:11.916130 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30464d4c-83c0-449b-85da-c56fd70030cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a0e2f38de0a4e0a911de51b0a91a896)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:11.918029 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30464d4c-83c0-449b-85da-c56fd70030cd admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:12.158778 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-30464d4c-83c0-449b-85da-c56fd70030cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a0e2f38de0a4e0a911de51b0a91a896'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:12.159413 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-30464d4c-83c0-449b-85da-c56fd70030cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a0e2f38de0a4e0a911de51b0a91a896'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:12.166796 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-30464d4c-83c0-449b-85da-c56fd70030cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a0e2f38de0a4e0a911de51b0a91a896'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:12.258859 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-30464d4c-83c0-449b-85da-c56fd70030cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a0e2f38de0a4e0a911de51b0a91a896'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:12.270485 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-30464d4c-83c0-449b-85da-c56fd70030cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a0e2f38de0a4e0a911de51b0a91a896'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:12.276194 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1086/2170] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:16:11 2021] DELETE /identity/v3/users/2a0e2f38de0a4e0a911de51b0a91a896 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:16:12.826400 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc65c8-c74f-4857-8095-fbfdad7faaa0 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:12.827871 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-7fdc65c8-c74f-4857-8095-fbfdad7faaa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:12.842250 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc65c8-c74f-4857-8095-fbfdad7faaa0 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:12.903535 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065a518-51de-4863-9312-4dbf50f08f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:12.904403 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065a518-51de-4863-9312-4dbf50f08f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:12.904712 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065a518-51de-4863-9312-4dbf50f08f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:12.904988 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065a518-51de-4863-9312-4dbf50f08f5f admin admin] PATH_INFO: `/v3/projects/9fdbf929cdad466e9bb56747c1caf7d8` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:12.906168 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065a518-51de-4863-9312-4dbf50f08f5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fdbf929cdad466e9bb56747c1caf7d8)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:12.908092 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065a518-51de-4863-9312-4dbf50f08f5f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:13.051069 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-3065a518-51de-4863-9312-4dbf50f08f5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fdbf929cdad466e9bb56747c1caf7d8', 'request_id': 'req-3065a518-51de-4863-9312-4dbf50f08f5f'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:13.138975 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-3065a518-51de-4863-9312-4dbf50f08f5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fdbf929cdad466e9bb56747c1caf7d8', 'request_id': 'req-3065a518-51de-4863-9312-4dbf50f08f5f'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:13.144727 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-3065a518-51de-4863-9312-4dbf50f08f5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fdbf929cdad466e9bb56747c1caf7d8', 'request_id': 'req-3065a518-51de-4863-9312-4dbf50f08f5f'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:13.155689 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-3065a518-51de-4863-9312-4dbf50f08f5f admin admin] The token cache is being invalidate because project 9fdbf929cdad466e9bb56747c1caf7d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:16:13.155971 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-3065a518-51de-4863-9312-4dbf50f08f5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:13.156625 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-3065a518-51de-4863-9312-4dbf50f08f5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:13.158154 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1085/2171] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:16:12 2021] DELETE /identity/v3/projects/9fdbf929cdad466e9bb56747c1caf7d8 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:16:13.164123 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9002d-4963-4266-8cbf-0eece9ca9886 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:13.164592 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9002d-4963-4266-8cbf-0eece9ca9886 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:13.164714 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9002d-4963-4266-8cbf-0eece9ca9886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:13.182650 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-e0d9002d-4963-4266-8cbf-0eece9ca9886 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:16:13.183838 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-e0d9002d-4963-4266-8cbf-0eece9ca9886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:13.239568 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1087/2172] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:16:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:16:13.247114 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f27e55-e5b5-4d40-bd52-3dc4e84cecd0 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:13.247406 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f27e55-e5b5-4d40-bd52-3dc4e84cecd0 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:13.247690 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f27e55-e5b5-4d40-bd52-3dc4e84cecd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:13.266242 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-a7f27e55-e5b5-4d40-bd52-3dc4e84cecd0 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:16:13.267428 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-a7f27e55-e5b5-4d40-bd52-3dc4e84cecd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:13.275164 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1086/2173] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:16:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:16:13.279321 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9002d-4963-4266-8cbf-0eece9ca9886 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:13.288936 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9002d-4963-4266-8cbf-0eece9ca9886 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:13.293506 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ff850-e896-41bc-aa5d-2cac4718d3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:13.294159 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ff850-e896-41bc-aa5d-2cac4718d3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:13.294443 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ff850-e896-41bc-aa5d-2cac4718d3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:13.294721 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ff850-e896-41bc-aa5d-2cac4718d3c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:13.295445 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ff850-e896-41bc-aa5d-2cac4718d3c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:16:13.295756 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ff850-e896-41bc-aa5d-2cac4718d3c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:13.297375 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ff850-e896-41bc-aa5d-2cac4718d3c9 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:13.308974 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1088/2174] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:16:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 03:16:13.313160 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f27e55-e5b5-4d40-bd52-3dc4e84cecd0 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:13.322676 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f27e55-e5b5-4d40-bd52-3dc4e84cecd0 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:13.327361 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44298e2d-df90-45c7-af66-ea2472827235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:13.328087 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44298e2d-df90-45c7-af66-ea2472827235 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:13.328380 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44298e2d-df90-45c7-af66-ea2472827235 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:13.328698 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44298e2d-df90-45c7-af66-ea2472827235 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:13.329399 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44298e2d-df90-45c7-af66-ea2472827235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:13.331385 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44298e2d-df90-45c7-af66-ea2472827235 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:13.420505 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1087/2175] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:16:13 2021] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:16:13.428475 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ff850-e896-41bc-aa5d-2cac4718d3c9 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:13.438214 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ff850-e896-41bc-aa5d-2cac4718d3c9 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:13.492709 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106eeec-8db3-4dfc-b6e0-73de4a1c623c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:13.493388 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106eeec-8db3-4dfc-b6e0-73de4a1c623c admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:13.493667 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106eeec-8db3-4dfc-b6e0-73de4a1c623c admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:13.493944 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106eeec-8db3-4dfc-b6e0-73de4a1c623c admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:13.494625 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106eeec-8db3-4dfc-b6e0-73de4a1c623c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:13.496535 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106eeec-8db3-4dfc-b6e0-73de4a1c623c admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:13.642164 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1089/2176] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:16:13 2021] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:16:13.646101 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44298e2d-df90-45c7-af66-ea2472827235 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:13.657679 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44298e2d-df90-45c7-af66-ea2472827235 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:13.662917 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559409da-b9f7-4366-a22e-66f5fe8a5cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:13.663627 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559409da-b9f7-4366-a22e-66f5fe8a5cee admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:13.663912 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559409da-b9f7-4366-a22e-66f5fe8a5cee admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:13.664191 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559409da-b9f7-4366-a22e-66f5fe8a5cee admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:13.664958 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559409da-b9f7-4366-a22e-66f5fe8a5cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:13.666546 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559409da-b9f7-4366-a22e-66f5fe8a5cee admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:13.680401 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1088/2177] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:16:13 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:16:13.681935 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106eeec-8db3-4dfc-b6e0-73de4a1c623c admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:13.693002 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106eeec-8db3-4dfc-b6e0-73de4a1c623c admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:13.698163 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39ffa7-f8f0-42bd-8e42-1c81b98f7a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:13.698841 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39ffa7-f8f0-42bd-8e42-1c81b98f7a52 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:13.699159 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39ffa7-f8f0-42bd-8e42-1c81b98f7a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:13.699440 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39ffa7-f8f0-42bd-8e42-1c81b98f7a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:13.700232 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b39ffa7-f8f0-42bd-8e42-1c81b98f7a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:13.702070 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b39ffa7-f8f0-42bd-8e42-1c81b98f7a52 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:13.713537 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1090/2178] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:16:13 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:16:13.722026 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559409da-b9f7-4366-a22e-66f5fe8a5cee admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:13.731762 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559409da-b9f7-4366-a22e-66f5fe8a5cee admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:13.736463 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77b6e8-a834-4019-9e26-3dda0980088d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:13.737996 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77b6e8-a834-4019-9e26-3dda0980088d admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:13.738274 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77b6e8-a834-4019-9e26-3dda0980088d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:13.738547 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77b6e8-a834-4019-9e26-3dda0980088d admin admin] PATH_INFO: `/v3/projects/4cbf488feff74538a486b68c991c943c/users/f66c7a1ed35943fa819f481894d1fb5e/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:13.754203 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77b6e8-a834-4019-9e26-3dda0980088d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cbf488feff74538a486b68c991c943c, user_id=f66c7a1ed35943fa819f481894d1fb5e, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:13.756862 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77b6e8-a834-4019-9e26-3dda0980088d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:13.876192 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1089/2179] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:16:13 2021] PUT /identity/v3/projects/4cbf488feff74538a486b68c991c943c/users/f66c7a1ed35943fa819f481894d1fb5e/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:16:13.881331 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866d6ce-66d9-4e7e-9e68-0a8cf372aa0d None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:13.881607 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866d6ce-66d9-4e7e-9e68-0a8cf372aa0d None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:13.881891 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866d6ce-66d9-4e7e-9e68-0a8cf372aa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:13.907634 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-5866d6ce-66d9-4e7e-9e68-0a8cf372aa0d None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:16:13.907634 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-5866d6ce-66d9-4e7e-9e68-0a8cf372aa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:13.956516 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1091/2180] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:16:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:16:13.966338 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77b6e8-a834-4019-9e26-3dda0980088d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:13.968020 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-6d77b6e8-a834-4019-9e26-3dda0980088d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:14.022652 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77b6e8-a834-4019-9e26-3dda0980088d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:14.026458 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b34b7-0c6f-4c47-bb8f-d0d833b54ccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:14.027148 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b34b7-0c6f-4c47-bb8f-d0d833b54ccc service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:14.027429 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b34b7-0c6f-4c47-bb8f-d0d833b54ccc service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:14.027708 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b34b7-0c6f-4c47-bb8f-d0d833b54ccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:14.038115 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b34b7-0c6f-4c47-bb8f-d0d833b54ccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:14.042972 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b34b7-0c6f-4c47-bb8f-d0d833b54ccc service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:14.048897 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1090/2181] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:16:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:16:14.728185 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866d6ce-66d9-4e7e-9e68-0a8cf372aa0d None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:14.729631 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-5866d6ce-66d9-4e7e-9e68-0a8cf372aa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:14.742185 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866d6ce-66d9-4e7e-9e68-0a8cf372aa0d None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:14.746979 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5222fd-09cb-45fd-8794-940b842f00a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:14.747916 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5222fd-09cb-45fd-8794-940b842f00a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:14.748201 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5222fd-09cb-45fd-8794-940b842f00a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:14.748475 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5222fd-09cb-45fd-8794-940b842f00a3 admin admin] PATH_INFO: `/v3/users/2a06c70266b54b029e4e124874ac8e54` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:14.749699 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5222fd-09cb-45fd-8794-940b842f00a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a06c70266b54b029e4e124874ac8e54)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:14.751664 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5222fd-09cb-45fd-8794-940b842f00a3 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:14.964193 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1b5222fd-09cb-45fd-8794-940b842f00a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a06c70266b54b029e4e124874ac8e54'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:14.964887 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1b5222fd-09cb-45fd-8794-940b842f00a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a06c70266b54b029e4e124874ac8e54'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:14.972685 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1b5222fd-09cb-45fd-8794-940b842f00a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a06c70266b54b029e4e124874ac8e54'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:15.047777 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1b5222fd-09cb-45fd-8794-940b842f00a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a06c70266b54b029e4e124874ac8e54'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:15.061156 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1b5222fd-09cb-45fd-8794-940b842f00a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a06c70266b54b029e4e124874ac8e54'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:15.067342 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1092/2182] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:16:14 2021] DELETE /identity/v3/users/2a06c70266b54b029e4e124874ac8e54 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:16:15.071856 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bc468-8322-4c23-9005-804a0e264afd None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:15.073892 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bc468-8322-4c23-9005-804a0e264afd None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:15.073892 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bc468-8322-4c23-9005-804a0e264afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:15.090025 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-7e9bc468-8322-4c23-9005-804a0e264afd None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:16:15.091361 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-7e9bc468-8322-4c23-9005-804a0e264afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:15.150386 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1091/2183] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:16:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:16:15.160893 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5222fd-09cb-45fd-8794-940b842f00a3 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:15.162431 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-1b5222fd-09cb-45fd-8794-940b842f00a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:15.218000 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5222fd-09cb-45fd-8794-940b842f00a3 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:15.221679 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e2d2c-dbfa-4bc4-8672-82030f710c41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:15.222324 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e2d2c-dbfa-4bc4-8672-82030f710c41 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:15.222603 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e2d2c-dbfa-4bc4-8672-82030f710c41 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:15.222873 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e2d2c-dbfa-4bc4-8672-82030f710c41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:15.231862 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e2d2c-dbfa-4bc4-8672-82030f710c41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:15.233647 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e2d2c-dbfa-4bc4-8672-82030f710c41 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:15.243632 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1093/2184] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:16:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:16:15.590049 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725c96e-5dfd-4221-85a4-1a2821be8802 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:15.590351 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725c96e-5dfd-4221-85a4-1a2821be8802 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:15.590636 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725c96e-5dfd-4221-85a4-1a2821be8802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:15.617105 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-6725c96e-5dfd-4221-85a4-1a2821be8802 None None] MFA Rules not processed for user `f66c7a1ed35943fa819f481894d1fb5e`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:16:15.618256 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-6725c96e-5dfd-4221-85a4-1a2821be8802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:15.681741 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1092/2185] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:16:15 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:16:15.686299 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e2d2c-dbfa-4bc4-8672-82030f710c41 service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:15.687700 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-0e0e2d2c-dbfa-4bc4-8672-82030f710c41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:15.701025 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e2d2c-dbfa-4bc4-8672-82030f710c41 service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:15.706138 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e906ae-f10b-456e-a1ee-ff1d8c707b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:15.706797 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e906ae-f10b-456e-a1ee-ff1d8c707b88 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:15.707121 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e906ae-f10b-456e-a1ee-ff1d8c707b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:15.707395 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e906ae-f10b-456e-a1ee-ff1d8c707b88 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:15.708157 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e906ae-f10b-456e-a1ee-ff1d8c707b88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:15.710186 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e906ae-f10b-456e-a1ee-ff1d8c707b88 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:15.714550 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725c96e-5dfd-4221-85a4-1a2821be8802 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:15.715929 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-6725c96e-5dfd-4221-85a4-1a2821be8802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:15.731443 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725c96e-5dfd-4221-85a4-1a2821be8802 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:15.736859 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72cbc2-ee42-4415-8e3d-1f01e1056849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:15.737760 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72cbc2-ee42-4415-8e3d-1f01e1056849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:15.738018 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72cbc2-ee42-4415-8e3d-1f01e1056849 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:15.738292 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72cbc2-ee42-4415-8e3d-1f01e1056849 admin admin] PATH_INFO: `/v3/projects/4f1fc702b735418e940075afcdee2355` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:15.739477 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72cbc2-ee42-4415-8e3d-1f01e1056849 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f1fc702b735418e940075afcdee2355)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:15.741451 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72cbc2-ee42-4415-8e3d-1f01e1056849 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:15.832476 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1094/2186] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:16:15 2021] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:16:15.836332 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e906ae-f10b-456e-a1ee-ff1d8c707b88 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:15.871727 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-dc72cbc2-ee42-4415-8e3d-1f01e1056849 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f1fc702b735418e940075afcdee2355', 'request_id': 'req-dc72cbc2-ee42-4415-8e3d-1f01e1056849'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:15.897256 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e906ae-f10b-456e-a1ee-ff1d8c707b88 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:15.944685 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-dc72cbc2-ee42-4415-8e3d-1f01e1056849 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f1fc702b735418e940075afcdee2355', 'request_id': 'req-dc72cbc2-ee42-4415-8e3d-1f01e1056849'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:15.949387 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f41d53-061b-41bd-89f6-2580b3f99d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:15.950131 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f41d53-061b-41bd-89f6-2580b3f99d70 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:15.950414 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f41d53-061b-41bd-89f6-2580b3f99d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:15.950693 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f41d53-061b-41bd-89f6-2580b3f99d70 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:15.951123 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-dc72cbc2-ee42-4415-8e3d-1f01e1056849 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f1fc702b735418e940075afcdee2355', 'request_id': 'req-dc72cbc2-ee42-4415-8e3d-1f01e1056849'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:15.951377 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f41d53-061b-41bd-89f6-2580b3f99d70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:15.953314 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f41d53-061b-41bd-89f6-2580b3f99d70 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:15.962423 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-dc72cbc2-ee42-4415-8e3d-1f01e1056849 admin admin] The token cache is being invalidate because project 4f1fc702b735418e940075afcdee2355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:16:15.962711 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-dc72cbc2-ee42-4415-8e3d-1f01e1056849 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:15.963415 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-dc72cbc2-ee42-4415-8e3d-1f01e1056849 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:15.965033 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1093/2187] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:16:15 2021] DELETE /identity/v3/projects/4f1fc702b735418e940075afcdee2355 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:16:15.968857 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72cbc2-ee42-4415-8e3d-1f01e1056849 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:15.970161 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-dc72cbc2-ee42-4415-8e3d-1f01e1056849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:15.983175 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72cbc2-ee42-4415-8e3d-1f01e1056849 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:15.987828 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566446ae-a28c-4fe3-a5b3-6ef2fa591e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:15.988716 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566446ae-a28c-4fe3-a5b3-6ef2fa591e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:15.989013 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566446ae-a28c-4fe3-a5b3-6ef2fa591e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:15.989292 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566446ae-a28c-4fe3-a5b3-6ef2fa591e52 admin admin] PATH_INFO: `/v3/users/b1b2ea13ffbc401a9cb31ff4049a1290` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:15.990482 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566446ae-a28c-4fe3-a5b3-6ef2fa591e52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1b2ea13ffbc401a9cb31ff4049a1290)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:15.992444 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566446ae-a28c-4fe3-a5b3-6ef2fa591e52 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:16.037181 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1095/2188] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:16:15 2021] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:16:16.041029 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f41d53-061b-41bd-89f6-2580b3f99d70 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:16.042629 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-c6f41d53-061b-41bd-89f6-2580b3f99d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:16.054369 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f41d53-061b-41bd-89f6-2580b3f99d70 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:16.059099 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca48a8-82ea-4ca6-a98d-405987a4ed02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:16.059765 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca48a8-82ea-4ca6-a98d-405987a4ed02 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:16.060042 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca48a8-82ea-4ca6-a98d-405987a4ed02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:16.060317 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca48a8-82ea-4ca6-a98d-405987a4ed02 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:16.061097 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca48a8-82ea-4ca6-a98d-405987a4ed02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:16.062674 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca48a8-82ea-4ca6-a98d-405987a4ed02 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:16.073953 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1096/2189] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:16:16 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:16:16.077927 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca48a8-82ea-4ca6-a98d-405987a4ed02 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:16.095256 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca48a8-82ea-4ca6-a98d-405987a4ed02 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:16.100908 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0655a9-2ac5-496e-9138-cd5355d0140b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:16.101819 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0655a9-2ac5-496e-9138-cd5355d0140b admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:16.102101 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0655a9-2ac5-496e-9138-cd5355d0140b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:16.102380 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0655a9-2ac5-496e-9138-cd5355d0140b admin admin] PATH_INFO: `/v3/projects/9a2f1ce856534435b062158fc1dd8847/users/4d4e9ad9e9ee48cbb16163721ca52efe/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:16.118110 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0655a9-2ac5-496e-9138-cd5355d0140b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a2f1ce856534435b062158fc1dd8847, user_id=4d4e9ad9e9ee48cbb16163721ca52efe, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:16.120821 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0655a9-2ac5-496e-9138-cd5355d0140b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:16.191954 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-566446ae-a28c-4fe3-a5b3-6ef2fa591e52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1b2ea13ffbc401a9cb31ff4049a1290'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:16.198358 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-566446ae-a28c-4fe3-a5b3-6ef2fa591e52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1b2ea13ffbc401a9cb31ff4049a1290'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:16.198358 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-566446ae-a28c-4fe3-a5b3-6ef2fa591e52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1b2ea13ffbc401a9cb31ff4049a1290'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:16.200137 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-566446ae-a28c-4fe3-a5b3-6ef2fa591e52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1b2ea13ffbc401a9cb31ff4049a1290'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:16.231653 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1097/2190] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:16:16 2021] PUT /identity/v3/projects/9a2f1ce856534435b062158fc1dd8847/users/4d4e9ad9e9ee48cbb16163721ca52efe/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:16:16.237966 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0655a9-2ac5-496e-9138-cd5355d0140b admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:16.238526 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-8f0655a9-2ac5-496e-9138-cd5355d0140b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:16.281809 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-566446ae-a28c-4fe3-a5b3-6ef2fa591e52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1b2ea13ffbc401a9cb31ff4049a1290'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:16.299075 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0655a9-2ac5-496e-9138-cd5355d0140b admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:16.300659 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1094/2191] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:16:15 2021] DELETE /identity/v3/users/b1b2ea13ffbc401a9cb31ff4049a1290 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:16:16.354119 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18399af-3a0c-464d-98d0-06e5900738f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:16.354884 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18399af-3a0c-464d-98d0-06e5900738f6 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:16.355163 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18399af-3a0c-464d-98d0-06e5900738f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:16.355436 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18399af-3a0c-464d-98d0-06e5900738f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:16.356165 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18399af-3a0c-464d-98d0-06e5900738f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:16.358068 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18399af-3a0c-464d-98d0-06e5900738f6 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:16.368282 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1098/2192] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:16:16 2021] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:16:16.372466 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566446ae-a28c-4fe3-a5b3-6ef2fa591e52 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:16.382404 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566446ae-a28c-4fe3-a5b3-6ef2fa591e52 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:16.387045 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b16039-dd0e-4ef5-9367-fcff579211cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:16.387955 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b16039-dd0e-4ef5-9367-fcff579211cb admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:16.388233 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b16039-dd0e-4ef5-9367-fcff579211cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:16.388531 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b16039-dd0e-4ef5-9367-fcff579211cb admin admin] PATH_INFO: `/v3/projects/9a2f1ce856534435b062158fc1dd8847/users/4d4e9ad9e9ee48cbb16163721ca52efe/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:16.390551 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b16039-dd0e-4ef5-9367-fcff579211cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a2f1ce856534435b062158fc1dd8847, user_id=4d4e9ad9e9ee48cbb16163721ca52efe, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:16.393201 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b16039-dd0e-4ef5-9367-fcff579211cb admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:16.403288 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1095/2193] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:16:16 2021] PUT /identity/v3/projects/9a2f1ce856534435b062158fc1dd8847/users/4d4e9ad9e9ee48cbb16163721ca52efe/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:16:16.741782 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18399af-3a0c-464d-98d0-06e5900738f6 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:16.743596 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-e18399af-3a0c-464d-98d0-06e5900738f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:16.760138 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18399af-3a0c-464d-98d0-06e5900738f6 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:16.819953 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3d002-c858-46b0-84e5-50e3a522bdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:16.820852 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3d002-c858-46b0-84e5-50e3a522bdf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:16.821245 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3d002-c858-46b0-84e5-50e3a522bdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:16.821526 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3d002-c858-46b0-84e5-50e3a522bdf7 admin admin] PATH_INFO: `/v3/projects/5dce517e18d047799922ad93b8c33aa1` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:16.823388 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3d002-c858-46b0-84e5-50e3a522bdf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dce517e18d047799922ad93b8c33aa1)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:16.825305 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3d002-c858-46b0-84e5-50e3a522bdf7 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:16.952044 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-2cd3d002-c858-46b0-84e5-50e3a522bdf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dce517e18d047799922ad93b8c33aa1', 'request_id': 'req-2cd3d002-c858-46b0-84e5-50e3a522bdf7'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:17.058845 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-2cd3d002-c858-46b0-84e5-50e3a522bdf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dce517e18d047799922ad93b8c33aa1', 'request_id': 'req-2cd3d002-c858-46b0-84e5-50e3a522bdf7'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:17.064929 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-2cd3d002-c858-46b0-84e5-50e3a522bdf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dce517e18d047799922ad93b8c33aa1', 'request_id': 'req-2cd3d002-c858-46b0-84e5-50e3a522bdf7'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:17.076574 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-2cd3d002-c858-46b0-84e5-50e3a522bdf7 admin admin] The token cache is being invalidate because project 5dce517e18d047799922ad93b8c33aa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:16:17.076862 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-2cd3d002-c858-46b0-84e5-50e3a522bdf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:17.077478 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-2cd3d002-c858-46b0-84e5-50e3a522bdf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:17.079010 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1099/2194] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:16:16 2021] DELETE /identity/v3/projects/5dce517e18d047799922ad93b8c33aa1 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:16:17.086796 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898e36d-9cd1-4761-ae8b-764cfaafd19b None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:17.087088 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898e36d-9cd1-4761-ae8b-764cfaafd19b None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:17.087369 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898e36d-9cd1-4761-ae8b-764cfaafd19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:17.106276 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-7898e36d-9cd1-4761-ae8b-764cfaafd19b None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:16:17.107750 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-7898e36d-9cd1-4761-ae8b-764cfaafd19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:17.173027 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1096/2195] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:16:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:16:17.181708 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0017b-3e2a-4341-b238-bd3ce7871d60 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:17.181974 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0017b-3e2a-4341-b238-bd3ce7871d60 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:17.182261 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0017b-3e2a-4341-b238-bd3ce7871d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:17.202157 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-3bb0017b-3e2a-4341-b238-bd3ce7871d60 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:16:17.203620 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-3bb0017b-3e2a-4341-b238-bd3ce7871d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:17.216566 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1100/2196] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:16:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:16:17.222034 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898e36d-9cd1-4761-ae8b-764cfaafd19b None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:17.234257 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898e36d-9cd1-4761-ae8b-764cfaafd19b None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:17.240103 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d738c-15bc-445e-a790-706e84c1d28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:17.243502 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d738c-15bc-445e-a790-706e84c1d28f admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:17.243502 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d738c-15bc-445e-a790-706e84c1d28f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:17.243502 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d738c-15bc-445e-a790-706e84c1d28f admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:17.243502 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d738c-15bc-445e-a790-706e84c1d28f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:16:17.243502 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d738c-15bc-445e-a790-706e84c1d28f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:17.244913 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d738c-15bc-445e-a790-706e84c1d28f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:17.258963 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1097/2197] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:16:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:16:17.264524 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0017b-3e2a-4341-b238-bd3ce7871d60 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:17.274170 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0017b-3e2a-4341-b238-bd3ce7871d60 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:17.280640 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4b538-015a-4db9-ba94-96ced1fa45a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:17.281224 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4b538-015a-4db9-ba94-96ced1fa45a6 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:17.281508 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4b538-015a-4db9-ba94-96ced1fa45a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:17.281812 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4b538-015a-4db9-ba94-96ced1fa45a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:17.282517 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4b538-015a-4db9-ba94-96ced1fa45a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:17.285045 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4b538-015a-4db9-ba94-96ced1fa45a6 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:17.415657 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1101/2198] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:16:17 2021] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:16:17.420323 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d738c-15bc-445e-a790-706e84c1d28f admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:17.431475 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d738c-15bc-445e-a790-706e84c1d28f admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:17.501944 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbe878-8398-4312-b69b-abd7db89c073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:17.503206 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbe878-8398-4312-b69b-abd7db89c073 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:17.503495 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbe878-8398-4312-b69b-abd7db89c073 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:17.503778 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbe878-8398-4312-b69b-abd7db89c073 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:17.504479 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbe878-8398-4312-b69b-abd7db89c073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:17.506588 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbe878-8398-4312-b69b-abd7db89c073 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:17.614311 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1098/2199] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:16:17 2021] POST /identity/v3/users => generated 286 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:16:17.618472 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4b538-015a-4db9-ba94-96ced1fa45a6 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:17.631397 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4b538-015a-4db9-ba94-96ced1fa45a6 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:17.638864 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df588aca-f3ff-4055-a825-60489737128e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:17.639838 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df588aca-f3ff-4055-a825-60489737128e admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:17.644287 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df588aca-f3ff-4055-a825-60489737128e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:17.644287 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df588aca-f3ff-4055-a825-60489737128e admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:17.644287 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df588aca-f3ff-4055-a825-60489737128e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:17.644287 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df588aca-f3ff-4055-a825-60489737128e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:17.655441 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1102/2200] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:16:17 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:16:17.660155 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbe878-8398-4312-b69b-abd7db89c073 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:17.672908 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbe878-8398-4312-b69b-abd7db89c073 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:17.679930 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae651f3c-4647-444e-82c8-67403b6ea9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:17.681172 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae651f3c-4647-444e-82c8-67403b6ea9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:17.681534 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae651f3c-4647-444e-82c8-67403b6ea9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:17.681917 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae651f3c-4647-444e-82c8-67403b6ea9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:17.682765 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae651f3c-4647-444e-82c8-67403b6ea9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:17.684366 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae651f3c-4647-444e-82c8-67403b6ea9d1 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:17.700753 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1099/2201] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:16:17 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:16:17.701593 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df588aca-f3ff-4055-a825-60489737128e admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:17.713117 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df588aca-f3ff-4055-a825-60489737128e admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:17.717920 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb88870-f762-4296-a1f9-4b3ba3aad646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:17.718818 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb88870-f762-4296-a1f9-4b3ba3aad646 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:17.719097 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb88870-f762-4296-a1f9-4b3ba3aad646 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:17.719372 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb88870-f762-4296-a1f9-4b3ba3aad646 admin admin] PATH_INFO: `/v3/projects/5939c75066cc45d8bfb227964729f041/users/f14f97daab1d499b8027de90847e6757/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:17.735544 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb88870-f762-4296-a1f9-4b3ba3aad646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5939c75066cc45d8bfb227964729f041, user_id=f14f97daab1d499b8027de90847e6757, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:17.738262 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb88870-f762-4296-a1f9-4b3ba3aad646 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:17.922485 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1103/2202] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:16:17 2021] PUT /identity/v3/projects/5939c75066cc45d8bfb227964729f041/users/f14f97daab1d499b8027de90847e6757/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:16:17.927590 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637eaaa-1ba5-4dba-a1ec-54a2a57ee588 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:17.927906 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637eaaa-1ba5-4dba-a1ec-54a2a57ee588 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:17.928183 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637eaaa-1ba5-4dba-a1ec-54a2a57ee588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:17.946019 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-3637eaaa-1ba5-4dba-a1ec-54a2a57ee588 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:16:17.947196 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-3637eaaa-1ba5-4dba-a1ec-54a2a57ee588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:18.024388 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1100/2203] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:16:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:16:18.035307 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb88870-f762-4296-a1f9-4b3ba3aad646 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:18.037285 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-dfb88870-f762-4296-a1f9-4b3ba3aad646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:18.075261 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daced44-2d5e-476a-859f-cbc55bf09ee3 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:18.075754 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daced44-2d5e-476a-859f-cbc55bf09ee3 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:18.076187 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daced44-2d5e-476a-859f-cbc55bf09ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:18.102706 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb88870-f762-4296-a1f9-4b3ba3aad646 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:18.106703 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfa420-b785-4e61-a0a2-36eedc7593c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:18.107757 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfa420-b785-4e61-a0a2-36eedc7593c4 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:18.108100 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfa420-b785-4e61-a0a2-36eedc7593c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:18.109549 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfa420-b785-4e61-a0a2-36eedc7593c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:18.110148 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-2daced44-2d5e-476a-859f-cbc55bf09ee3 None None] MFA Rules not processed for user `4d4e9ad9e9ee48cbb16163721ca52efe`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:16:18.111378 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-2daced44-2d5e-476a-859f-cbc55bf09ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:18.118961 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bfa420-b785-4e61-a0a2-36eedc7593c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:18.120544 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bfa420-b785-4e61-a0a2-36eedc7593c4 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:18.131171 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1104/2204] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:16:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:16:18.183986 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1101/2205] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:16:18 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:16:18.191925 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfa420-b785-4e61-a0a2-36eedc7593c4 service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:18.193446 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-d0bfa420-b785-4e61-a0a2-36eedc7593c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:18.249853 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfa420-b785-4e61-a0a2-36eedc7593c4 service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:18.254074 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e8a36-71b4-40dc-a720-02792a66d7f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:18.254729 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e8a36-71b4-40dc-a720-02792a66d7f4 service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:18.255008 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e8a36-71b4-40dc-a720-02792a66d7f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:18.255283 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e8a36-71b4-40dc-a720-02792a66d7f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:18.258767 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-9a6e8a36-71b4-40dc-a720-02792a66d7f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:18.313836 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e8a36-71b4-40dc-a720-02792a66d7f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:18.316062 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e8a36-71b4-40dc-a720-02792a66d7f4 service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:18.327452 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1105/2206] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:16:18 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:16:19.881994 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0c74d-a069-44f3-891c-1f58214eaf49 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:19.882568 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0c74d-a069-44f3-891c-1f58214eaf49 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:19.882681 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0c74d-a069-44f3-891c-1f58214eaf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:19.913142 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-67b0c74d-a069-44f3-891c-1f58214eaf49 None None] MFA Rules not processed for user `f14f97daab1d499b8027de90847e6757`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:16:19.924906 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-67b0c74d-a069-44f3-891c-1f58214eaf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:19.976092 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1102/2207] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:16:19 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:16:19.987575 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e8a36-71b4-40dc-a720-02792a66d7f4 service cinder] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:19.995815 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e8a36-71b4-40dc-a720-02792a66d7f4 service cinder] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:19.999538 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883440a-4137-4ba8-8340-e6e08b500b19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:20.000185 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883440a-4137-4ba8-8340-e6e08b500b19 service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:20.000538 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883440a-4137-4ba8-8340-e6e08b500b19 service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:20.000824 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883440a-4137-4ba8-8340-e6e08b500b19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:20.009852 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883440a-4137-4ba8-8340-e6e08b500b19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:20.011336 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883440a-4137-4ba8-8340-e6e08b500b19 service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:20.022403 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1106/2208] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:16:19 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:16:21.238757 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0c74d-a069-44f3-891c-1f58214eaf49 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:21.248221 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0c74d-a069-44f3-891c-1f58214eaf49 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:21.251884 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a858a51-2a0c-49d4-9383-6ac307924721 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:21.253127 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a858a51-2a0c-49d4-9383-6ac307924721 service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:21.253414 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a858a51-2a0c-49d4-9383-6ac307924721 service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:21.253692 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a858a51-2a0c-49d4-9383-6ac307924721 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:21.262523 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a858a51-2a0c-49d4-9383-6ac307924721 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:21.263951 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a858a51-2a0c-49d4-9383-6ac307924721 service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:21.273302 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1103/2209] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:16:21 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:16:22.988606 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af90e7-9c50-45de-b927-1af45ec65891 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:22.989106 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af90e7-9c50-45de-b927-1af45ec65891 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:22.989207 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af90e7-9c50-45de-b927-1af45ec65891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:23.006113 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-e8af90e7-9c50-45de-b927-1af45ec65891 None None] MFA Rules not processed for user `f14f97daab1d499b8027de90847e6757`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:16:23.007436 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-e8af90e7-9c50-45de-b927-1af45ec65891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:23.014731 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1107/2210] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:16:22 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:16:23.306642 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39111b9b-3d81-4831-b2f8-1273e00e57f6 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:23.307146 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39111b9b-3d81-4831-b2f8-1273e00e57f6 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:23.307237 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39111b9b-3d81-4831-b2f8-1273e00e57f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:23.325801 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-39111b9b-3d81-4831-b2f8-1273e00e57f6 None None] MFA Rules not processed for user `36893da01a1845f5af4921a298abb9eb`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:16:23.328979 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-39111b9b-3d81-4831-b2f8-1273e00e57f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:23.384998 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1104/2211] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:16:23 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:16:25.141682 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af90e7-9c50-45de-b927-1af45ec65891 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:25.143819 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-e8af90e7-9c50-45de-b927-1af45ec65891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:25.252310 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af90e7-9c50-45de-b927-1af45ec65891 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:25.257388 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae762dc-60f5-4522-8a58-1079fd96d92c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b7e780a23e4ee499cb7820a85feccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:25.258042 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae762dc-60f5-4522-8a58-1079fd96d92c service placement] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:25.258367 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae762dc-60f5-4522-8a58-1079fd96d92c service placement] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:25.258646 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae762dc-60f5-4522-8a58-1079fd96d92c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:25.260399 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-4ae762dc-60f5-4522-8a58-1079fd96d92c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:25.272058 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae762dc-60f5-4522-8a58-1079fd96d92c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:25.273641 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae762dc-60f5-4522-8a58-1079fd96d92c service placement] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:25.283109 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1108/2212] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:16:25 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:16:42.018696 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39111b9b-3d81-4831-b2f8-1273e00e57f6 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:42.020116 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-39111b9b-3d81-4831-b2f8-1273e00e57f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:42.034923 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39111b9b-3d81-4831-b2f8-1273e00e57f6 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:42.041665 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7f640-bf3d-4bdc-a256-0bba4d087c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:42.043058 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7f640-bf3d-4bdc-a256-0bba4d087c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:42.043446 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7f640-bf3d-4bdc-a256-0bba4d087c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:42.043907 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7f640-bf3d-4bdc-a256-0bba4d087c68 admin admin] PATH_INFO: `/v3/users/f66c7a1ed35943fa819f481894d1fb5e` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:42.045366 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7f640-bf3d-4bdc-a256-0bba4d087c68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f66c7a1ed35943fa819f481894d1fb5e)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:42.047489 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7f640-bf3d-4bdc-a256-0bba4d087c68 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:42.198173 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-15c7f640-bf3d-4bdc-a256-0bba4d087c68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f66c7a1ed35943fa819f481894d1fb5e'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:42.198825 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-15c7f640-bf3d-4bdc-a256-0bba4d087c68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f66c7a1ed35943fa819f481894d1fb5e'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:42.199434 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-15c7f640-bf3d-4bdc-a256-0bba4d087c68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f66c7a1ed35943fa819f481894d1fb5e'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:42.206622 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-15c7f640-bf3d-4bdc-a256-0bba4d087c68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f66c7a1ed35943fa819f481894d1fb5e'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:42.253669 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-15c7f640-bf3d-4bdc-a256-0bba4d087c68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f66c7a1ed35943fa819f481894d1fb5e'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:42.270714 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1105/2213] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:16:42 2021] DELETE /identity/v3/users/f66c7a1ed35943fa819f481894d1fb5e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:16:42.568269 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae762dc-60f5-4522-8a58-1079fd96d92c service placement] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:42.578793 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae762dc-60f5-4522-8a58-1079fd96d92c service placement] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:42.650005 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1075b-43fa-492d-bbef-a38e72e729e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:42.650881 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1075b-43fa-492d-bbef-a38e72e729e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:42.651167 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1075b-43fa-492d-bbef-a38e72e729e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:42.651489 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1075b-43fa-492d-bbef-a38e72e729e1 admin admin] PATH_INFO: `/v3/projects/4cbf488feff74538a486b68c991c943c` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:42.659172 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1075b-43fa-492d-bbef-a38e72e729e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cbf488feff74538a486b68c991c943c)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:42.661297 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1075b-43fa-492d-bbef-a38e72e729e1 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:42.825580 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-b8e1075b-43fa-492d-bbef-a38e72e729e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cbf488feff74538a486b68c991c943c', 'request_id': 'req-b8e1075b-43fa-492d-bbef-a38e72e729e1'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:42.955991 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-b8e1075b-43fa-492d-bbef-a38e72e729e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cbf488feff74538a486b68c991c943c', 'request_id': 'req-b8e1075b-43fa-492d-bbef-a38e72e729e1'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:42.961794 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-b8e1075b-43fa-492d-bbef-a38e72e729e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cbf488feff74538a486b68c991c943c', 'request_id': 'req-b8e1075b-43fa-492d-bbef-a38e72e729e1'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:42.972616 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-b8e1075b-43fa-492d-bbef-a38e72e729e1 admin admin] The token cache is being invalidate because project 4cbf488feff74538a486b68c991c943c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:16:42.972907 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-b8e1075b-43fa-492d-bbef-a38e72e729e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:42.973531 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-b8e1075b-43fa-492d-bbef-a38e72e729e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:42.975179 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1109/2214] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:16:42 2021] DELETE /identity/v3/projects/4cbf488feff74538a486b68c991c943c => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:16:42.979104 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7f640-bf3d-4bdc-a256-0bba4d087c68 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:42.980590 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-15c7f640-bf3d-4bdc-a256-0bba4d087c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:42.994051 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7f640-bf3d-4bdc-a256-0bba4d087c68 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:43.047862 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e21eda-354b-4872-a6d8-eb639b71f8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:43.049250 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e21eda-354b-4872-a6d8-eb639b71f8ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:43.049529 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e21eda-354b-4872-a6d8-eb639b71f8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:43.049804 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e21eda-354b-4872-a6d8-eb639b71f8ec admin admin] PATH_INFO: `/v3/users/4d4e9ad9e9ee48cbb16163721ca52efe` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:43.050975 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e21eda-354b-4872-a6d8-eb639b71f8ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d4e9ad9e9ee48cbb16163721ca52efe)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:43.052907 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e21eda-354b-4872-a6d8-eb639b71f8ec admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:43.267134 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e4e21eda-354b-4872-a6d8-eb639b71f8ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d4e9ad9e9ee48cbb16163721ca52efe'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:43.267984 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e4e21eda-354b-4872-a6d8-eb639b71f8ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d4e9ad9e9ee48cbb16163721ca52efe'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:43.268872 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e4e21eda-354b-4872-a6d8-eb639b71f8ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d4e9ad9e9ee48cbb16163721ca52efe'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:43.282698 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e4e21eda-354b-4872-a6d8-eb639b71f8ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d4e9ad9e9ee48cbb16163721ca52efe'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:43.384583 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e4e21eda-354b-4872-a6d8-eb639b71f8ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d4e9ad9e9ee48cbb16163721ca52efe'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:43.402831 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1106/2215] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:16:42 2021] DELETE /identity/v3/users/4d4e9ad9e9ee48cbb16163721ca52efe => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:16:43.642520 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1075b-43fa-492d-bbef-a38e72e729e1 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:43.644022 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-b8e1075b-43fa-492d-bbef-a38e72e729e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:43.658947 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1075b-43fa-492d-bbef-a38e72e729e1 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:43.716923 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70555d77-f16e-409e-9e9b-7557678f4647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:43.717813 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70555d77-f16e-409e-9e9b-7557678f4647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:43.718103 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70555d77-f16e-409e-9e9b-7557678f4647 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:43.718383 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70555d77-f16e-409e-9e9b-7557678f4647 admin admin] PATH_INFO: `/v3/projects/9a2f1ce856534435b062158fc1dd8847` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:43.719582 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70555d77-f16e-409e-9e9b-7557678f4647 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a2f1ce856534435b062158fc1dd8847)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:43.722045 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70555d77-f16e-409e-9e9b-7557678f4647 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:43.858779 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-70555d77-f16e-409e-9e9b-7557678f4647 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a2f1ce856534435b062158fc1dd8847', 'request_id': 'req-70555d77-f16e-409e-9e9b-7557678f4647'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:43.944572 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-70555d77-f16e-409e-9e9b-7557678f4647 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a2f1ce856534435b062158fc1dd8847', 'request_id': 'req-70555d77-f16e-409e-9e9b-7557678f4647'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:43.950687 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-70555d77-f16e-409e-9e9b-7557678f4647 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a2f1ce856534435b062158fc1dd8847', 'request_id': 'req-70555d77-f16e-409e-9e9b-7557678f4647'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:43.961964 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-70555d77-f16e-409e-9e9b-7557678f4647 admin admin] The token cache is being invalidate because project 9a2f1ce856534435b062158fc1dd8847 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:16:43.962253 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-70555d77-f16e-409e-9e9b-7557678f4647 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:43.962898 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-70555d77-f16e-409e-9e9b-7557678f4647 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:43.964597 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1110/2216] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:16:43 2021] DELETE /identity/v3/projects/9a2f1ce856534435b062158fc1dd8847 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:16:43.970482 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6d709-a2de-493c-81b0-1f7bd145c6f4 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:43.970787 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6d709-a2de-493c-81b0-1f7bd145c6f4 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:43.971068 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6d709-a2de-493c-81b0-1f7bd145c6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:43.989625 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-0be6d709-a2de-493c-81b0-1f7bd145c6f4 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:16:43.990824 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-0be6d709-a2de-493c-81b0-1f7bd145c6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:44.049600 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1107/2217] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:16:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:16:44.058299 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68175562-2a22-42ca-8b28-e61e6a1b6b97 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:44.058591 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68175562-2a22-42ca-8b28-e61e6a1b6b97 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:44.058900 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68175562-2a22-42ca-8b28-e61e6a1b6b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:44.077284 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-68175562-2a22-42ca-8b28-e61e6a1b6b97 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:16:44.078472 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-68175562-2a22-42ca-8b28-e61e6a1b6b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:44.086204 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1111/2218] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:16:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:16:44.090424 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6d709-a2de-493c-81b0-1f7bd145c6f4 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:44.100414 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6d709-a2de-493c-81b0-1f7bd145c6f4 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:44.105043 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdfc7b-c34d-466c-95b4-26a7478529c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:44.105697 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdfc7b-c34d-466c-95b4-26a7478529c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:44.105981 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdfc7b-c34d-466c-95b4-26a7478529c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:44.106286 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdfc7b-c34d-466c-95b4-26a7478529c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:44.107012 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdfc7b-c34d-466c-95b4-26a7478529c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:16:44.107582 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdfc7b-c34d-466c-95b4-26a7478529c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:44.109203 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdfc7b-c34d-466c-95b4-26a7478529c1 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:44.120967 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1108/2219] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:16:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 03:16:44.125017 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68175562-2a22-42ca-8b28-e61e6a1b6b97 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:44.134223 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68175562-2a22-42ca-8b28-e61e6a1b6b97 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:44.138830 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a1b07-c9ab-4bdd-b429-70aa7509d7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:44.139469 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a1b07-c9ab-4bdd-b429-70aa7509d7e0 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:44.139748 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a1b07-c9ab-4bdd-b429-70aa7509d7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:44.140022 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a1b07-c9ab-4bdd-b429-70aa7509d7e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:44.140861 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a1b07-c9ab-4bdd-b429-70aa7509d7e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:44.142765 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a1b07-c9ab-4bdd-b429-70aa7509d7e0 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:44.265818 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1112/2220] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:16:44 2021] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:16:44.270405 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdfc7b-c34d-466c-95b4-26a7478529c1 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:44.280542 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdfc7b-c34d-466c-95b4-26a7478529c1 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:44.338459 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46b47f-eb50-4cbc-9302-9360a8e3f2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:44.339143 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46b47f-eb50-4cbc-9302-9360a8e3f2aa admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:44.339432 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46b47f-eb50-4cbc-9302-9360a8e3f2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:44.339736 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46b47f-eb50-4cbc-9302-9360a8e3f2aa admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:44.340434 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b46b47f-eb50-4cbc-9302-9360a8e3f2aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:44.342381 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b46b47f-eb50-4cbc-9302-9360a8e3f2aa admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:44.464813 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1109/2221] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:16:44 2021] POST /identity/v3/users => generated 283 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:16:44.468748 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a1b07-c9ab-4bdd-b429-70aa7509d7e0 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:44.479150 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a1b07-c9ab-4bdd-b429-70aa7509d7e0 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:44.484037 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0bd97-21fb-4b37-ae60-5536abbecce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:44.484732 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0bd97-21fb-4b37-ae60-5536abbecce3 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:44.485013 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0bd97-21fb-4b37-ae60-5536abbecce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:44.485290 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0bd97-21fb-4b37-ae60-5536abbecce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:44.486046 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0bd97-21fb-4b37-ae60-5536abbecce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:44.488127 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0bd97-21fb-4b37-ae60-5536abbecce3 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:44.498710 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1113/2222] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:16:44 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:16:44.503128 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46b47f-eb50-4cbc-9302-9360a8e3f2aa admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:44.513507 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46b47f-eb50-4cbc-9302-9360a8e3f2aa admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:44.518297 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd43fc-bb80-459c-bef8-d60eb106e364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:44.518902 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd43fc-bb80-459c-bef8-d60eb106e364 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:44.519187 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd43fc-bb80-459c-bef8-d60eb106e364 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:44.519466 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd43fc-bb80-459c-bef8-d60eb106e364 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:44.520197 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd43fc-bb80-459c-bef8-d60eb106e364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:44.521856 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd43fc-bb80-459c-bef8-d60eb106e364 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:44.531736 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1110/2223] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:16:44 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:16:44.536127 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0bd97-21fb-4b37-ae60-5536abbecce3 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:44.563420 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0bd97-21fb-4b37-ae60-5536abbecce3 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:44.563420 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a1969-ea07-4b2c-ab34-479407114b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:44.563420 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a1969-ea07-4b2c-ab34-479407114b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:44.563420 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a1969-ea07-4b2c-ab34-479407114b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:44.563830 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a1969-ea07-4b2c-ab34-479407114b36 admin admin] PATH_INFO: `/v3/projects/75a9fbdf33ae4ff78bef7ce697bd3d24/users/6c5b4f111295488c9d6ed7fadf52255e/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:44.568416 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a1969-ea07-4b2c-ab34-479407114b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75a9fbdf33ae4ff78bef7ce697bd3d24, user_id=6c5b4f111295488c9d6ed7fadf52255e, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:44.571075 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a1969-ea07-4b2c-ab34-479407114b36 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:44.716156 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1114/2224] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:16:44 2021] PUT /identity/v3/projects/75a9fbdf33ae4ff78bef7ce697bd3d24/users/6c5b4f111295488c9d6ed7fadf52255e/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:16:44.726309 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911d493-61f2-4178-8353-97669caf9211 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:44.726600 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911d493-61f2-4178-8353-97669caf9211 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:44.726882 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911d493-61f2-4178-8353-97669caf9211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:44.754394 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-2911d493-61f2-4178-8353-97669caf9211 None None] MFA Rules not processed for user `6c5b4f111295488c9d6ed7fadf52255e`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:16:44.755616 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-2911d493-61f2-4178-8353-97669caf9211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:44.824730 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1111/2225] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:16:44 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:16:44.835283 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a1969-ea07-4b2c-ab34-479407114b36 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:44.837242 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-be1a1969-ea07-4b2c-ab34-479407114b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:44.895062 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a1969-ea07-4b2c-ab34-479407114b36 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:44.898784 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d743bc-58c7-4194-ab65-7743f25388a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:44.899435 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d743bc-58c7-4194-ab65-7743f25388a9 service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:44.899721 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d743bc-58c7-4194-ab65-7743f25388a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:44.899997 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d743bc-58c7-4194-ab65-7743f25388a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:44.908335 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d743bc-58c7-4194-ab65-7743f25388a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:44.909946 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d743bc-58c7-4194-ab65-7743f25388a9 service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:44.919726 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1115/2226] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:16:44 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:16:49.602221 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ff900-9886-486a-971f-87d7c7e585b8 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:49.602708 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ff900-9886-486a-971f-87d7c7e585b8 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:49.602977 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ff900-9886-486a-971f-87d7c7e585b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:49.622209 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-9d7ff900-9886-486a-971f-87d7c7e585b8 None None] MFA Rules not processed for user `f14f97daab1d499b8027de90847e6757`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:16:49.623406 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-9d7ff900-9886-486a-971f-87d7c7e585b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:49.678768 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1112/2227] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:16:49 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:16:55.677037 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d743bc-58c7-4194-ab65-7743f25388a9 service cinder] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:55.679205 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-a8d743bc-58c7-4194-ab65-7743f25388a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:55.748186 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d743bc-58c7-4194-ab65-7743f25388a9 service cinder] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:55.753303 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e41ad-bde3-41d3-9669-5d48df6795a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:55.754170 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e41ad-bde3-41d3-9669-5d48df6795a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:55.754480 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e41ad-bde3-41d3-9669-5d48df6795a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:55.754761 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e41ad-bde3-41d3-9669-5d48df6795a1 admin admin] PATH_INFO: `/v3/users/dbd9a5404ac747d4964d215c96918625` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:55.755954 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e41ad-bde3-41d3-9669-5d48df6795a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbd9a5404ac747d4964d215c96918625)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:55.757894 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e41ad-bde3-41d3-9669-5d48df6795a1 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:55.987871 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-579e41ad-bde3-41d3-9669-5d48df6795a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbd9a5404ac747d4964d215c96918625'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:55.988574 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-579e41ad-bde3-41d3-9669-5d48df6795a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbd9a5404ac747d4964d215c96918625'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:55.998279 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-579e41ad-bde3-41d3-9669-5d48df6795a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbd9a5404ac747d4964d215c96918625'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:56.070101 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-579e41ad-bde3-41d3-9669-5d48df6795a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbd9a5404ac747d4964d215c96918625'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:56.082254 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-579e41ad-bde3-41d3-9669-5d48df6795a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbd9a5404ac747d4964d215c96918625'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:56.087938 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1116/2228] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:16:55 2021] DELETE /identity/v3/users/dbd9a5404ac747d4964d215c96918625 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:16:56.344091 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ff900-9886-486a-971f-87d7c7e585b8 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:56.355375 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ff900-9886-486a-971f-87d7c7e585b8 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:56.421472 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f08bbc-0e42-4f39-b91b-f994a08d307b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:56.422459 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f08bbc-0e42-4f39-b91b-f994a08d307b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:56.422761 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f08bbc-0e42-4f39-b91b-f994a08d307b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:56.423033 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f08bbc-0e42-4f39-b91b-f994a08d307b admin admin] PATH_INFO: `/v3/projects/a28d49e25ce7449f8ae6c33149e67246` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:56.424255 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f08bbc-0e42-4f39-b91b-f994a08d307b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a28d49e25ce7449f8ae6c33149e67246)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:56.426204 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f08bbc-0e42-4f39-b91b-f994a08d307b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:56.529061 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b8f08bbc-0e42-4f39-b91b-f994a08d307b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a28d49e25ce7449f8ae6c33149e67246', 'request_id': 'req-b8f08bbc-0e42-4f39-b91b-f994a08d307b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:56.578429 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b8f08bbc-0e42-4f39-b91b-f994a08d307b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a28d49e25ce7449f8ae6c33149e67246', 'request_id': 'req-b8f08bbc-0e42-4f39-b91b-f994a08d307b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:56.585209 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b8f08bbc-0e42-4f39-b91b-f994a08d307b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a28d49e25ce7449f8ae6c33149e67246', 'request_id': 'req-b8f08bbc-0e42-4f39-b91b-f994a08d307b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:56.596619 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b8f08bbc-0e42-4f39-b91b-f994a08d307b admin admin] The token cache is being invalidate because project a28d49e25ce7449f8ae6c33149e67246 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:16:56.596910 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b8f08bbc-0e42-4f39-b91b-f994a08d307b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:56.597775 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b8f08bbc-0e42-4f39-b91b-f994a08d307b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:16:56.599445 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1113/2229] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:16:56 2021] DELETE /identity/v3/projects/a28d49e25ce7449f8ae6c33149e67246 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:16:56.605421 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fede3c-5da2-4b09-836c-532e879e062f None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:56.605712 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fede3c-5da2-4b09-836c-532e879e062f None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:56.606106 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fede3c-5da2-4b09-836c-532e879e062f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:56.624799 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-78fede3c-5da2-4b09-836c-532e879e062f None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:16:56.628742 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-78fede3c-5da2-4b09-836c-532e879e062f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:56.684125 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1117/2230] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:16:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:16:56.692303 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49b259-6c89-4e66-93b1-551ecc6d9279 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:56.692630 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49b259-6c89-4e66-93b1-551ecc6d9279 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:56.692910 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49b259-6c89-4e66-93b1-551ecc6d9279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:56.711715 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-2d49b259-6c89-4e66-93b1-551ecc6d9279 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:16:56.712887 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-2d49b259-6c89-4e66-93b1-551ecc6d9279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:56.721298 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1114/2231] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:16:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:16:56.725431 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fede3c-5da2-4b09-836c-532e879e062f None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:56.735392 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fede3c-5da2-4b09-836c-532e879e062f None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:56.740022 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f3819-25f2-4f80-883e-ae256f0056fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:56.740712 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f3819-25f2-4f80-883e-ae256f0056fa admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:56.740999 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f3819-25f2-4f80-883e-ae256f0056fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:56.741281 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f3819-25f2-4f80-883e-ae256f0056fa admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:56.741997 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f3819-25f2-4f80-883e-ae256f0056fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:16:56.742306 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f3819-25f2-4f80-883e-ae256f0056fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:56.743924 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f3819-25f2-4f80-883e-ae256f0056fa admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:56.755454 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1118/2232] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:16:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:16:56.759977 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49b259-6c89-4e66-93b1-551ecc6d9279 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:56.769383 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49b259-6c89-4e66-93b1-551ecc6d9279 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:56.774200 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f8862-e577-4a19-92b0-ec171f435666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:56.774858 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f8862-e577-4a19-92b0-ec171f435666 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:56.775140 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f8862-e577-4a19-92b0-ec171f435666 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:56.775418 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f8862-e577-4a19-92b0-ec171f435666 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:56.776117 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f8862-e577-4a19-92b0-ec171f435666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:56.778084 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f8862-e577-4a19-92b0-ec171f435666 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:56.951748 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1115/2233] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:16:56 2021] POST /identity/v3/projects => generated 373 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:16:56.955939 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f3819-25f2-4f80-883e-ae256f0056fa admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:56.965835 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f3819-25f2-4f80-883e-ae256f0056fa admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:57.026601 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a674f7f-c783-4236-86e7-e515acff9f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:57.027288 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a674f7f-c783-4236-86e7-e515acff9f15 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:57.027575 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a674f7f-c783-4236-86e7-e515acff9f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:57.027853 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a674f7f-c783-4236-86e7-e515acff9f15 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:57.028680 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a674f7f-c783-4236-86e7-e515acff9f15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:57.030603 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a674f7f-c783-4236-86e7-e515acff9f15 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:57.116790 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1119/2234] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:16:56 2021] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:16:57.120837 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f8862-e577-4a19-92b0-ec171f435666 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:57.133244 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f8862-e577-4a19-92b0-ec171f435666 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:57.138041 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b0241-150a-4c3d-b98a-bd078803e3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:57.138753 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b0241-150a-4c3d-b98a-bd078803e3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:57.139002 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b0241-150a-4c3d-b98a-bd078803e3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:57.139281 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b0241-150a-4c3d-b98a-bd078803e3c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:57.140009 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b0241-150a-4c3d-b98a-bd078803e3c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:57.141644 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b0241-150a-4c3d-b98a-bd078803e3c1 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:57.152956 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1116/2235] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:16:57 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:16:57.156977 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a674f7f-c783-4236-86e7-e515acff9f15 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:57.166837 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a674f7f-c783-4236-86e7-e515acff9f15 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:57.171533 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d350804-0b80-4ce3-b200-0d302a9a1916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:57.172233 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d350804-0b80-4ce3-b200-0d302a9a1916 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:57.172554 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d350804-0b80-4ce3-b200-0d302a9a1916 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:57.172838 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d350804-0b80-4ce3-b200-0d302a9a1916 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:57.173567 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d350804-0b80-4ce3-b200-0d302a9a1916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:57.175162 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d350804-0b80-4ce3-b200-0d302a9a1916 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:57.185202 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1120/2236] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:16:57 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:16:57.189839 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b0241-150a-4c3d-b98a-bd078803e3c1 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:57.199574 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b0241-150a-4c3d-b98a-bd078803e3c1 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:57.204344 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af594bf8-e6aa-4563-a3d4-c47297d7e5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:57.205839 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af594bf8-e6aa-4563-a3d4-c47297d7e5ad admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:57.206116 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af594bf8-e6aa-4563-a3d4-c47297d7e5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:57.206390 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af594bf8-e6aa-4563-a3d4-c47297d7e5ad admin admin] PATH_INFO: `/v3/projects/1f6b00c4f894434d83dd531dd2061340/users/b5a879c70720409fbe202981e08a8afe/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:57.225470 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af594bf8-e6aa-4563-a3d4-c47297d7e5ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f6b00c4f894434d83dd531dd2061340, user_id=b5a879c70720409fbe202981e08a8afe, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:57.225470 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af594bf8-e6aa-4563-a3d4-c47297d7e5ad admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:57.299254 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1117/2237] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:16:57 2021] PUT /identity/v3/projects/1f6b00c4f894434d83dd531dd2061340/users/b5a879c70720409fbe202981e08a8afe/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:16:57.309597 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bcb2c-b019-4e72-8d5b-3dba2a5d98f3 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:57.309890 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bcb2c-b019-4e72-8d5b-3dba2a5d98f3 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:57.310217 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bcb2c-b019-4e72-8d5b-3dba2a5d98f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:57.336608 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-0a7bcb2c-b019-4e72-8d5b-3dba2a5d98f3 None None] MFA Rules not processed for user `b5a879c70720409fbe202981e08a8afe`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:16:57.337998 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-0a7bcb2c-b019-4e72-8d5b-3dba2a5d98f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:57.398177 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1121/2238] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:16:57 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:16:57.409010 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af594bf8-e6aa-4563-a3d4-c47297d7e5ad admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:16:57.410683 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-af594bf8-e6aa-4563-a3d4-c47297d7e5ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:16:57.506275 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af594bf8-e6aa-4563-a3d4-c47297d7e5ad admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:16:57.511828 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35f328-b9d7-47bf-ba4a-4fbe37f0642b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:16:57.512466 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35f328-b9d7-47bf-ba4a-4fbe37f0642b service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:16:57.512775 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35f328-b9d7-47bf-ba4a-4fbe37f0642b service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:16:57.513050 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35f328-b9d7-47bf-ba4a-4fbe37f0642b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:16:57.522654 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35f328-b9d7-47bf-ba4a-4fbe37f0642b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:16:57.524238 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35f328-b9d7-47bf-ba4a-4fbe37f0642b service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:16:57.534222 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1118/2239] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:16:57 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:17:06.101393 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bcb2c-b019-4e72-8d5b-3dba2a5d98f3 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:06.160828 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bcb2c-b019-4e72-8d5b-3dba2a5d98f3 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:06.165289 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984894b-73c9-4b63-b2f5-e7d47fe941ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:06.166146 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984894b-73c9-4b63-b2f5-e7d47fe941ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:06.166427 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984894b-73c9-4b63-b2f5-e7d47fe941ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:06.166699 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984894b-73c9-4b63-b2f5-e7d47fe941ff admin admin] PATH_INFO: `/v3/users/b5a879c70720409fbe202981e08a8afe` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:06.167870 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984894b-73c9-4b63-b2f5-e7d47fe941ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5a879c70720409fbe202981e08a8afe)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:06.169788 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984894b-73c9-4b63-b2f5-e7d47fe941ff admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:06.402301 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-5984894b-73c9-4b63-b2f5-e7d47fe941ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5a879c70720409fbe202981e08a8afe'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:06.402957 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-5984894b-73c9-4b63-b2f5-e7d47fe941ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5a879c70720409fbe202981e08a8afe'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:06.409512 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-5984894b-73c9-4b63-b2f5-e7d47fe941ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5a879c70720409fbe202981e08a8afe'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:06.544584 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-5984894b-73c9-4b63-b2f5-e7d47fe941ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5a879c70720409fbe202981e08a8afe'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:06.557364 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-5984894b-73c9-4b63-b2f5-e7d47fe941ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5a879c70720409fbe202981e08a8afe'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:06.563143 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1122/2240] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:17:06 2021] DELETE /identity/v3/users/b5a879c70720409fbe202981e08a8afe => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:17:06.568137 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28774d98-2ae3-41a7-b776-54d319b02765 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:06.568623 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28774d98-2ae3-41a7-b776-54d319b02765 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:06.568747 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28774d98-2ae3-41a7-b776-54d319b02765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:06.586975 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-28774d98-2ae3-41a7-b776-54d319b02765 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:06.588165 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-28774d98-2ae3-41a7-b776-54d319b02765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:06.646533 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1119/2241] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:17:06.656854 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984894b-73c9-4b63-b2f5-e7d47fe941ff admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:06.658265 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-5984894b-73c9-4b63-b2f5-e7d47fe941ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:06.714216 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984894b-73c9-4b63-b2f5-e7d47fe941ff admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:06.718219 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04678848-8f5c-425e-9f17-289f8f9d3cb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:06.718881 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04678848-8f5c-425e-9f17-289f8f9d3cb1 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:06.719168 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04678848-8f5c-425e-9f17-289f8f9d3cb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:06.719445 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04678848-8f5c-425e-9f17-289f8f9d3cb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:06.729022 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04678848-8f5c-425e-9f17-289f8f9d3cb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:06.730506 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04678848-8f5c-425e-9f17-289f8f9d3cb1 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:06.740373 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1123/2242] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:17:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:17:07.174729 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28774d98-2ae3-41a7-b776-54d319b02765 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:07.176066 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-28774d98-2ae3-41a7-b776-54d319b02765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:07.192463 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28774d98-2ae3-41a7-b776-54d319b02765 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:07.197378 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a21b8-f655-4067-a47d-519582b0d7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:07.198279 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a21b8-f655-4067-a47d-519582b0d7ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:07.198729 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a21b8-f655-4067-a47d-519582b0d7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:07.198834 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a21b8-f655-4067-a47d-519582b0d7ac admin admin] PATH_INFO: `/v3/projects/1f6b00c4f894434d83dd531dd2061340` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:07.199951 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a21b8-f655-4067-a47d-519582b0d7ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f6b00c4f894434d83dd531dd2061340)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:07.201997 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a21b8-f655-4067-a47d-519582b0d7ac admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:07.298606 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b75a21b8-f655-4067-a47d-519582b0d7ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f6b00c4f894434d83dd531dd2061340', 'request_id': 'req-b75a21b8-f655-4067-a47d-519582b0d7ac'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:07.401224 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b75a21b8-f655-4067-a47d-519582b0d7ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f6b00c4f894434d83dd531dd2061340', 'request_id': 'req-b75a21b8-f655-4067-a47d-519582b0d7ac'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:07.406996 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b75a21b8-f655-4067-a47d-519582b0d7ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f6b00c4f894434d83dd531dd2061340', 'request_id': 'req-b75a21b8-f655-4067-a47d-519582b0d7ac'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:07.417691 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b75a21b8-f655-4067-a47d-519582b0d7ac admin admin] The token cache is being invalidate because project 1f6b00c4f894434d83dd531dd2061340 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:17:07.417975 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b75a21b8-f655-4067-a47d-519582b0d7ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:07.418590 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b75a21b8-f655-4067-a47d-519582b0d7ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:07.420104 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1120/2243] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:17:07 2021] DELETE /identity/v3/projects/1f6b00c4f894434d83dd531dd2061340 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:17:07.426036 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571204ab-5113-44f6-9016-bd611b2fe144 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:07.426520 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571204ab-5113-44f6-9016-bd611b2fe144 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:07.426520 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571204ab-5113-44f6-9016-bd611b2fe144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:07.448005 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-571204ab-5113-44f6-9016-bd611b2fe144 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:07.448005 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-571204ab-5113-44f6-9016-bd611b2fe144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:07.504351 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1124/2244] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:17:07.512156 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feac475-72f5-474f-9f13-de0be2062f68 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:07.512443 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feac475-72f5-474f-9f13-de0be2062f68 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:07.512752 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feac475-72f5-474f-9f13-de0be2062f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:07.531898 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-2feac475-72f5-474f-9f13-de0be2062f68 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:07.533149 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-2feac475-72f5-474f-9f13-de0be2062f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:07.541503 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1121/2245] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:17:07.547753 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571204ab-5113-44f6-9016-bd611b2fe144 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:07.560662 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571204ab-5113-44f6-9016-bd611b2fe144 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:07.566981 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e353941-2830-4c85-9408-013f02f1a6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:07.567760 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e353941-2830-4c85-9408-013f02f1a6ae admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:07.568148 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e353941-2830-4c85-9408-013f02f1a6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:07.568617 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e353941-2830-4c85-9408-013f02f1a6ae admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:07.569455 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e353941-2830-4c85-9408-013f02f1a6ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:17:07.569923 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e353941-2830-4c85-9408-013f02f1a6ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:07.571672 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e353941-2830-4c85-9408-013f02f1a6ae admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:07.585673 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1125/2246] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:17:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:17:07.589929 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feac475-72f5-474f-9f13-de0be2062f68 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:07.599221 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feac475-72f5-474f-9f13-de0be2062f68 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:07.604750 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa027d6-d82b-4180-a476-16c4ac694588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:07.606819 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa027d6-d82b-4180-a476-16c4ac694588 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:07.606819 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa027d6-d82b-4180-a476-16c4ac694588 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:07.606819 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa027d6-d82b-4180-a476-16c4ac694588 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:07.607993 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa027d6-d82b-4180-a476-16c4ac694588 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:07.610124 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa027d6-d82b-4180-a476-16c4ac694588 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:07.774541 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1122/2247] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:17:07 2021] POST /identity/v3/projects => generated 367 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:17:07.778573 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e353941-2830-4c85-9408-013f02f1a6ae admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:07.788288 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e353941-2830-4c85-9408-013f02f1a6ae admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:07.847803 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85267d39-ec9f-45af-b0b8-a61e84f34571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:07.848474 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85267d39-ec9f-45af-b0b8-a61e84f34571 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:07.848862 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85267d39-ec9f-45af-b0b8-a61e84f34571 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:07.849138 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85267d39-ec9f-45af-b0b8-a61e84f34571 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:07.849859 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85267d39-ec9f-45af-b0b8-a61e84f34571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:07.851768 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85267d39-ec9f-45af-b0b8-a61e84f34571 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:07.933557 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1126/2248] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:17:07 2021] POST /identity/v3/users => generated 284 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:17:07.937753 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa027d6-d82b-4180-a476-16c4ac694588 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:07.948692 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa027d6-d82b-4180-a476-16c4ac694588 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:07.953270 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e185c91-f562-4a44-8b2b-8bfc8e072328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:07.953925 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e185c91-f562-4a44-8b2b-8bfc8e072328 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:07.954205 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e185c91-f562-4a44-8b2b-8bfc8e072328 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:07.954519 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e185c91-f562-4a44-8b2b-8bfc8e072328 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:07.955266 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e185c91-f562-4a44-8b2b-8bfc8e072328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:07.957005 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e185c91-f562-4a44-8b2b-8bfc8e072328 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:07.967916 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1123/2249] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:17:07 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:17:07.971990 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85267d39-ec9f-45af-b0b8-a61e84f34571 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:07.985498 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85267d39-ec9f-45af-b0b8-a61e84f34571 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:07.991552 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8b0c8-d0fa-4f9c-8ed6-bacd4c462fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:07.992270 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8b0c8-d0fa-4f9c-8ed6-bacd4c462fcb admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:07.992641 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8b0c8-d0fa-4f9c-8ed6-bacd4c462fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:07.992981 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8b0c8-d0fa-4f9c-8ed6-bacd4c462fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:07.993706 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8b0c8-d0fa-4f9c-8ed6-bacd4c462fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:07.995454 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8b0c8-d0fa-4f9c-8ed6-bacd4c462fcb admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:08.006219 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1127/2250] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:17:07 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:17:08.010715 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e185c91-f562-4a44-8b2b-8bfc8e072328 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:08.021256 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e185c91-f562-4a44-8b2b-8bfc8e072328 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:08.026031 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b4580-9c4f-4fea-9c0d-9b770ee75314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:08.027107 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b4580-9c4f-4fea-9c0d-9b770ee75314 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:08.027390 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b4580-9c4f-4fea-9c0d-9b770ee75314 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:08.027666 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b4580-9c4f-4fea-9c0d-9b770ee75314 admin admin] PATH_INFO: `/v3/projects/7823b6cc745e4d2292486364e4b9d31b/users/c2991cb610994df7be9f44cb0e23d5e0/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:08.043028 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b4580-9c4f-4fea-9c0d-9b770ee75314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7823b6cc745e4d2292486364e4b9d31b, user_id=c2991cb610994df7be9f44cb0e23d5e0, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:08.045928 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b4580-9c4f-4fea-9c0d-9b770ee75314 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:08.138608 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1124/2251] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:17:08 2021] PUT /identity/v3/projects/7823b6cc745e4d2292486364e4b9d31b/users/c2991cb610994df7be9f44cb0e23d5e0/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:17:08.150370 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a66822-ee01-4d28-9951-e113e44fe90d None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:08.150663 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a66822-ee01-4d28-9951-e113e44fe90d None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:08.150944 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a66822-ee01-4d28-9951-e113e44fe90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:08.183587 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-38a66822-ee01-4d28-9951-e113e44fe90d None None] MFA Rules not processed for user `c2991cb610994df7be9f44cb0e23d5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:08.184930 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-38a66822-ee01-4d28-9951-e113e44fe90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:08.273956 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1128/2252] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:08 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:17:08.284852 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b4580-9c4f-4fea-9c0d-9b770ee75314 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:08.286601 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-9a3b4580-9c4f-4fea-9c0d-9b770ee75314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:08.342767 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b4580-9c4f-4fea-9c0d-9b770ee75314 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:08.346524 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68038ba0-aa3b-4de2-86a1-42dbe1b9b00a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:08.347183 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68038ba0-aa3b-4de2-86a1-42dbe1b9b00a service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:08.347470 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68038ba0-aa3b-4de2-86a1-42dbe1b9b00a service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:08.347753 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68038ba0-aa3b-4de2-86a1-42dbe1b9b00a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:08.356682 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68038ba0-aa3b-4de2-86a1-42dbe1b9b00a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:08.358400 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68038ba0-aa3b-4de2-86a1-42dbe1b9b00a service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:08.369241 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1125/2253] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:17:08 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:17:20.643961 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67a0ba-c729-40cd-ad5f-24d39a33b029 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:20.644477 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67a0ba-c729-40cd-ad5f-24d39a33b029 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:20.644848 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67a0ba-c729-40cd-ad5f-24d39a33b029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:20.706216 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-7d67a0ba-c729-40cd-ad5f-24d39a33b029 None None] MFA Rules not processed for user `96c9b76133d74b79a0d2da9a884651e1`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:20.716847 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-7d67a0ba-c729-40cd-ad5f-24d39a33b029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:20.784280 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1129/2254] 10.222.0.23 () {58 vars in 1010 bytes} [Thu Sep 23 03:17:20 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:17:21.098141 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68038ba0-aa3b-4de2-86a1-42dbe1b9b00a service cinder] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:21.099913 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-68038ba0-aa3b-4de2-86a1-42dbe1b9b00a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:21.191685 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68038ba0-aa3b-4de2-86a1-42dbe1b9b00a service cinder] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:21.197015 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0af3d-da05-452b-bad3-25491a3a01f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df051fd059b34fe0993f501546d1610f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:21.197686 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0af3d-da05-452b-bad3-25491a3a01f4 service swift] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:21.197973 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0af3d-da05-452b-bad3-25491a3a01f4 service swift] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:21.198251 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0af3d-da05-452b-bad3-25491a3a01f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:21.206787 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0af3d-da05-452b-bad3-25491a3a01f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:21.208382 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0af3d-da05-452b-bad3-25491a3a01f4 service swift] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:21.216285 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1126/2255] 10.222.0.23 () {60 vars in 1385 bytes} [Thu Sep 23 03:17:21 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 03:17:29.212449 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67a0ba-c729-40cd-ad5f-24d39a33b029 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:29.296631 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67a0ba-c729-40cd-ad5f-24d39a33b029 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:29.302267 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd78aed-ac6d-4d94-a20c-8b39ea2a8b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:29.303031 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd78aed-ac6d-4d94-a20c-8b39ea2a8b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:29.303311 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd78aed-ac6d-4d94-a20c-8b39ea2a8b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:29.303603 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd78aed-ac6d-4d94-a20c-8b39ea2a8b9f admin admin] PATH_INFO: `/v3/users/c2991cb610994df7be9f44cb0e23d5e0` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:29.305140 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd78aed-ac6d-4d94-a20c-8b39ea2a8b9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2991cb610994df7be9f44cb0e23d5e0)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:29.310223 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd78aed-ac6d-4d94-a20c-8b39ea2a8b9f admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:29.487647 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-bdd78aed-ac6d-4d94-a20c-8b39ea2a8b9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2991cb610994df7be9f44cb0e23d5e0'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:29.488228 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-bdd78aed-ac6d-4d94-a20c-8b39ea2a8b9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2991cb610994df7be9f44cb0e23d5e0'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:29.496693 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-bdd78aed-ac6d-4d94-a20c-8b39ea2a8b9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2991cb610994df7be9f44cb0e23d5e0'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:29.573383 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-bdd78aed-ac6d-4d94-a20c-8b39ea2a8b9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2991cb610994df7be9f44cb0e23d5e0'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:29.607706 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-bdd78aed-ac6d-4d94-a20c-8b39ea2a8b9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2991cb610994df7be9f44cb0e23d5e0'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:29.619824 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1130/2256] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:17:29 2021] DELETE /identity/v3/users/c2991cb610994df7be9f44cb0e23d5e0 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:17:29.624623 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812a20b-29ca-4656-97bd-119d767a7e8b None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:29.625278 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812a20b-29ca-4656-97bd-119d767a7e8b None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:29.625278 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812a20b-29ca-4656-97bd-119d767a7e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:29.654182 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-e812a20b-29ca-4656-97bd-119d767a7e8b None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:29.655869 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-e812a20b-29ca-4656-97bd-119d767a7e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:29.761699 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1127/2257] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:17:29.776138 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd78aed-ac6d-4d94-a20c-8b39ea2a8b9f admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:29.777941 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-bdd78aed-ac6d-4d94-a20c-8b39ea2a8b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:29.909536 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd78aed-ac6d-4d94-a20c-8b39ea2a8b9f admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:29.920524 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bb3b6-4ac8-4de2-9e7c-0e4900f4dd2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:29.925745 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bb3b6-4ac8-4de2-9e7c-0e4900f4dd2d service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:29.925745 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bb3b6-4ac8-4de2-9e7c-0e4900f4dd2d service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:29.925745 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bb3b6-4ac8-4de2-9e7c-0e4900f4dd2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:29.955118 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0bb3b6-4ac8-4de2-9e7c-0e4900f4dd2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:29.957217 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0bb3b6-4ac8-4de2-9e7c-0e4900f4dd2d service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:29.977003 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1131/2258] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:17:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:17:30.162754 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cb7de-ae5b-4d9e-885c-94eeecaeeae0 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:30.163055 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cb7de-ae5b-4d9e-885c-94eeecaeeae0 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:30.163665 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cb7de-ae5b-4d9e-885c-94eeecaeeae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:30.191284 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-0b1cb7de-ae5b-4d9e-885c-94eeecaeeae0 None None] MFA Rules not processed for user `96c9b76133d74b79a0d2da9a884651e1`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:30.191523 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-0b1cb7de-ae5b-4d9e-885c-94eeecaeeae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:30.263490 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1128/2259] 10.222.0.23 () {58 vars in 1010 bytes} [Thu Sep 23 03:17:30 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:17:30.277097 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bb3b6-4ac8-4de2-9e7c-0e4900f4dd2d service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:30.278677 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-eb0bb3b6-4ac8-4de2-9e7c-0e4900f4dd2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:30.351892 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bb3b6-4ac8-4de2-9e7c-0e4900f4dd2d service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:30.359841 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17839bce-ecc6-4ce1-a065-46d765253370 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df051fd059b34fe0993f501546d1610f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:30.360553 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17839bce-ecc6-4ce1-a065-46d765253370 service swift] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:30.360836 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17839bce-ecc6-4ce1-a065-46d765253370 service swift] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:30.361111 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17839bce-ecc6-4ce1-a065-46d765253370 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:30.369768 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17839bce-ecc6-4ce1-a065-46d765253370 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:30.371402 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17839bce-ecc6-4ce1-a065-46d765253370 service swift] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:30.384176 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1132/2260] 10.222.0.23 () {60 vars in 1385 bytes} [Thu Sep 23 03:17:30 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 03:17:31.163614 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cb7de-ae5b-4d9e-885c-94eeecaeeae0 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:31.165887 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-0b1cb7de-ae5b-4d9e-885c-94eeecaeeae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:31.196065 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cb7de-ae5b-4d9e-885c-94eeecaeeae0 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:31.205747 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc61d05-6e2b-4e38-90d9-acd079f4d30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:31.207234 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc61d05-6e2b-4e38-90d9-acd079f4d30b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:31.207664 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc61d05-6e2b-4e38-90d9-acd079f4d30b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:31.208136 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc61d05-6e2b-4e38-90d9-acd079f4d30b admin admin] PATH_INFO: `/v3/projects/7823b6cc745e4d2292486364e4b9d31b` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:31.209968 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc61d05-6e2b-4e38-90d9-acd079f4d30b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7823b6cc745e4d2292486364e4b9d31b)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:31.212377 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc61d05-6e2b-4e38-90d9-acd079f4d30b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:31.342812 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-1dc61d05-6e2b-4e38-90d9-acd079f4d30b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7823b6cc745e4d2292486364e4b9d31b', 'request_id': 'req-1dc61d05-6e2b-4e38-90d9-acd079f4d30b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:31.421097 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-1dc61d05-6e2b-4e38-90d9-acd079f4d30b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7823b6cc745e4d2292486364e4b9d31b', 'request_id': 'req-1dc61d05-6e2b-4e38-90d9-acd079f4d30b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:31.428010 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-1dc61d05-6e2b-4e38-90d9-acd079f4d30b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7823b6cc745e4d2292486364e4b9d31b', 'request_id': 'req-1dc61d05-6e2b-4e38-90d9-acd079f4d30b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:31.441264 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-1dc61d05-6e2b-4e38-90d9-acd079f4d30b admin admin] The token cache is being invalidate because project 7823b6cc745e4d2292486364e4b9d31b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:17:31.441582 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-1dc61d05-6e2b-4e38-90d9-acd079f4d30b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:31.442408 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-1dc61d05-6e2b-4e38-90d9-acd079f4d30b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:31.450093 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1129/2261] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:17:31 2021] DELETE /identity/v3/projects/7823b6cc745e4d2292486364e4b9d31b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:17:31.451812 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26252c-75a2-4af0-b357-27fb03cda8bd None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:31.452330 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26252c-75a2-4af0-b357-27fb03cda8bd None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:31.452445 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26252c-75a2-4af0-b357-27fb03cda8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:31.476933 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-1e26252c-75a2-4af0-b357-27fb03cda8bd None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:31.478303 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-1e26252c-75a2-4af0-b357-27fb03cda8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:31.569311 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1133/2262] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:17:31.578136 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c472067-85f0-4ec9-8122-3138a8558b9b None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:31.578994 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c472067-85f0-4ec9-8122-3138a8558b9b None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:31.578994 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c472067-85f0-4ec9-8122-3138a8558b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:31.610709 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-7c472067-85f0-4ec9-8122-3138a8558b9b None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:31.612037 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-7c472067-85f0-4ec9-8122-3138a8558b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:31.623920 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1130/2263] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:17:31.626445 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26252c-75a2-4af0-b357-27fb03cda8bd None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:31.645069 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26252c-75a2-4af0-b357-27fb03cda8bd None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:31.650238 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554728b1-13b8-4a35-9a29-fbc59bac2bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:31.651611 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554728b1-13b8-4a35-9a29-fbc59bac2bdf admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:31.652062 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554728b1-13b8-4a35-9a29-fbc59bac2bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:31.652522 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554728b1-13b8-4a35-9a29-fbc59bac2bdf admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:31.653424 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554728b1-13b8-4a35-9a29-fbc59bac2bdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:17:31.654302 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554728b1-13b8-4a35-9a29-fbc59bac2bdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:31.656082 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554728b1-13b8-4a35-9a29-fbc59bac2bdf admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:31.671849 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1134/2264] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:17:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:17:31.675649 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c472067-85f0-4ec9-8122-3138a8558b9b None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:31.695015 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c472067-85f0-4ec9-8122-3138a8558b9b None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:31.713159 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a144011-f72e-4f86-afc7-514ef14b57b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:31.714339 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a144011-f72e-4f86-afc7-514ef14b57b1 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:31.714622 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a144011-f72e-4f86-afc7-514ef14b57b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:31.714902 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a144011-f72e-4f86-afc7-514ef14b57b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:31.715774 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a144011-f72e-4f86-afc7-514ef14b57b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:31.717705 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a144011-f72e-4f86-afc7-514ef14b57b1 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:31.864911 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1131/2265] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:17:31 2021] POST /identity/v3/projects => generated 375 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:17:31.866557 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554728b1-13b8-4a35-9a29-fbc59bac2bdf admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:31.887406 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554728b1-13b8-4a35-9a29-fbc59bac2bdf admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:31.994630 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0da86-c473-497c-8ff5-9e8f51da3096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:31.995244 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0da86-c473-497c-8ff5-9e8f51da3096 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:31.995528 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0da86-c473-497c-8ff5-9e8f51da3096 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:31.995850 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0da86-c473-497c-8ff5-9e8f51da3096 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:31.996624 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf0da86-c473-497c-8ff5-9e8f51da3096 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:31.998542 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf0da86-c473-497c-8ff5-9e8f51da3096 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:32.128240 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1135/2266] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:17:31 2021] POST /identity/v3/users => generated 288 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:17:32.150227 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a144011-f72e-4f86-afc7-514ef14b57b1 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:32.167858 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a144011-f72e-4f86-afc7-514ef14b57b1 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:32.175708 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96b8a4-1217-47a5-9b31-7c3bfc148416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:32.176819 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96b8a4-1217-47a5-9b31-7c3bfc148416 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:32.177211 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96b8a4-1217-47a5-9b31-7c3bfc148416 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:32.177594 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96b8a4-1217-47a5-9b31-7c3bfc148416 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:32.178496 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96b8a4-1217-47a5-9b31-7c3bfc148416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:32.180204 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96b8a4-1217-47a5-9b31-7c3bfc148416 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:32.213934 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1132/2267] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:17:32 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:17:32.217760 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0da86-c473-497c-8ff5-9e8f51da3096 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:32.235549 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0da86-c473-497c-8ff5-9e8f51da3096 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:32.249882 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a013f-6efd-424e-974d-4407062162f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:32.250528 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a013f-6efd-424e-974d-4407062162f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:32.251427 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a013f-6efd-424e-974d-4407062162f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:32.251785 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a013f-6efd-424e-974d-4407062162f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:32.252625 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a013f-6efd-424e-974d-4407062162f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:32.254323 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a013f-6efd-424e-974d-4407062162f5 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:32.265153 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1136/2268] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:17:32 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:17:32.278838 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96b8a4-1217-47a5-9b31-7c3bfc148416 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:32.286000 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96b8a4-1217-47a5-9b31-7c3bfc148416 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:32.294951 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d994d9-c76a-4b4f-abf3-8822b3e5f0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:32.295913 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d994d9-c76a-4b4f-abf3-8822b3e5f0a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:32.296210 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d994d9-c76a-4b4f-abf3-8822b3e5f0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:32.296517 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d994d9-c76a-4b4f-abf3-8822b3e5f0a5 admin admin] PATH_INFO: `/v3/projects/e0b3c75715cd4ef18c860167b22f77c0/users/66548be88b9a42d78c43531e2dffdaef/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:32.313937 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d994d9-c76a-4b4f-abf3-8822b3e5f0a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0b3c75715cd4ef18c860167b22f77c0, user_id=66548be88b9a42d78c43531e2dffdaef, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:32.318373 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d994d9-c76a-4b4f-abf3-8822b3e5f0a5 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:32.416020 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1133/2269] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:17:32 2021] PUT /identity/v3/projects/e0b3c75715cd4ef18c860167b22f77c0/users/66548be88b9a42d78c43531e2dffdaef/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:17:32.426192 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d8fb0-2525-4561-a5e3-12d6fbc506db None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:32.426486 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d8fb0-2525-4561-a5e3-12d6fbc506db None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:32.426767 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d8fb0-2525-4561-a5e3-12d6fbc506db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:32.459882 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-508d8fb0-2525-4561-a5e3-12d6fbc506db None None] MFA Rules not processed for user `66548be88b9a42d78c43531e2dffdaef`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:32.461145 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-508d8fb0-2525-4561-a5e3-12d6fbc506db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:32.559419 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1137/2270] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:32 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:17:32.572612 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d994d9-c76a-4b4f-abf3-8822b3e5f0a5 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:32.574513 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-56d994d9-c76a-4b4f-abf3-8822b3e5f0a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:32.658170 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d994d9-c76a-4b4f-abf3-8822b3e5f0a5 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:32.664727 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ee52e-7049-4fe3-abcc-a7c8fd2a20da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:32.665900 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ee52e-7049-4fe3-abcc-a7c8fd2a20da service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:32.666329 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ee52e-7049-4fe3-abcc-a7c8fd2a20da service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:32.667002 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ee52e-7049-4fe3-abcc-a7c8fd2a20da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:32.681414 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ee52e-7049-4fe3-abcc-a7c8fd2a20da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:32.684538 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ee52e-7049-4fe3-abcc-a7c8fd2a20da service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:32.701860 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1134/2271] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:17:32 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:17:32.921216 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d8fb0-2525-4561-a5e3-12d6fbc506db None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:32.984875 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d8fb0-2525-4561-a5e3-12d6fbc506db None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:32.989582 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec79bab-3431-433b-b687-883084ba34f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:32.990445 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec79bab-3431-433b-b687-883084ba34f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:32.990725 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec79bab-3431-433b-b687-883084ba34f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:32.990996 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec79bab-3431-433b-b687-883084ba34f9 admin admin] PATH_INFO: `/v3/users/66548be88b9a42d78c43531e2dffdaef` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:32.992169 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec79bab-3431-433b-b687-883084ba34f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66548be88b9a42d78c43531e2dffdaef)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:32.994102 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec79bab-3431-433b-b687-883084ba34f9 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:33.181075 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-bec79bab-3431-433b-b687-883084ba34f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66548be88b9a42d78c43531e2dffdaef'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:33.181722 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-bec79bab-3431-433b-b687-883084ba34f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66548be88b9a42d78c43531e2dffdaef'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:33.188285 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-bec79bab-3431-433b-b687-883084ba34f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66548be88b9a42d78c43531e2dffdaef'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:33.252721 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-bec79bab-3431-433b-b687-883084ba34f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66548be88b9a42d78c43531e2dffdaef'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:33.265175 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-bec79bab-3431-433b-b687-883084ba34f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66548be88b9a42d78c43531e2dffdaef'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:33.271626 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1138/2272] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:17:32 2021] DELETE /identity/v3/users/66548be88b9a42d78c43531e2dffdaef => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:17:33.276284 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ddf28-ab96-49c1-94f4-36c38b46196e None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:33.282634 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ddf28-ab96-49c1-94f4-36c38b46196e None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:33.282634 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ddf28-ab96-49c1-94f4-36c38b46196e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:33.295566 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-360ddf28-ab96-49c1-94f4-36c38b46196e None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:33.297015 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-360ddf28-ab96-49c1-94f4-36c38b46196e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:33.382850 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1135/2273] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:17:33.393963 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec79bab-3431-433b-b687-883084ba34f9 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:33.395741 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-bec79bab-3431-433b-b687-883084ba34f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:33.476930 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec79bab-3431-433b-b687-883084ba34f9 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:33.481093 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd95aad-fd1d-4926-81f4-ff9c3a7c4a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:33.482219 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd95aad-fd1d-4926-81f4-ff9c3a7c4a00 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:33.482636 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd95aad-fd1d-4926-81f4-ff9c3a7c4a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:33.483038 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd95aad-fd1d-4926-81f4-ff9c3a7c4a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:33.494900 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd95aad-fd1d-4926-81f4-ff9c3a7c4a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:33.496675 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd95aad-fd1d-4926-81f4-ff9c3a7c4a00 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:33.507706 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1139/2274] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:17:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:17:34.067977 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ddf28-ab96-49c1-94f4-36c38b46196e None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:34.070418 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-360ddf28-ab96-49c1-94f4-36c38b46196e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:34.088311 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ddf28-ab96-49c1-94f4-36c38b46196e None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:34.103450 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c8e53-f21a-432b-b870-3c0efffff3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:34.104539 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c8e53-f21a-432b-b870-3c0efffff3e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:34.104805 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c8e53-f21a-432b-b870-3c0efffff3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:34.105128 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c8e53-f21a-432b-b870-3c0efffff3e6 admin admin] PATH_INFO: `/v3/projects/e0b3c75715cd4ef18c860167b22f77c0` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:34.106607 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c8e53-f21a-432b-b870-3c0efffff3e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0b3c75715cd4ef18c860167b22f77c0)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:34.111705 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c8e53-f21a-432b-b870-3c0efffff3e6 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:34.244431 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-151c8e53-f21a-432b-b870-3c0efffff3e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0b3c75715cd4ef18c860167b22f77c0', 'request_id': 'req-151c8e53-f21a-432b-b870-3c0efffff3e6'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:34.298643 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-151c8e53-f21a-432b-b870-3c0efffff3e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0b3c75715cd4ef18c860167b22f77c0', 'request_id': 'req-151c8e53-f21a-432b-b870-3c0efffff3e6'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:34.304710 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-151c8e53-f21a-432b-b870-3c0efffff3e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0b3c75715cd4ef18c860167b22f77c0', 'request_id': 'req-151c8e53-f21a-432b-b870-3c0efffff3e6'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:34.315550 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-151c8e53-f21a-432b-b870-3c0efffff3e6 admin admin] The token cache is being invalidate because project e0b3c75715cd4ef18c860167b22f77c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:17:34.316050 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-151c8e53-f21a-432b-b870-3c0efffff3e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:34.316935 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-151c8e53-f21a-432b-b870-3c0efffff3e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:34.318971 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1136/2275] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:17:34 2021] DELETE /identity/v3/projects/e0b3c75715cd4ef18c860167b22f77c0 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:17:34.324613 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc26cc9-76e4-4603-a754-46014f65bdce None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:34.324909 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc26cc9-76e4-4603-a754-46014f65bdce None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:34.325195 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc26cc9-76e4-4603-a754-46014f65bdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:34.345368 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-afc26cc9-76e4-4603-a754-46014f65bdce None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:34.346605 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-afc26cc9-76e4-4603-a754-46014f65bdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:34.407011 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1140/2276] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:17:34.415601 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fef7e-2967-4ca5-b37a-3ba1b7b4c6ff None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:34.415894 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fef7e-2967-4ca5-b37a-3ba1b7b4c6ff None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:34.416179 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fef7e-2967-4ca5-b37a-3ba1b7b4c6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:34.434272 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-6b3fef7e-2967-4ca5-b37a-3ba1b7b4c6ff None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:34.435478 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-6b3fef7e-2967-4ca5-b37a-3ba1b7b4c6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:34.444138 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1137/2277] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:17:34.448458 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc26cc9-76e4-4603-a754-46014f65bdce None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:34.458433 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc26cc9-76e4-4603-a754-46014f65bdce None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:34.465034 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13de8d-c079-4211-a175-25443bfcf986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:34.465969 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13de8d-c079-4211-a175-25443bfcf986 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:34.466419 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13de8d-c079-4211-a175-25443bfcf986 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:34.466699 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13de8d-c079-4211-a175-25443bfcf986 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:34.467745 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13de8d-c079-4211-a175-25443bfcf986 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:17:34.468325 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13de8d-c079-4211-a175-25443bfcf986 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:34.471659 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13de8d-c079-4211-a175-25443bfcf986 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:34.502476 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fef7e-2967-4ca5-b37a-3ba1b7b4c6ff None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:34.502916 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1141/2278] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:17:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:17:34.513984 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fef7e-2967-4ca5-b37a-3ba1b7b4c6ff None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:34.533006 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1132d-8979-43b8-8dc1-9e2a96a81653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:34.533855 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1132d-8979-43b8-8dc1-9e2a96a81653 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:34.534249 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1132d-8979-43b8-8dc1-9e2a96a81653 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:34.534724 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1132d-8979-43b8-8dc1-9e2a96a81653 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:34.535541 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1132d-8979-43b8-8dc1-9e2a96a81653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:34.537931 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1132d-8979-43b8-8dc1-9e2a96a81653 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:34.712411 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1138/2279] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:17:34 2021] POST /identity/v3/projects => generated 355 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:17:34.767738 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13de8d-c079-4211-a175-25443bfcf986 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:34.779206 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13de8d-c079-4211-a175-25443bfcf986 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:34.857666 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047183c9-6f5b-444b-9a54-df703d6245f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:34.858265 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047183c9-6f5b-444b-9a54-df703d6245f2 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:34.858544 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047183c9-6f5b-444b-9a54-df703d6245f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:34.858816 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047183c9-6f5b-444b-9a54-df703d6245f2 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:34.859490 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047183c9-6f5b-444b-9a54-df703d6245f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:34.861459 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047183c9-6f5b-444b-9a54-df703d6245f2 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:34.957220 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1142/2280] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:17:34 2021] POST /identity/v3/users => generated 278 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:17:34.958399 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1132d-8979-43b8-8dc1-9e2a96a81653 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:34.972987 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1132d-8979-43b8-8dc1-9e2a96a81653 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:34.978008 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f61b5-1488-4088-bc5f-f4d7e8fae976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:34.978686 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f61b5-1488-4088-bc5f-f4d7e8fae976 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:34.978976 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f61b5-1488-4088-bc5f-f4d7e8fae976 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:34.979254 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f61b5-1488-4088-bc5f-f4d7e8fae976 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:34.980021 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f61b5-1488-4088-bc5f-f4d7e8fae976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:34.983820 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f61b5-1488-4088-bc5f-f4d7e8fae976 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:35.000452 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1139/2281] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:17:34 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:17:35.004687 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047183c9-6f5b-444b-9a54-df703d6245f2 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:35.015734 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047183c9-6f5b-444b-9a54-df703d6245f2 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:35.023755 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a85c1d-053e-442f-945c-72d8f3c19783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:35.024441 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a85c1d-053e-442f-945c-72d8f3c19783 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:35.024888 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a85c1d-053e-442f-945c-72d8f3c19783 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:35.025100 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a85c1d-053e-442f-945c-72d8f3c19783 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:35.025746 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a85c1d-053e-442f-945c-72d8f3c19783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:35.027345 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a85c1d-053e-442f-945c-72d8f3c19783 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:35.040541 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1143/2282] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:17:35 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:17:35.044066 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f61b5-1488-4088-bc5f-f4d7e8fae976 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:35.054563 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f61b5-1488-4088-bc5f-f4d7e8fae976 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:35.059327 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51bc6a-7424-4f72-be5d-3ce66f646ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:35.060218 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51bc6a-7424-4f72-be5d-3ce66f646ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:35.060675 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51bc6a-7424-4f72-be5d-3ce66f646ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:35.060956 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51bc6a-7424-4f72-be5d-3ce66f646ec5 admin admin] PATH_INFO: `/v3/projects/3e58ec06f1e646419f6cc969e98658aa/users/c51af46549f342cb8395fea0684a95f1/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:35.082146 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51bc6a-7424-4f72-be5d-3ce66f646ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e58ec06f1e646419f6cc969e98658aa, user_id=c51af46549f342cb8395fea0684a95f1, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:35.083659 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51bc6a-7424-4f72-be5d-3ce66f646ec5 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:35.163197 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1140/2283] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:17:35 2021] PUT /identity/v3/projects/3e58ec06f1e646419f6cc969e98658aa/users/c51af46549f342cb8395fea0684a95f1/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:17:35.174367 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05428e2e-8d4e-4368-b5c5-431e15cbd1da None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:35.174771 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05428e2e-8d4e-4368-b5c5-431e15cbd1da None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:35.175126 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05428e2e-8d4e-4368-b5c5-431e15cbd1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:35.204689 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-05428e2e-8d4e-4368-b5c5-431e15cbd1da None None] MFA Rules not processed for user `c51af46549f342cb8395fea0684a95f1`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:35.206180 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-05428e2e-8d4e-4368-b5c5-431e15cbd1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:35.318766 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1144/2284] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:35 2021] POST /identity/v3/auth/tokens => generated 3375 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:17:35.323425 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51bc6a-7424-4f72-be5d-3ce66f646ec5 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:35.407724 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51bc6a-7424-4f72-be5d-3ce66f646ec5 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:35.413347 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4b65c-0e6a-4bfb-994b-176f91144a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:35.414336 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4b65c-0e6a-4bfb-994b-176f91144a60 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:35.414795 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4b65c-0e6a-4bfb-994b-176f91144a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:35.415359 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4b65c-0e6a-4bfb-994b-176f91144a60 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:35.416225 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4b65c-0e6a-4bfb-994b-176f91144a60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:35.418883 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4b65c-0e6a-4bfb-994b-176f91144a60 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:35.488612 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1141/2285] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:17:35 2021] POST /identity/v3/projects => generated 355 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:17:35.489954 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05428e2e-8d4e-4368-b5c5-431e15cbd1da None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:35.503243 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05428e2e-8d4e-4368-b5c5-431e15cbd1da None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:35.563752 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af391b57-ea15-4e30-9278-72e06747cc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:35.564450 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af391b57-ea15-4e30-9278-72e06747cc89 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:35.564766 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af391b57-ea15-4e30-9278-72e06747cc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:35.565044 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af391b57-ea15-4e30-9278-72e06747cc89 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:35.565755 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af391b57-ea15-4e30-9278-72e06747cc89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:35.567686 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af391b57-ea15-4e30-9278-72e06747cc89 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:35.644904 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1145/2286] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:17:35 2021] POST /identity/v3/users => generated 284 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:17:35.648670 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4b65c-0e6a-4bfb-994b-176f91144a60 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:35.659827 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4b65c-0e6a-4bfb-994b-176f91144a60 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:35.665555 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a64675-3a05-4556-a09a-09ccfd65f103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:35.666633 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a64675-3a05-4556-a09a-09ccfd65f103 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:35.667084 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a64675-3a05-4556-a09a-09ccfd65f103 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:35.667524 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a64675-3a05-4556-a09a-09ccfd65f103 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:35.668586 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a64675-3a05-4556-a09a-09ccfd65f103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:35.670354 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a64675-3a05-4556-a09a-09ccfd65f103 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:35.684229 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1142/2287] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:17:35 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:17:35.688258 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af391b57-ea15-4e30-9278-72e06747cc89 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:35.700855 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af391b57-ea15-4e30-9278-72e06747cc89 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:35.724048 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012b658-f3ba-4952-9965-7de07c91f8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:35.725000 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012b658-f3ba-4952-9965-7de07c91f8f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:35.726769 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012b658-f3ba-4952-9965-7de07c91f8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:35.726769 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012b658-f3ba-4952-9965-7de07c91f8f5 admin admin] PATH_INFO: `/v3/projects/83548b9f55574ee2860166b19c85c959/users/bfe715fa235b48eb82d3152a00daaa91/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:35.743097 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012b658-f3ba-4952-9965-7de07c91f8f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83548b9f55574ee2860166b19c85c959, user_id=bfe715fa235b48eb82d3152a00daaa91, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:35.746411 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012b658-f3ba-4952-9965-7de07c91f8f5 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:35.835109 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1146/2288] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:17:35 2021] PUT /identity/v3/projects/83548b9f55574ee2860166b19c85c959/users/bfe715fa235b48eb82d3152a00daaa91/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:17:35.839078 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a64675-3a05-4556-a09a-09ccfd65f103 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:35.868622 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a64675-3a05-4556-a09a-09ccfd65f103 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:35.980825 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5758b7f-3221-4e96-afdb-5e0e20843728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:35.982462 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5758b7f-3221-4e96-afdb-5e0e20843728 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:35.982789 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5758b7f-3221-4e96-afdb-5e0e20843728 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:35.983151 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5758b7f-3221-4e96-afdb-5e0e20843728 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:35.983999 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5758b7f-3221-4e96-afdb-5e0e20843728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:35.986729 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5758b7f-3221-4e96-afdb-5e0e20843728 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:35.999829 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1143/2289] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:17:35 2021] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:17:36.005090 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012b658-f3ba-4952-9965-7de07c91f8f5 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:36.024299 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012b658-f3ba-4952-9965-7de07c91f8f5 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:36.036352 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9d838-87f3-470e-9cff-d2961cc34da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:36.036352 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9d838-87f3-470e-9cff-d2961cc34da2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:36.036352 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9d838-87f3-470e-9cff-d2961cc34da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:36.036743 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9d838-87f3-470e-9cff-d2961cc34da2 admin admin] PATH_INFO: `/v3/projects/83548b9f55574ee2860166b19c85c959/users/bfe715fa235b48eb82d3152a00daaa91/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:36.039669 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9d838-87f3-470e-9cff-d2961cc34da2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83548b9f55574ee2860166b19c85c959, user_id=bfe715fa235b48eb82d3152a00daaa91, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:36.044614 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9d838-87f3-470e-9cff-d2961cc34da2 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:36.057435 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1147/2290] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:17:36 2021] PUT /identity/v3/projects/83548b9f55574ee2860166b19c85c959/users/bfe715fa235b48eb82d3152a00daaa91/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:17:36.068823 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fc6fc-8335-4513-a51b-afac46073052 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:36.069686 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fc6fc-8335-4513-a51b-afac46073052 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:36.070908 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fc6fc-8335-4513-a51b-afac46073052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:36.113633 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-cd3fc6fc-8335-4513-a51b-afac46073052 None None] MFA Rules not processed for user `bfe715fa235b48eb82d3152a00daaa91`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:36.114991 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-cd3fc6fc-8335-4513-a51b-afac46073052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:36.190240 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1144/2291] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:36 2021] POST /identity/v3/auth/tokens => generated 3442 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:17:36.202115 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9d838-87f3-470e-9cff-d2961cc34da2 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:36.203860 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-8fa9d838-87f3-470e-9cff-d2961cc34da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:36.263955 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9d838-87f3-470e-9cff-d2961cc34da2 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:36.268677 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213520e-fdfe-4bfd-a31e-3e05a1911733 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:36.269469 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213520e-fdfe-4bfd-a31e-3e05a1911733 service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:36.270036 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213520e-fdfe-4bfd-a31e-3e05a1911733 service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:36.270422 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213520e-fdfe-4bfd-a31e-3e05a1911733 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:36.280607 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213520e-fdfe-4bfd-a31e-3e05a1911733 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:36.282428 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213520e-fdfe-4bfd-a31e-3e05a1911733 service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:36.294884 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1148/2292] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:17:36 2021] GET /identity/v3/auth/tokens => generated 3442 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:17:36.460965 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fc6fc-8335-4513-a51b-afac46073052 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:36.474983 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fc6fc-8335-4513-a51b-afac46073052 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:36.479294 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8458e9b-ee58-4715-8198-fae747831fda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:36.480227 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8458e9b-ee58-4715-8198-fae747831fda service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:36.480782 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8458e9b-ee58-4715-8198-fae747831fda service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:36.481268 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8458e9b-ee58-4715-8198-fae747831fda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:36.551235 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8458e9b-ee58-4715-8198-fae747831fda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:36.552718 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8458e9b-ee58-4715-8198-fae747831fda service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:36.572878 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1145/2293] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:17:36 2021] GET /identity/v3/auth/tokens => generated 3375 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:17:39.724757 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213520e-fdfe-4bfd-a31e-3e05a1911733 service cinder] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:39.726408 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-b213520e-fdfe-4bfd-a31e-3e05a1911733 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:39.839320 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213520e-fdfe-4bfd-a31e-3e05a1911733 service cinder] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:39.845020 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8ab67-58b8-4dce-93ed-af069e411720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:39.846207 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8ab67-58b8-4dce-93ed-af069e411720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:39.846761 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8ab67-58b8-4dce-93ed-af069e411720 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:39.847273 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8ab67-58b8-4dce-93ed-af069e411720 admin admin] PATH_INFO: `/v3/users/36893da01a1845f5af4921a298abb9eb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:39.848705 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8ab67-58b8-4dce-93ed-af069e411720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36893da01a1845f5af4921a298abb9eb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:39.850739 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8ab67-58b8-4dce-93ed-af069e411720 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:40.012125 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-26a8ab67-58b8-4dce-93ed-af069e411720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36893da01a1845f5af4921a298abb9eb'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:40.013269 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-26a8ab67-58b8-4dce-93ed-af069e411720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36893da01a1845f5af4921a298abb9eb'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:40.021080 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-26a8ab67-58b8-4dce-93ed-af069e411720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36893da01a1845f5af4921a298abb9eb'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:40.162952 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-26a8ab67-58b8-4dce-93ed-af069e411720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36893da01a1845f5af4921a298abb9eb'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:40.178389 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-26a8ab67-58b8-4dce-93ed-af069e411720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36893da01a1845f5af4921a298abb9eb'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:40.184847 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1149/2294] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:17:39 2021] DELETE /identity/v3/users/36893da01a1845f5af4921a298abb9eb => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:17:40.347836 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a69705-4402-40ac-80a4-015d384d9a90 None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:40.348903 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a69705-4402-40ac-80a4-015d384d9a90 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:40.349372 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a69705-4402-40ac-80a4-015d384d9a90 None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:40.352556 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1146/2295] 10.222.0.23 () {54 vars in 921 bytes} [Thu Sep 23 03:17:40 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:17:40.359060 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eadea1-eded-4fc5-ace0-7a5f042dc2fe None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:40.359585 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eadea1-eded-4fc5-ace0-7a5f042dc2fe None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:40.360058 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eadea1-eded-4fc5-ace0-7a5f042dc2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:40.431414 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-05eadea1-eded-4fc5-ace0-7a5f042dc2fe None None] MFA Rules not processed for user `83aa47f723434143b22aac1b96b6a610`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:40.432855 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-05eadea1-eded-4fc5-ace0-7a5f042dc2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:40.538176 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1150/2296] 10.222.0.23 () {58 vars in 1019 bytes} [Thu Sep 23 03:17:40 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:17:40.553357 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a69705-4402-40ac-80a4-015d384d9a90 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:40.558039 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-39a69705-4402-40ac-80a4-015d384d9a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:40.611226 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eadea1-eded-4fc5-ace0-7a5f042dc2fe None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:40.615283 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-05eadea1-eded-4fc5-ace0-7a5f042dc2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:40.665814 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a69705-4402-40ac-80a4-015d384d9a90 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:40.678168 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b246f-1e97-4c57-854c-cdb576a23fd3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83242c1ef12d4a5b800e67346f4ad963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:40.678861 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b246f-1e97-4c57-854c-cdb576a23fd3 service glance] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:40.679146 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b246f-1e97-4c57-854c-cdb576a23fd3 service glance] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:40.679429 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b246f-1e97-4c57-854c-cdb576a23fd3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:40.694149 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b246f-1e97-4c57-854c-cdb576a23fd3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:40.696310 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b246f-1e97-4c57-854c-cdb576a23fd3 service glance] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:40.703368 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eadea1-eded-4fc5-ace0-7a5f042dc2fe None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:40.707577 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1147/2297] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:17:40 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:17:40.727534 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe193d-6144-4ea2-a2a1-5de0b793b6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:40.728530 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe193d-6144-4ea2-a2a1-5de0b793b6e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:40.729052 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe193d-6144-4ea2-a2a1-5de0b793b6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:40.729510 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe193d-6144-4ea2-a2a1-5de0b793b6e9 admin admin] PATH_INFO: `/v3/projects/3a0db8b321a54de5ae011d51e6e69a58` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:40.730920 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe193d-6144-4ea2-a2a1-5de0b793b6e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a0db8b321a54de5ae011d51e6e69a58)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:40.733303 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe193d-6144-4ea2-a2a1-5de0b793b6e9 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:40.935294 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3712826-4411-421c-864b-0aaf679b1cde None None] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:40.935918 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3712826-4411-421c-864b-0aaf679b1cde None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:40.936284 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3712826-4411-421c-864b-0aaf679b1cde None None] PATH_INFO: `/` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:40.938990 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1148/2298] 10.222.0.23 () {54 vars in 921 bytes} [Thu Sep 23 03:17:40 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:17:40.944954 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35384382-2ac7-4924-a389-5f9919120980 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:40.945624 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35384382-2ac7-4924-a389-5f9919120980 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:40.946153 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35384382-2ac7-4924-a389-5f9919120980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:40.975903 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-2cbe193d-6144-4ea2-a2a1-5de0b793b6e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a0db8b321a54de5ae011d51e6e69a58', 'request_id': 'req-2cbe193d-6144-4ea2-a2a1-5de0b793b6e9'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:40.988740 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-35384382-2ac7-4924-a389-5f9919120980 None None] MFA Rules not processed for user `621e97bd0914448c8afadba25510053d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:41.007364 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-35384382-2ac7-4924-a389-5f9919120980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:41.051252 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1149/2299] 10.222.0.23 () {58 vars in 1019 bytes} [Thu Sep 23 03:17:40 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:17:41.065451 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35384382-2ac7-4924-a389-5f9919120980 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:41.066916 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-35384382-2ac7-4924-a389-5f9919120980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:41.075593 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-2cbe193d-6144-4ea2-a2a1-5de0b793b6e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a0db8b321a54de5ae011d51e6e69a58', 'request_id': 'req-2cbe193d-6144-4ea2-a2a1-5de0b793b6e9'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:41.080224 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35384382-2ac7-4924-a389-5f9919120980 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:41.083562 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-2cbe193d-6144-4ea2-a2a1-5de0b793b6e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a0db8b321a54de5ae011d51e6e69a58', 'request_id': 'req-2cbe193d-6144-4ea2-a2a1-5de0b793b6e9'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:41.085856 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7fa52-2bbc-421c-b2b6-9b90ff983c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:41.086761 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7fa52-2bbc-421c-b2b6-9b90ff983c12 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:41.087154 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7fa52-2bbc-421c-b2b6-9b90ff983c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:41.087528 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7fa52-2bbc-421c-b2b6-9b90ff983c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:41.096975 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7fa52-2bbc-421c-b2b6-9b90ff983c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:41.101792 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7fa52-2bbc-421c-b2b6-9b90ff983c12 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:41.101929 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-2cbe193d-6144-4ea2-a2a1-5de0b793b6e9 admin admin] The token cache is being invalidate because project 3a0db8b321a54de5ae011d51e6e69a58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:17:41.101929 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-2cbe193d-6144-4ea2-a2a1-5de0b793b6e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:41.101929 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-2cbe193d-6144-4ea2-a2a1-5de0b793b6e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:41.106764 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1151/2300] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:17:40 2021] DELETE /identity/v3/projects/3a0db8b321a54de5ae011d51e6e69a58 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:17:41.107397 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1150/2301] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:17:41 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:17:41.108742 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55881f-2151-44c6-b1f3-f0cb963c79eb None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:41.109032 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55881f-2151-44c6-b1f3-f0cb963c79eb None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:41.109307 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55881f-2151-44c6-b1f3-f0cb963c79eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:41.142533 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-be55881f-2151-44c6-b1f3-f0cb963c79eb None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:41.143786 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-be55881f-2151-44c6-b1f3-f0cb963c79eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:41.236240 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1152/2302] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:17:41.243817 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4acaf7-62a4-44ea-ba9f-1821bd436e49 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:41.245040 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4acaf7-62a4-44ea-ba9f-1821bd436e49 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:41.245040 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4acaf7-62a4-44ea-ba9f-1821bd436e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:41.296508 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-1d4acaf7-62a4-44ea-ba9f-1821bd436e49 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:41.296508 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-1d4acaf7-62a4-44ea-ba9f-1821bd436e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:41.304260 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1151/2303] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:17:41.308780 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55881f-2151-44c6-b1f3-f0cb963c79eb None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:41.319098 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55881f-2151-44c6-b1f3-f0cb963c79eb None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:41.324250 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2878f-ba2d-4202-b10b-84d83f3ab898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:41.324952 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2878f-ba2d-4202-b10b-84d83f3ab898 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:41.336262 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2878f-ba2d-4202-b10b-84d83f3ab898 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:41.336262 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2878f-ba2d-4202-b10b-84d83f3ab898 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:41.336262 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2878f-ba2d-4202-b10b-84d83f3ab898 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:17:41.336262 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2878f-ba2d-4202-b10b-84d83f3ab898 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:41.336262 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2878f-ba2d-4202-b10b-84d83f3ab898 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:41.343700 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1153/2304] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:17:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 03:17:41.345160 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4acaf7-62a4-44ea-ba9f-1821bd436e49 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:41.354490 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4acaf7-62a4-44ea-ba9f-1821bd436e49 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:41.359756 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c714a2c-a642-4b39-9953-42b92eb911ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:41.361043 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c714a2c-a642-4b39-9953-42b92eb911ce admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:41.361359 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c714a2c-a642-4b39-9953-42b92eb911ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:41.361639 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c714a2c-a642-4b39-9953-42b92eb911ce admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:41.362338 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c714a2c-a642-4b39-9953-42b92eb911ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:41.364229 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c714a2c-a642-4b39-9953-42b92eb911ce admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:41.477494 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2878f-ba2d-4202-b10b-84d83f3ab898 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:41.478788 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1152/2305] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:17:41 2021] POST /identity/v3/projects => generated 403 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:17:41.497970 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2878f-ba2d-4202-b10b-84d83f3ab898 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:41.574829 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfc28c-95fd-4fc1-91d4-5540ba56f91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:41.575522 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfc28c-95fd-4fc1-91d4-5540ba56f91b admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:41.575809 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfc28c-95fd-4fc1-91d4-5540ba56f91b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:41.576087 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfc28c-95fd-4fc1-91d4-5540ba56f91b admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:41.576987 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cfc28c-95fd-4fc1-91d4-5540ba56f91b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:41.579767 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cfc28c-95fd-4fc1-91d4-5540ba56f91b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:41.718058 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1154/2306] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:17:41 2021] POST /identity/v3/users => generated 302 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:17:41.721985 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c714a2c-a642-4b39-9953-42b92eb911ce admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:41.756236 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c714a2c-a642-4b39-9953-42b92eb911ce admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:41.780019 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9545b5-6636-4e7c-9b61-87405b64f3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:41.780019 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9545b5-6636-4e7c-9b61-87405b64f3ba admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:41.780019 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9545b5-6636-4e7c-9b61-87405b64f3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:41.780019 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9545b5-6636-4e7c-9b61-87405b64f3ba admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:41.780424 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9545b5-6636-4e7c-9b61-87405b64f3ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:41.780424 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9545b5-6636-4e7c-9b61-87405b64f3ba admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:41.784612 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1153/2307] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:17:41 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:17:41.787217 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfc28c-95fd-4fc1-91d4-5540ba56f91b admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:41.797894 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfc28c-95fd-4fc1-91d4-5540ba56f91b admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:41.802877 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd88f75-5a47-40e3-a5e2-27a1000e5549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:41.803548 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd88f75-5a47-40e3-a5e2-27a1000e5549 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:41.803833 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd88f75-5a47-40e3-a5e2-27a1000e5549 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:41.804110 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd88f75-5a47-40e3-a5e2-27a1000e5549 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:41.804875 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd88f75-5a47-40e3-a5e2-27a1000e5549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:41.806474 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd88f75-5a47-40e3-a5e2-27a1000e5549 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:41.817195 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1155/2308] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:17:41 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:17:41.821397 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9545b5-6636-4e7c-9b61-87405b64f3ba admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:41.834822 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9545b5-6636-4e7c-9b61-87405b64f3ba admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:41.840146 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609bfa1-4e63-4b26-b994-4186f0fac057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:41.841119 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609bfa1-4e63-4b26-b994-4186f0fac057 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:41.841414 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609bfa1-4e63-4b26-b994-4186f0fac057 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:41.841704 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609bfa1-4e63-4b26-b994-4186f0fac057 admin admin] PATH_INFO: `/v3/projects/98b87b572f4c4eb5918835b788a9c1ba/users/0ec290eb21b24766aafe342ebeb6fc62/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:41.862528 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3609bfa1-4e63-4b26-b994-4186f0fac057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b87b572f4c4eb5918835b788a9c1ba, user_id=0ec290eb21b24766aafe342ebeb6fc62, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:41.863892 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3609bfa1-4e63-4b26-b994-4186f0fac057 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:41.987115 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1154/2309] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:17:41 2021] PUT /identity/v3/projects/98b87b572f4c4eb5918835b788a9c1ba/users/0ec290eb21b24766aafe342ebeb6fc62/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:17:41.992441 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5db16-7ee5-4c75-b1e3-74b5f1b6c9b4 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:41.993051 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5db16-7ee5-4c75-b1e3-74b5f1b6c9b4 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:41.993489 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5db16-7ee5-4c75-b1e3-74b5f1b6c9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:42.037560 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-03a5db16-7ee5-4c75-b1e3-74b5f1b6c9b4 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:42.038997 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-03a5db16-7ee5-4c75-b1e3-74b5f1b6c9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:42.112401 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1156/2310] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:17:42.124369 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609bfa1-4e63-4b26-b994-4186f0fac057 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:42.126945 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-3609bfa1-4e63-4b26-b994-4186f0fac057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:42.197043 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609bfa1-4e63-4b26-b994-4186f0fac057 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:42.202646 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eae7ca-b860-4387-8e4e-00013d6fb5d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:42.203409 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eae7ca-b860-4387-8e4e-00013d6fb5d4 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:42.204336 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eae7ca-b860-4387-8e4e-00013d6fb5d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:42.204714 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eae7ca-b860-4387-8e4e-00013d6fb5d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:42.217628 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eae7ca-b860-4387-8e4e-00013d6fb5d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:42.219638 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eae7ca-b860-4387-8e4e-00013d6fb5d4 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:42.231203 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1155/2311] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:17:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:17:43.879316 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef381c-be28-4bbb-9a60-8556ac92bbdf None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:43.879739 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef381c-be28-4bbb-9a60-8556ac92bbdf None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:43.879892 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef381c-be28-4bbb-9a60-8556ac92bbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:43.924964 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-b8ef381c-be28-4bbb-9a60-8556ac92bbdf None None] MFA Rules not processed for user `0ec290eb21b24766aafe342ebeb6fc62`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:43.927259 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-b8ef381c-be28-4bbb-9a60-8556ac92bbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:44.052206 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1157/2312] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:43 2021] POST /identity/v3/auth/tokens => generated 3423 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:17:44.056877 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eae7ca-b860-4387-8e4e-00013d6fb5d4 service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:44.067159 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eae7ca-b860-4387-8e4e-00013d6fb5d4 service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:44.080876 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42062d58-ba49-4d1f-a1c7-7f8fe953f767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:44.081564 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42062d58-ba49-4d1f-a1c7-7f8fe953f767 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:44.081870 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42062d58-ba49-4d1f-a1c7-7f8fe953f767 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:44.082271 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42062d58-ba49-4d1f-a1c7-7f8fe953f767 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:44.083002 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42062d58-ba49-4d1f-a1c7-7f8fe953f767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:44.085232 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42062d58-ba49-4d1f-a1c7-7f8fe953f767 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:44.204022 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1156/2313] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:17:44 2021] POST /identity/v3/projects => generated 403 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:17:44.211683 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef381c-be28-4bbb-9a60-8556ac92bbdf None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:44.237537 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef381c-be28-4bbb-9a60-8556ac92bbdf None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:44.336154 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9f1af-3f47-49fa-801d-1b176a44c6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:44.337232 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9f1af-3f47-49fa-801d-1b176a44c6bc admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:44.337662 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9f1af-3f47-49fa-801d-1b176a44c6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:44.338151 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9f1af-3f47-49fa-801d-1b176a44c6bc admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:44.339411 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9f1af-3f47-49fa-801d-1b176a44c6bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:44.342514 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9f1af-3f47-49fa-801d-1b176a44c6bc admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:44.443673 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1158/2314] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:17:44 2021] POST /identity/v3/users => generated 308 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:17:44.446875 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42062d58-ba49-4d1f-a1c7-7f8fe953f767 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:44.459744 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42062d58-ba49-4d1f-a1c7-7f8fe953f767 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:44.465310 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d50774-a072-469a-a6f7-051b115310ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:44.466313 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d50774-a072-469a-a6f7-051b115310ed admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:44.466774 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d50774-a072-469a-a6f7-051b115310ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:44.467195 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d50774-a072-469a-a6f7-051b115310ed admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:44.468082 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d50774-a072-469a-a6f7-051b115310ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:44.471214 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d50774-a072-469a-a6f7-051b115310ed admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:44.504406 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1157/2315] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:17:44 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:17:44.511923 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9f1af-3f47-49fa-801d-1b176a44c6bc admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:44.564295 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9f1af-3f47-49fa-801d-1b176a44c6bc admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:44.587070 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3aebf-3e06-4196-b149-36e076e542d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:44.587998 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3aebf-3e06-4196-b149-36e076e542d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:44.588349 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3aebf-3e06-4196-b149-36e076e542d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:44.588662 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3aebf-3e06-4196-b149-36e076e542d8 admin admin] PATH_INFO: `/v3/projects/d0a79b295e3d4a88b3e6accbed443525/users/12f98078110a45dfb7e4c7bfefd5a83d/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:44.631770 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3aebf-3e06-4196-b149-36e076e542d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a79b295e3d4a88b3e6accbed443525, user_id=12f98078110a45dfb7e4c7bfefd5a83d, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:44.633294 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3aebf-3e06-4196-b149-36e076e542d8 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:44.902551 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1159/2316] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:17:44 2021] PUT /identity/v3/projects/d0a79b295e3d4a88b3e6accbed443525/users/12f98078110a45dfb7e4c7bfefd5a83d/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:17:44.909717 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d50774-a072-469a-a6f7-051b115310ed admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:44.921573 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d50774-a072-469a-a6f7-051b115310ed admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:45.036453 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8714194-e910-4f09-a988-9cbfc7705ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:45.037151 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8714194-e910-4f09-a988-9cbfc7705ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:45.037431 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8714194-e910-4f09-a988-9cbfc7705ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:45.037705 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8714194-e910-4f09-a988-9cbfc7705ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:45.038771 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8714194-e910-4f09-a988-9cbfc7705ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:45.040352 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8714194-e910-4f09-a988-9cbfc7705ed0 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:45.050313 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1158/2317] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:17:44 2021] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:17:45.063551 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3aebf-3e06-4196-b149-36e076e542d8 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:45.065603 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3aebf-3e06-4196-b149-36e076e542d8 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:45.070205 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb36fc3-356c-4bb0-b39a-b9182dd9973a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:45.071087 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb36fc3-356c-4bb0-b39a-b9182dd9973a admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:45.071367 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb36fc3-356c-4bb0-b39a-b9182dd9973a admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:45.071642 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb36fc3-356c-4bb0-b39a-b9182dd9973a admin admin] PATH_INFO: `/v3/projects/d0a79b295e3d4a88b3e6accbed443525/users/12f98078110a45dfb7e4c7bfefd5a83d/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:45.073622 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb36fc3-356c-4bb0-b39a-b9182dd9973a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a79b295e3d4a88b3e6accbed443525, user_id=12f98078110a45dfb7e4c7bfefd5a83d, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:45.076401 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb36fc3-356c-4bb0-b39a-b9182dd9973a admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:45.088848 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1160/2318] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:17:45 2021] PUT /identity/v3/projects/d0a79b295e3d4a88b3e6accbed443525/users/12f98078110a45dfb7e4c7bfefd5a83d/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:17:45.564916 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef68c6d-2f72-4a16-8efb-a05fe7a65860 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:45.565854 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef68c6d-2f72-4a16-8efb-a05fe7a65860 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:45.566365 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef68c6d-2f72-4a16-8efb-a05fe7a65860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:45.593385 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-fef68c6d-2f72-4a16-8efb-a05fe7a65860 None None] MFA Rules not processed for user `96c9b76133d74b79a0d2da9a884651e1`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:45.595095 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-fef68c6d-2f72-4a16-8efb-a05fe7a65860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:45.659642 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1159/2319] 10.222.0.23 () {58 vars in 1010 bytes} [Thu Sep 23 03:17:45 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:17:45.702675 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb36fc3-356c-4bb0-b39a-b9182dd9973a admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:45.704925 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-fbb36fc3-356c-4bb0-b39a-b9182dd9973a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:45.816179 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb36fc3-356c-4bb0-b39a-b9182dd9973a admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:45.829058 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec175b-0bc6-4b4d-8b39-1a0a9d0aab84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df051fd059b34fe0993f501546d1610f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:45.829058 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec175b-0bc6-4b4d-8b39-1a0a9d0aab84 service swift] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:45.829058 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec175b-0bc6-4b4d-8b39-1a0a9d0aab84 service swift] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:45.829058 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec175b-0bc6-4b4d-8b39-1a0a9d0aab84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:45.836889 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec175b-0bc6-4b4d-8b39-1a0a9d0aab84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:45.838630 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec175b-0bc6-4b4d-8b39-1a0a9d0aab84 service swift] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:45.850309 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1161/2320] 10.222.0.23 () {60 vars in 1385 bytes} [Thu Sep 23 03:17:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 23 03:17:46.737914 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bce0ba-d265-47ae-a2c0-199b32b0435f None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:46.738897 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bce0ba-d265-47ae-a2c0-199b32b0435f None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:46.739330 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bce0ba-d265-47ae-a2c0-199b32b0435f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:46.810023 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-84bce0ba-d265-47ae-a2c0-199b32b0435f None None] MFA Rules not processed for user `12f98078110a45dfb7e4c7bfefd5a83d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:46.829036 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-84bce0ba-d265-47ae-a2c0-199b32b0435f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:47.053740 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1160/2321] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:46 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:17:49.586664 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec175b-0bc6-4b4d-8b39-1a0a9d0aab84 service swift] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:49.716818 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec175b-0bc6-4b4d-8b39-1a0a9d0aab84 service swift] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:49.723269 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a548c-9ad6-4afb-b58d-ecc9980e4000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:49.724423 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a548c-9ad6-4afb-b58d-ecc9980e4000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:49.724961 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a548c-9ad6-4afb-b58d-ecc9980e4000 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:49.725508 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a548c-9ad6-4afb-b58d-ecc9980e4000 admin admin] PATH_INFO: `/v3/users/0ec290eb21b24766aafe342ebeb6fc62` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:49.726981 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a548c-9ad6-4afb-b58d-ecc9980e4000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ec290eb21b24766aafe342ebeb6fc62)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:49.729157 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a548c-9ad6-4afb-b58d-ecc9980e4000 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:49.981037 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-b33a548c-9ad6-4afb-b58d-ecc9980e4000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ec290eb21b24766aafe342ebeb6fc62'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:49.982329 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-b33a548c-9ad6-4afb-b58d-ecc9980e4000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ec290eb21b24766aafe342ebeb6fc62'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:49.992192 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-b33a548c-9ad6-4afb-b58d-ecc9980e4000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ec290eb21b24766aafe342ebeb6fc62'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:50.070390 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-b33a548c-9ad6-4afb-b58d-ecc9980e4000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ec290eb21b24766aafe342ebeb6fc62'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:50.085801 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-b33a548c-9ad6-4afb-b58d-ecc9980e4000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ec290eb21b24766aafe342ebeb6fc62'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:50.091642 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1162/2322] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:17:49 2021] DELETE /identity/v3/users/0ec290eb21b24766aafe342ebeb6fc62 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:17:50.402925 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bce0ba-d265-47ae-a2c0-199b32b0435f None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:50.447352 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bce0ba-d265-47ae-a2c0-199b32b0435f None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:50.510671 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8d908-cb58-4af2-aa9e-6926c75cb7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:50.511641 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8d908-cb58-4af2-aa9e-6926c75cb7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:50.511996 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8d908-cb58-4af2-aa9e-6926c75cb7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:50.512353 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8d908-cb58-4af2-aa9e-6926c75cb7ed admin admin] PATH_INFO: `/v3/projects/98b87b572f4c4eb5918835b788a9c1ba` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:50.513663 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8d908-cb58-4af2-aa9e-6926c75cb7ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=98b87b572f4c4eb5918835b788a9c1ba)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:50.515629 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8d908-cb58-4af2-aa9e-6926c75cb7ed admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:50.625831 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-58e8d908-cb58-4af2-aa9e-6926c75cb7ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98b87b572f4c4eb5918835b788a9c1ba', 'request_id': 'req-58e8d908-cb58-4af2-aa9e-6926c75cb7ed'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:50.722129 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-58e8d908-cb58-4af2-aa9e-6926c75cb7ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98b87b572f4c4eb5918835b788a9c1ba', 'request_id': 'req-58e8d908-cb58-4af2-aa9e-6926c75cb7ed'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:50.729724 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-58e8d908-cb58-4af2-aa9e-6926c75cb7ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98b87b572f4c4eb5918835b788a9c1ba', 'request_id': 'req-58e8d908-cb58-4af2-aa9e-6926c75cb7ed'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:50.746911 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-58e8d908-cb58-4af2-aa9e-6926c75cb7ed admin admin] The token cache is being invalidate because project 98b87b572f4c4eb5918835b788a9c1ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:17:50.747503 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-58e8d908-cb58-4af2-aa9e-6926c75cb7ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:50.748550 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-58e8d908-cb58-4af2-aa9e-6926c75cb7ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:50.750812 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1161/2323] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:17:50 2021] DELETE /identity/v3/projects/98b87b572f4c4eb5918835b788a9c1ba => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:17:50.754888 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a548c-9ad6-4afb-b58d-ecc9980e4000 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:50.757366 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-b33a548c-9ad6-4afb-b58d-ecc9980e4000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:50.779548 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a548c-9ad6-4afb-b58d-ecc9980e4000 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:50.855368 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173f680-27d1-43f2-a3f5-062f0c23e306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:50.856571 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173f680-27d1-43f2-a3f5-062f0c23e306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:50.869598 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173f680-27d1-43f2-a3f5-062f0c23e306 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:50.870290 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173f680-27d1-43f2-a3f5-062f0c23e306 admin admin] PATH_INFO: `/v3/users/12f98078110a45dfb7e4c7bfefd5a83d` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:50.872173 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173f680-27d1-43f2-a3f5-062f0c23e306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12f98078110a45dfb7e4c7bfefd5a83d)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:50.879366 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173f680-27d1-43f2-a3f5-062f0c23e306 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:51.050639 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-e173f680-27d1-43f2-a3f5-062f0c23e306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12f98078110a45dfb7e4c7bfefd5a83d'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:51.051354 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-e173f680-27d1-43f2-a3f5-062f0c23e306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12f98078110a45dfb7e4c7bfefd5a83d'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:51.058667 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-e173f680-27d1-43f2-a3f5-062f0c23e306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12f98078110a45dfb7e4c7bfefd5a83d'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:51.109938 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-e173f680-27d1-43f2-a3f5-062f0c23e306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12f98078110a45dfb7e4c7bfefd5a83d'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:51.122077 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-e173f680-27d1-43f2-a3f5-062f0c23e306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12f98078110a45dfb7e4c7bfefd5a83d'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:51.128607 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1163/2324] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:17:50 2021] DELETE /identity/v3/users/12f98078110a45dfb7e4c7bfefd5a83d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:17:51.374870 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8d908-cb58-4af2-aa9e-6926c75cb7ed admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:51.376294 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-58e8d908-cb58-4af2-aa9e-6926c75cb7ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:51.424899 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8d908-cb58-4af2-aa9e-6926c75cb7ed admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:51.515375 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a8528-23a7-4e8b-99f7-be60fb544755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:51.517167 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a8528-23a7-4e8b-99f7-be60fb544755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:51.517646 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a8528-23a7-4e8b-99f7-be60fb544755 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:51.518654 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a8528-23a7-4e8b-99f7-be60fb544755 admin admin] PATH_INFO: `/v3/projects/d0a79b295e3d4a88b3e6accbed443525` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:51.520206 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173f680-27d1-43f2-a3f5-062f0c23e306 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:51.520974 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a8528-23a7-4e8b-99f7-be60fb544755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0a79b295e3d4a88b3e6accbed443525)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:51.523968 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-e173f680-27d1-43f2-a3f5-062f0c23e306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:51.524094 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a8528-23a7-4e8b-99f7-be60fb544755 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:51.542269 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173f680-27d1-43f2-a3f5-062f0c23e306 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:51.548218 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d07ce-339d-4229-a1e0-772b48eda141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:51.552427 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d07ce-339d-4229-a1e0-772b48eda141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:51.552427 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d07ce-339d-4229-a1e0-772b48eda141 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:51.552427 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d07ce-339d-4229-a1e0-772b48eda141 admin admin] PATH_INFO: `/v3/users/6c5b4f111295488c9d6ed7fadf52255e` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:51.552427 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d07ce-339d-4229-a1e0-772b48eda141 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c5b4f111295488c9d6ed7fadf52255e)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:51.556102 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d07ce-339d-4229-a1e0-772b48eda141 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:51.674011 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-3f9a8528-23a7-4e8b-99f7-be60fb544755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0a79b295e3d4a88b3e6accbed443525', 'request_id': 'req-3f9a8528-23a7-4e8b-99f7-be60fb544755'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:51.887308 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-3f9a8528-23a7-4e8b-99f7-be60fb544755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0a79b295e3d4a88b3e6accbed443525', 'request_id': 'req-3f9a8528-23a7-4e8b-99f7-be60fb544755'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:51.893383 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-3f9a8528-23a7-4e8b-99f7-be60fb544755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0a79b295e3d4a88b3e6accbed443525', 'request_id': 'req-3f9a8528-23a7-4e8b-99f7-be60fb544755'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:51.898053 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-934d07ce-339d-4229-a1e0-772b48eda141 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c5b4f111295488c9d6ed7fadf52255e'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:51.898762 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-934d07ce-339d-4229-a1e0-772b48eda141 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c5b4f111295488c9d6ed7fadf52255e'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:51.909688 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-934d07ce-339d-4229-a1e0-772b48eda141 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c5b4f111295488c9d6ed7fadf52255e'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:51.917376 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-3f9a8528-23a7-4e8b-99f7-be60fb544755 admin admin] The token cache is being invalidate because project d0a79b295e3d4a88b3e6accbed443525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:17:51.917674 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-3f9a8528-23a7-4e8b-99f7-be60fb544755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:51.918576 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-3f9a8528-23a7-4e8b-99f7-be60fb544755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:51.920273 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1162/2325] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:17:51 2021] DELETE /identity/v3/projects/d0a79b295e3d4a88b3e6accbed443525 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:17:51.926493 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75659d30-73e1-4a46-b435-a5da6d1ed2bd None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:51.933031 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75659d30-73e1-4a46-b435-a5da6d1ed2bd None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:51.933031 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75659d30-73e1-4a46-b435-a5da6d1ed2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:51.948150 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-75659d30-73e1-4a46-b435-a5da6d1ed2bd None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:51.950032 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-75659d30-73e1-4a46-b435-a5da6d1ed2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:51.990469 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-934d07ce-339d-4229-a1e0-772b48eda141 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c5b4f111295488c9d6ed7fadf52255e'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:52.006837 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-934d07ce-339d-4229-a1e0-772b48eda141 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c5b4f111295488c9d6ed7fadf52255e'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:52.035500 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1164/2326] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:17:51 2021] DELETE /identity/v3/users/6c5b4f111295488c9d6ed7fadf52255e => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:17:52.040184 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2f7d7-0618-4563-86da-feb4fd070b1d None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:52.040801 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2f7d7-0618-4563-86da-feb4fd070b1d None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:52.041260 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2f7d7-0618-4563-86da-feb4fd070b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:52.054868 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1163/2327] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:17:52.056814 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224af4c-39cc-4593-814a-a62e690b1c85 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:52.057172 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224af4c-39cc-4593-814a-a62e690b1c85 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:52.057700 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224af4c-39cc-4593-814a-a62e690b1c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:52.083519 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-d224af4c-39cc-4593-814a-a62e690b1c85 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:52.084919 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-d224af4c-39cc-4593-814a-a62e690b1c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:52.094024 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-73e2f7d7-0618-4563-86da-feb4fd070b1d None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:52.095250 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-73e2f7d7-0618-4563-86da-feb4fd070b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:52.236201 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1164/2328] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:17:52.241166 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e6362-7e56-4a4c-96d6-51a3abebea60 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:52.241166 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e6362-7e56-4a4c-96d6-51a3abebea60 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:52.241689 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e6362-7e56-4a4c-96d6-51a3abebea60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:52.244114 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1165/2329] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:17:52.257407 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2f7d7-0618-4563-86da-feb4fd070b1d None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:52.269378 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2f7d7-0618-4563-86da-feb4fd070b1d None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:52.275537 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ffcd7-fe0a-461d-ad40-0dac48e4b4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:52.276432 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ffcd7-fe0a-461d-ad40-0dac48e4b4fa admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:52.276918 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ffcd7-fe0a-461d-ad40-0dac48e4b4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:52.277349 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ffcd7-fe0a-461d-ad40-0dac48e4b4fa admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:52.278221 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ffcd7-fe0a-461d-ad40-0dac48e4b4fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:17:52.278692 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ffcd7-fe0a-461d-ad40-0dac48e4b4fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:52.280771 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ffcd7-fe0a-461d-ad40-0dac48e4b4fa admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:52.288527 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-546e6362-7e56-4a4c-96d6-51a3abebea60 None None] MFA Rules not processed for user `96c9b76133d74b79a0d2da9a884651e1`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:52.293152 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-546e6362-7e56-4a4c-96d6-51a3abebea60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:52.294310 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1166/2330] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:17:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:17:52.295241 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ffcd7-fe0a-461d-ad40-0dac48e4b4fa admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:52.297528 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-150ffcd7-fe0a-461d-ad40-0dac48e4b4fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:52.377638 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1165/2331] 10.222.0.23 () {58 vars in 968 bytes} [Thu Sep 23 03:17:52 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:17:52.378730 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e6362-7e56-4a4c-96d6-51a3abebea60 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:52.387635 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ffcd7-fe0a-461d-ad40-0dac48e4b4fa admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:52.391627 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e6362-7e56-4a4c-96d6-51a3abebea60 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:52.400395 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bbd86-8b0b-4679-ac5d-81744dcea4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:52.400981 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c07c96-287a-4ad7-8b4b-038dbf22d0a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:52.401780 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bbd86-8b0b-4679-ac5d-81744dcea4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:52.402584 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c07c96-287a-4ad7-8b4b-038dbf22d0a3 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:52.402992 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bbd86-8b0b-4679-ac5d-81744dcea4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:52.403385 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c07c96-287a-4ad7-8b4b-038dbf22d0a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:52.403777 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bbd86-8b0b-4679-ac5d-81744dcea4c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:52.404307 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c07c96-287a-4ad7-8b4b-038dbf22d0a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:52.405283 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1bbd86-8b0b-4679-ac5d-81744dcea4c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:52.408930 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1bbd86-8b0b-4679-ac5d-81744dcea4c2 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:52.422771 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c07c96-287a-4ad7-8b4b-038dbf22d0a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:52.430392 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c07c96-287a-4ad7-8b4b-038dbf22d0a3 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:52.436634 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1167/2332] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:17:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:17:52.448641 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c07c96-287a-4ad7-8b4b-038dbf22d0a3 service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:52.454009 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-31c07c96-287a-4ad7-8b4b-038dbf22d0a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:52.534353 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1166/2333] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:17:52 2021] POST /identity/v3/projects => generated 371 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:17:52.535365 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bbd86-8b0b-4679-ac5d-81744dcea4c2 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:52.608034 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c07c96-287a-4ad7-8b4b-038dbf22d0a3 service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:52.635617 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bbd86-8b0b-4679-ac5d-81744dcea4c2 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:52.640278 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba55b01-a700-4e12-8be0-e0e21dcd784c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:52.645109 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba55b01-a700-4e12-8be0-e0e21dcd784c admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:52.645109 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba55b01-a700-4e12-8be0-e0e21dcd784c admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:52.645109 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba55b01-a700-4e12-8be0-e0e21dcd784c admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:52.645109 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba55b01-a700-4e12-8be0-e0e21dcd784c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:52.645109 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba55b01-a700-4e12-8be0-e0e21dcd784c admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:52.730511 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad12b5b-f90b-40e8-ae26-31d9e6a246ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df051fd059b34fe0993f501546d1610f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:52.732434 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad12b5b-f90b-40e8-ae26-31d9e6a246ba service swift] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:52.732935 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad12b5b-f90b-40e8-ae26-31d9e6a246ba service swift] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:52.734306 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad12b5b-f90b-40e8-ae26-31d9e6a246ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:52.802577 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad12b5b-f90b-40e8-ae26-31d9e6a246ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:52.805030 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad12b5b-f90b-40e8-ae26-31d9e6a246ba service swift] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:52.827203 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1168/2334] 10.222.0.23 () {60 vars in 1385 bytes} [Thu Sep 23 03:17:52 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 03:17:53.010650 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1167/2335] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:17:52 2021] POST /identity/v3/users => generated 286 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:17:53.011852 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad12b5b-f90b-40e8-ae26-31d9e6a246ba service swift] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:53.022749 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad12b5b-f90b-40e8-ae26-31d9e6a246ba service swift] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:53.028416 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31885e4-23c2-4b11-a55a-47577b9dcca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:53.028416 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31885e4-23c2-4b11-a55a-47577b9dcca1 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:53.028416 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31885e4-23c2-4b11-a55a-47577b9dcca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:53.028835 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31885e4-23c2-4b11-a55a-47577b9dcca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:53.029273 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31885e4-23c2-4b11-a55a-47577b9dcca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:53.030861 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31885e4-23c2-4b11-a55a-47577b9dcca1 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:53.041361 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1169/2336] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:17:53 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:17:53.045400 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba55b01-a700-4e12-8be0-e0e21dcd784c admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:53.055269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba55b01-a700-4e12-8be0-e0e21dcd784c admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:53.060084 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3432ae-e7da-4955-a1b5-3f82655d7f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:53.060783 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3432ae-e7da-4955-a1b5-3f82655d7f1a admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:53.061066 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3432ae-e7da-4955-a1b5-3f82655d7f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:53.061342 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3432ae-e7da-4955-a1b5-3f82655d7f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:53.062071 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3432ae-e7da-4955-a1b5-3f82655d7f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:53.063804 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3432ae-e7da-4955-a1b5-3f82655d7f1a admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:53.078808 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1168/2337] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:17:53 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:17:53.080030 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31885e4-23c2-4b11-a55a-47577b9dcca1 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:53.090296 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3432ae-e7da-4955-a1b5-3f82655d7f1a admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:53.093305 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31885e4-23c2-4b11-a55a-47577b9dcca1 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:53.096956 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-8f3432ae-e7da-4955-a1b5-3f82655d7f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:53.099811 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e77beb-fb14-4413-bf38-546c1b996e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:53.100956 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e77beb-fb14-4413-bf38-546c1b996e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:53.101253 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e77beb-fb14-4413-bf38-546c1b996e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:53.101539 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e77beb-fb14-4413-bf38-546c1b996e1c admin admin] PATH_INFO: `/v3/projects/18be7da85589431b9e9fac3a3bb154a4/users/f19065ade2204254a281b8e7756b717b/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:53.129433 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e77beb-fb14-4413-bf38-546c1b996e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=18be7da85589431b9e9fac3a3bb154a4, user_id=f19065ade2204254a281b8e7756b717b, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:53.131729 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3432ae-e7da-4955-a1b5-3f82655d7f1a admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:53.135381 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e77beb-fb14-4413-bf38-546c1b996e1c admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:53.144632 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0daaca-366a-469c-a397-d4f8bb7b748d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:53.145685 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0daaca-366a-469c-a397-d4f8bb7b748d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:53.146010 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0daaca-366a-469c-a397-d4f8bb7b748d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:53.146293 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0daaca-366a-469c-a397-d4f8bb7b748d admin admin] PATH_INFO: `/v3/projects/75a9fbdf33ae4ff78bef7ce697bd3d24` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:53.147814 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0daaca-366a-469c-a397-d4f8bb7b748d admin admin] RBAC: Authorizing `identity:delete_project(project_id=75a9fbdf33ae4ff78bef7ce697bd3d24)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:53.150227 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0daaca-366a-469c-a397-d4f8bb7b748d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:53.228145 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1170/2338] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:17:53 2021] PUT /identity/v3/projects/18be7da85589431b9e9fac3a3bb154a4/users/f19065ade2204254a281b8e7756b717b/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:17:53.240571 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a332cc-169a-473d-9607-49987af3df9e None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:53.240571 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a332cc-169a-473d-9607-49987af3df9e None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:53.240571 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a332cc-169a-473d-9607-49987af3df9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:53.277396 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-93a332cc-169a-473d-9607-49987af3df9e None None] MFA Rules not processed for user `f19065ade2204254a281b8e7756b717b`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:53.279120 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-fa0daaca-366a-469c-a397-d4f8bb7b748d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75a9fbdf33ae4ff78bef7ce697bd3d24', 'request_id': 'req-fa0daaca-366a-469c-a397-d4f8bb7b748d'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:53.279704 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-93a332cc-169a-473d-9607-49987af3df9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:53.353200 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1171/2339] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:53 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:17:53.357832 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a332cc-169a-473d-9607-49987af3df9e None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:53.359957 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-fa0daaca-366a-469c-a397-d4f8bb7b748d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75a9fbdf33ae4ff78bef7ce697bd3d24', 'request_id': 'req-fa0daaca-366a-469c-a397-d4f8bb7b748d'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:53.378277 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-fa0daaca-366a-469c-a397-d4f8bb7b748d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75a9fbdf33ae4ff78bef7ce697bd3d24', 'request_id': 'req-fa0daaca-366a-469c-a397-d4f8bb7b748d'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:53.407133 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-fa0daaca-366a-469c-a397-d4f8bb7b748d admin admin] The token cache is being invalidate because project 75a9fbdf33ae4ff78bef7ce697bd3d24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:17:53.407390 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-fa0daaca-366a-469c-a397-d4f8bb7b748d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:53.408048 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-fa0daaca-366a-469c-a397-d4f8bb7b748d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:53.414021 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1169/2340] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:17:53 2021] DELETE /identity/v3/projects/75a9fbdf33ae4ff78bef7ce697bd3d24 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:17:53.416523 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ece70-1d55-44ef-a227-fcf0dfc91271 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:53.416890 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ece70-1d55-44ef-a227-fcf0dfc91271 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:53.419250 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ece70-1d55-44ef-a227-fcf0dfc91271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:53.460463 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-986ece70-1d55-44ef-a227-fcf0dfc91271 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:53.462115 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-986ece70-1d55-44ef-a227-fcf0dfc91271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:53.474085 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1170/2341] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:17:53.474202 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a332cc-169a-473d-9607-49987af3df9e None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:53.477703 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5df6ab-40fa-4a4b-82b4-dda71d069cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:53.478539 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5df6ab-40fa-4a4b-82b4-dda71d069cab admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:53.478902 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5df6ab-40fa-4a4b-82b4-dda71d069cab admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:53.479258 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5df6ab-40fa-4a4b-82b4-dda71d069cab admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:53.480029 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5df6ab-40fa-4a4b-82b4-dda71d069cab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:53.480220 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c8f9b-1aa1-4332-9853-53748db910de None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:53.480602 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c8f9b-1aa1-4332-9853-53748db910de None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:53.480965 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c8f9b-1aa1-4332-9853-53748db910de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:53.482955 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5df6ab-40fa-4a4b-82b4-dda71d069cab admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:53.509881 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-506c8f9b-1aa1-4332-9853-53748db910de None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:53.511372 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-506c8f9b-1aa1-4332-9853-53748db910de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:53.522472 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1171/2342] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:17:53.526424 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c8f9b-1aa1-4332-9853-53748db910de None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:53.540696 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c8f9b-1aa1-4332-9853-53748db910de None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:53.548250 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe457694-27cc-473d-8e43-d0bf68d72bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:53.551779 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe457694-27cc-473d-8e43-d0bf68d72bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:53.551779 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe457694-27cc-473d-8e43-d0bf68d72bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:53.551779 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe457694-27cc-473d-8e43-d0bf68d72bd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:53.551779 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe457694-27cc-473d-8e43-d0bf68d72bd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:17:53.551779 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe457694-27cc-473d-8e43-d0bf68d72bd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:53.554696 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe457694-27cc-473d-8e43-d0bf68d72bd6 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:53.569283 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1172/2343] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:17:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:17:53.573699 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe457694-27cc-473d-8e43-d0bf68d72bd6 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:53.584528 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1172/2344] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:17:53 2021] POST /identity/v3/projects => generated 373 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:17:53.586505 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5df6ab-40fa-4a4b-82b4-dda71d069cab admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:53.588363 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-4e5df6ab-40fa-4a4b-82b4-dda71d069cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:53.594543 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe457694-27cc-473d-8e43-d0bf68d72bd6 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:53.658254 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b64847-85c4-448d-9986-4c02955fa837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:53.658925 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b64847-85c4-448d-9986-4c02955fa837 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:53.659214 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b64847-85c4-448d-9986-4c02955fa837 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:53.659487 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b64847-85c4-448d-9986-4c02955fa837 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:53.660184 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b64847-85c4-448d-9986-4c02955fa837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:53.662361 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b64847-85c4-448d-9986-4c02955fa837 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:53.665273 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5df6ab-40fa-4a4b-82b4-dda71d069cab admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:53.672294 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aeb654-26c4-4bd4-bab9-7abafdd63ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:53.676676 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aeb654-26c4-4bd4-bab9-7abafdd63ecb admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:53.676676 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aeb654-26c4-4bd4-bab9-7abafdd63ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:53.676676 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aeb654-26c4-4bd4-bab9-7abafdd63ecb admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:53.676676 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aeb654-26c4-4bd4-bab9-7abafdd63ecb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:53.677213 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aeb654-26c4-4bd4-bab9-7abafdd63ecb admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:53.809991 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1173/2345] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:17:53 2021] POST /identity/v3/projects => generated 371 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:17:53.816168 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b64847-85c4-448d-9986-4c02955fa837 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:53.834809 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1173/2346] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:17:53 2021] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:17:53.838909 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aeb654-26c4-4bd4-bab9-7abafdd63ecb admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:53.852653 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aeb654-26c4-4bd4-bab9-7abafdd63ecb admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:53.911428 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b64847-85c4-448d-9986-4c02955fa837 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:53.917608 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cee98-a9fc-4963-8bd6-d2205cc2e5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:53.918004 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cee98-a9fc-4963-8bd6-d2205cc2e5be admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:53.918233 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cee98-a9fc-4963-8bd6-d2205cc2e5be admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:53.918518 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cee98-a9fc-4963-8bd6-d2205cc2e5be admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:53.919208 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863cee98-a9fc-4963-8bd6-d2205cc2e5be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:53.921440 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863cee98-a9fc-4963-8bd6-d2205cc2e5be admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:53.940451 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7fb8e-2da0-4182-b957-8280dc3df084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:53.944074 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7fb8e-2da0-4182-b957-8280dc3df084 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:53.944074 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7fb8e-2da0-4182-b957-8280dc3df084 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:53.944074 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7fb8e-2da0-4182-b957-8280dc3df084 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:53.944074 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7fb8e-2da0-4182-b957-8280dc3df084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:53.944074 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7fb8e-2da0-4182-b957-8280dc3df084 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:53.962721 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1174/2347] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:17:53 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:17:53.963778 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7fb8e-2da0-4182-b957-8280dc3df084 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:53.974409 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7fb8e-2da0-4182-b957-8280dc3df084 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:53.979297 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f71ef5-3481-4107-b132-78aef62f2a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:53.980324 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f71ef5-3481-4107-b132-78aef62f2a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:53.980699 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f71ef5-3481-4107-b132-78aef62f2a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:53.981000 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f71ef5-3481-4107-b132-78aef62f2a5a admin admin] PATH_INFO: `/v3/projects/16ab0c859fb64f13b73d8bd02d7f1d42/users/a0b5d971d29f46be89f0147e0b0eabb5/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:53.996215 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f71ef5-3481-4107-b132-78aef62f2a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ab0c859fb64f13b73d8bd02d7f1d42, user_id=a0b5d971d29f46be89f0147e0b0eabb5, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:53.998954 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f71ef5-3481-4107-b132-78aef62f2a5a admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:54.012638 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1174/2348] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:17:53 2021] POST /identity/v3/users => generated 286 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:17:54.017204 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cee98-a9fc-4963-8bd6-d2205cc2e5be admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:54.029286 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cee98-a9fc-4963-8bd6-d2205cc2e5be admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:54.034267 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43129d3-c21f-4845-b235-70db4d74af18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:54.034951 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43129d3-c21f-4845-b235-70db4d74af18 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:54.035225 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43129d3-c21f-4845-b235-70db4d74af18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:54.035496 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43129d3-c21f-4845-b235-70db4d74af18 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:54.036223 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43129d3-c21f-4845-b235-70db4d74af18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:54.037890 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43129d3-c21f-4845-b235-70db4d74af18 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:54.051466 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1175/2349] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:17:54 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:17:54.052630 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43129d3-c21f-4845-b235-70db4d74af18 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:54.079775 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43129d3-c21f-4845-b235-70db4d74af18 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:54.086111 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d07cce-801b-4e88-af04-9bac32b4b150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:54.087216 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d07cce-801b-4e88-af04-9bac32b4b150 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:54.087678 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d07cce-801b-4e88-af04-9bac32b4b150 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:54.088065 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d07cce-801b-4e88-af04-9bac32b4b150 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:54.089066 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d07cce-801b-4e88-af04-9bac32b4b150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:54.091481 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d07cce-801b-4e88-af04-9bac32b4b150 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:54.108738 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1176/2350] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:17:54 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:17:54.109920 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d07cce-801b-4e88-af04-9bac32b4b150 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:54.114535 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1175/2351] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:17:53 2021] PUT /identity/v3/projects/16ab0c859fb64f13b73d8bd02d7f1d42/users/a0b5d971d29f46be89f0147e0b0eabb5/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:17:54.118317 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f71ef5-3481-4107-b132-78aef62f2a5a admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:54.127178 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d07cce-801b-4e88-af04-9bac32b4b150 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:54.182730 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f71ef5-3481-4107-b132-78aef62f2a5a admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:54.188218 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12783197-debc-4223-bbf2-e33e42977328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:54.189160 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12783197-debc-4223-bbf2-e33e42977328 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:54.189450 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12783197-debc-4223-bbf2-e33e42977328 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:54.189728 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12783197-debc-4223-bbf2-e33e42977328 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:54.190463 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12783197-debc-4223-bbf2-e33e42977328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:54.192079 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12783197-debc-4223-bbf2-e33e42977328 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:54.193768 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561fd13-8505-49db-9ce3-f63678ad4ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:54.195334 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561fd13-8505-49db-9ce3-f63678ad4ec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:54.195334 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561fd13-8505-49db-9ce3-f63678ad4ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:54.195597 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561fd13-8505-49db-9ce3-f63678ad4ec3 admin admin] PATH_INFO: `/v3/projects/5eea8bb3dd9f45e49298595cf9cc4bcd/users/c4c4cf4a700841be81d7765443bf141e/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:54.206229 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1176/2352] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:17:54 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:17:54.207659 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12783197-debc-4223-bbf2-e33e42977328 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:54.212738 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561fd13-8505-49db-9ce3-f63678ad4ec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eea8bb3dd9f45e49298595cf9cc4bcd, user_id=c4c4cf4a700841be81d7765443bf141e, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:54.215483 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561fd13-8505-49db-9ce3-f63678ad4ec3 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:54.224982 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12783197-debc-4223-bbf2-e33e42977328 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:54.230029 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a884b-0365-4041-b81e-ab4a10e2a06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:54.231052 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a884b-0365-4041-b81e-ab4a10e2a06d admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:54.231439 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a884b-0365-4041-b81e-ab4a10e2a06d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:54.232226 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a884b-0365-4041-b81e-ab4a10e2a06d admin admin] PATH_INFO: `/v3/projects/16ab0c859fb64f13b73d8bd02d7f1d42/users/a0b5d971d29f46be89f0147e0b0eabb5/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:54.234422 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a884b-0365-4041-b81e-ab4a10e2a06d admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ab0c859fb64f13b73d8bd02d7f1d42, user_id=a0b5d971d29f46be89f0147e0b0eabb5, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:54.237819 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a884b-0365-4041-b81e-ab4a10e2a06d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:54.261493 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1177/2353] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:17:54 2021] PUT /identity/v3/projects/16ab0c859fb64f13b73d8bd02d7f1d42/users/a0b5d971d29f46be89f0147e0b0eabb5/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:17:54.264039 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd86486-fb87-4c2e-90ec-d61cb6993845 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:54.264434 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd86486-fb87-4c2e-90ec-d61cb6993845 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:54.264884 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd86486-fb87-4c2e-90ec-d61cb6993845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:54.290998 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-ebd86486-fb87-4c2e-90ec-d61cb6993845 None None] MFA Rules not processed for user `a0b5d971d29f46be89f0147e0b0eabb5`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:54.292293 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-ebd86486-fb87-4c2e-90ec-d61cb6993845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:54.299602 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1177/2354] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:17:54 2021] PUT /identity/v3/projects/5eea8bb3dd9f45e49298595cf9cc4bcd/users/c4c4cf4a700841be81d7765443bf141e/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:17:54.309824 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1338a88-71be-456a-bc83-b950f89deb24 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:54.310112 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1338a88-71be-456a-bc83-b950f89deb24 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:54.310392 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1338a88-71be-456a-bc83-b950f89deb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:54.340452 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-a1338a88-71be-456a-bc83-b950f89deb24 None None] MFA Rules not processed for user `c4c4cf4a700841be81d7765443bf141e`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:54.342366 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-a1338a88-71be-456a-bc83-b950f89deb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:54.408671 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1178/2355] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:54 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:17:54.416394 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd86486-fb87-4c2e-90ec-d61cb6993845 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:54.423650 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-ebd86486-fb87-4c2e-90ec-d61cb6993845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:54.433846 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1178/2356] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:54 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:17:54.436192 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1338a88-71be-456a-bc83-b950f89deb24 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:54.440580 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-a1338a88-71be-456a-bc83-b950f89deb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:54.515061 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd86486-fb87-4c2e-90ec-d61cb6993845 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:54.522105 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1338a88-71be-456a-bc83-b950f89deb24 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:54.524806 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a6615-a080-4d61-b2f9-c32cceff02dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:54.525559 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a6615-a080-4d61-b2f9-c32cceff02dc service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:54.526053 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a6615-a080-4d61-b2f9-c32cceff02dc service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:54.526335 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a6615-a080-4d61-b2f9-c32cceff02dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:54.532839 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfafbfd-8172-4279-b069-2e586105aa13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:54.533790 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfafbfd-8172-4279-b069-2e586105aa13 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:54.536933 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfafbfd-8172-4279-b069-2e586105aa13 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:54.537214 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfafbfd-8172-4279-b069-2e586105aa13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:54.538504 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a6615-a080-4d61-b2f9-c32cceff02dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:54.539666 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-edfafbfd-8172-4279-b069-2e586105aa13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:54.540015 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a6615-a080-4d61-b2f9-c32cceff02dc service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:54.551610 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1179/2357] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:17:54 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:17:54.552700 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a6615-a080-4d61-b2f9-c32cceff02dc service cinder] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:54.557443 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-d82a6615-a080-4d61-b2f9-c32cceff02dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:54.566494 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a6615-a080-4d61-b2f9-c32cceff02dc service cinder] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:54.570809 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cee940-e15e-4508-9707-95924448fbeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:54.571752 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cee940-e15e-4508-9707-95924448fbeb service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:54.572137 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cee940-e15e-4508-9707-95924448fbeb service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:54.572730 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cee940-e15e-4508-9707-95924448fbeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:54.584338 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cee940-e15e-4508-9707-95924448fbeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:54.586678 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cee940-e15e-4508-9707-95924448fbeb service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:54.607529 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1180/2358] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:17:54 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:17:54.656935 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cee940-e15e-4508-9707-95924448fbeb service cinder] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:54.667529 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfafbfd-8172-4279-b069-2e586105aa13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:54.670105 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfafbfd-8172-4279-b069-2e586105aa13 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:54.709894 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1179/2359] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:17:54 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:17:54.795791 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cee940-e15e-4508-9707-95924448fbeb service cinder] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:54.799822 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eff409-ce74-4ef4-9020-eb44fbed1817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:54.800850 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eff409-ce74-4ef4-9020-eb44fbed1817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:54.801144 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eff409-ce74-4ef4-9020-eb44fbed1817 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:54.801775 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eff409-ce74-4ef4-9020-eb44fbed1817 admin admin] PATH_INFO: `/v3/users/c4c4cf4a700841be81d7765443bf141e` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:54.803186 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eff409-ce74-4ef4-9020-eb44fbed1817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4c4cf4a700841be81d7765443bf141e)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:54.805204 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eff409-ce74-4ef4-9020-eb44fbed1817 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:55.036156 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-03eff409-ce74-4ef4-9020-eb44fbed1817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4c4cf4a700841be81d7765443bf141e'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:55.036948 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-03eff409-ce74-4ef4-9020-eb44fbed1817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4c4cf4a700841be81d7765443bf141e'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:55.044415 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-03eff409-ce74-4ef4-9020-eb44fbed1817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4c4cf4a700841be81d7765443bf141e'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:55.111417 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-03eff409-ce74-4ef4-9020-eb44fbed1817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4c4cf4a700841be81d7765443bf141e'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:55.129070 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-03eff409-ce74-4ef4-9020-eb44fbed1817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4c4cf4a700841be81d7765443bf141e'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:55.137632 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1181/2360] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:17:54 2021] DELETE /identity/v3/users/c4c4cf4a700841be81d7765443bf141e => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:17:55.144366 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87febe3f-010c-4773-97a2-0216609d170f None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:55.144749 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87febe3f-010c-4773-97a2-0216609d170f None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:55.145042 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87febe3f-010c-4773-97a2-0216609d170f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:55.171036 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-87febe3f-010c-4773-97a2-0216609d170f None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:55.172666 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-87febe3f-010c-4773-97a2-0216609d170f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:55.258977 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1180/2361] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:17:55.280661 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eff409-ce74-4ef4-9020-eb44fbed1817 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:55.282338 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-03eff409-ce74-4ef4-9020-eb44fbed1817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:55.341387 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eff409-ce74-4ef4-9020-eb44fbed1817 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:55.346367 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d943b1-ea30-4d75-a475-8dda4cde9ec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:55.347013 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d943b1-ea30-4d75-a475-8dda4cde9ec5 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:55.347293 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d943b1-ea30-4d75-a475-8dda4cde9ec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:55.347565 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d943b1-ea30-4d75-a475-8dda4cde9ec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:55.357497 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d943b1-ea30-4d75-a475-8dda4cde9ec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:55.359091 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d943b1-ea30-4d75-a475-8dda4cde9ec5 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:55.369177 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1182/2362] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:17:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:17:55.975489 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87febe3f-010c-4773-97a2-0216609d170f None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:55.986070 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87febe3f-010c-4773-97a2-0216609d170f None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:55.989904 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b9dfe-d15e-4236-b0c7-92def6c1df64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:55.990788 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b9dfe-d15e-4236-b0c7-92def6c1df64 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:55.991083 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b9dfe-d15e-4236-b0c7-92def6c1df64 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:55.991369 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b9dfe-d15e-4236-b0c7-92def6c1df64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:55.999282 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-e91b9dfe-d15e-4236-b0c7-92def6c1df64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:56.075650 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b9dfe-d15e-4236-b0c7-92def6c1df64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:56.077079 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b9dfe-d15e-4236-b0c7-92def6c1df64 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:56.089645 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1181/2363] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:17:55 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:17:56.619955 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d943b1-ea30-4d75-a475-8dda4cde9ec5 service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:56.621645 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-f2d943b1-ea30-4d75-a475-8dda4cde9ec5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:56.636221 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d943b1-ea30-4d75-a475-8dda4cde9ec5 service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:56.649832 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf04027-c845-48d3-a5fa-42b927313b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:56.650725 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf04027-c845-48d3-a5fa-42b927313b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:56.651005 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf04027-c845-48d3-a5fa-42b927313b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:56.651285 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf04027-c845-48d3-a5fa-42b927313b45 admin admin] PATH_INFO: `/v3/users/f19065ade2204254a281b8e7756b717b` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:56.652614 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf04027-c845-48d3-a5fa-42b927313b45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f19065ade2204254a281b8e7756b717b)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:56.654554 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf04027-c845-48d3-a5fa-42b927313b45 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:56.724194 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b9dfe-d15e-4236-b0c7-92def6c1df64 service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:56.724194 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-e91b9dfe-d15e-4236-b0c7-92def6c1df64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:56.738317 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b9dfe-d15e-4236-b0c7-92def6c1df64 service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:56.743403 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fedfe2-99cd-4d38-b98f-c872e842c9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:56.744520 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fedfe2-99cd-4d38-b98f-c872e842c9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:56.744894 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fedfe2-99cd-4d38-b98f-c872e842c9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:56.745247 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fedfe2-99cd-4d38-b98f-c872e842c9a6 admin admin] PATH_INFO: `/v3/projects/5eea8bb3dd9f45e49298595cf9cc4bcd` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:56.746547 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fedfe2-99cd-4d38-b98f-c872e842c9a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eea8bb3dd9f45e49298595cf9cc4bcd)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:56.748714 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fedfe2-99cd-4d38-b98f-c872e842c9a6 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:56.918269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-92fedfe2-99cd-4d38-b98f-c872e842c9a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eea8bb3dd9f45e49298595cf9cc4bcd', 'request_id': 'req-92fedfe2-99cd-4d38-b98f-c872e842c9a6'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:56.918536 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-fdf04027-c845-48d3-a5fa-42b927313b45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f19065ade2204254a281b8e7756b717b'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:56.919308 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-fdf04027-c845-48d3-a5fa-42b927313b45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f19065ade2204254a281b8e7756b717b'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:56.926693 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-fdf04027-c845-48d3-a5fa-42b927313b45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f19065ade2204254a281b8e7756b717b'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:57.007238 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-92fedfe2-99cd-4d38-b98f-c872e842c9a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eea8bb3dd9f45e49298595cf9cc4bcd', 'request_id': 'req-92fedfe2-99cd-4d38-b98f-c872e842c9a6'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:57.013869 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-92fedfe2-99cd-4d38-b98f-c872e842c9a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eea8bb3dd9f45e49298595cf9cc4bcd', 'request_id': 'req-92fedfe2-99cd-4d38-b98f-c872e842c9a6'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:57.026423 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-92fedfe2-99cd-4d38-b98f-c872e842c9a6 admin admin] The token cache is being invalidate because project 5eea8bb3dd9f45e49298595cf9cc4bcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:17:57.026849 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-92fedfe2-99cd-4d38-b98f-c872e842c9a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:57.027604 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-92fedfe2-99cd-4d38-b98f-c872e842c9a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:57.031098 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1182/2364] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:17:56 2021] DELETE /identity/v3/projects/5eea8bb3dd9f45e49298595cf9cc4bcd => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:17:57.087410 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-fdf04027-c845-48d3-a5fa-42b927313b45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f19065ade2204254a281b8e7756b717b'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:57.101535 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-fdf04027-c845-48d3-a5fa-42b927313b45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f19065ade2204254a281b8e7756b717b'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:57.108590 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1183/2365] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:17:56 2021] DELETE /identity/v3/users/f19065ade2204254a281b8e7756b717b => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:17:57.114345 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9e915-e7bd-4e1e-9c36-baf839feaca1 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:57.114655 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9e915-e7bd-4e1e-9c36-baf839feaca1 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:57.115172 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9e915-e7bd-4e1e-9c36-baf839feaca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:57.136756 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-c8b9e915-e7bd-4e1e-9c36-baf839feaca1 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:57.138840 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-c8b9e915-e7bd-4e1e-9c36-baf839feaca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:57.202889 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1183/2366] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:17:57.212819 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf04027-c845-48d3-a5fa-42b927313b45 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:57.214520 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-fdf04027-c845-48d3-a5fa-42b927313b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:57.276590 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf04027-c845-48d3-a5fa-42b927313b45 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:57.280503 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdc087-d33d-4a8b-8f20-16c224959637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:57.281928 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdc087-d33d-4a8b-8f20-16c224959637 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:57.282229 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdc087-d33d-4a8b-8f20-16c224959637 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:57.282510 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdc087-d33d-4a8b-8f20-16c224959637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:57.292197 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bdc087-d33d-4a8b-8f20-16c224959637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:57.293685 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bdc087-d33d-4a8b-8f20-16c224959637 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:57.303673 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1184/2367] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:17:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:17:57.764810 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9e915-e7bd-4e1e-9c36-baf839feaca1 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:57.767266 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-c8b9e915-e7bd-4e1e-9c36-baf839feaca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:57.781042 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9e915-e7bd-4e1e-9c36-baf839feaca1 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:57.791360 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688338c8-ca41-48ac-bfe3-f1367957b1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:57.792245 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688338c8-ca41-48ac-bfe3-f1367957b1f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:57.792553 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688338c8-ca41-48ac-bfe3-f1367957b1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:57.792861 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688338c8-ca41-48ac-bfe3-f1367957b1f5 admin admin] PATH_INFO: `/v3/projects/18be7da85589431b9e9fac3a3bb154a4` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:57.794082 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688338c8-ca41-48ac-bfe3-f1367957b1f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18be7da85589431b9e9fac3a3bb154a4)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:57.796172 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688338c8-ca41-48ac-bfe3-f1367957b1f5 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:57.938576 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-688338c8-ca41-48ac-bfe3-f1367957b1f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18be7da85589431b9e9fac3a3bb154a4', 'request_id': 'req-688338c8-ca41-48ac-bfe3-f1367957b1f5'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:58.029780 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-688338c8-ca41-48ac-bfe3-f1367957b1f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18be7da85589431b9e9fac3a3bb154a4', 'request_id': 'req-688338c8-ca41-48ac-bfe3-f1367957b1f5'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:58.035914 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-688338c8-ca41-48ac-bfe3-f1367957b1f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18be7da85589431b9e9fac3a3bb154a4', 'request_id': 'req-688338c8-ca41-48ac-bfe3-f1367957b1f5'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:58.046713 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-688338c8-ca41-48ac-bfe3-f1367957b1f5 admin admin] The token cache is being invalidate because project 18be7da85589431b9e9fac3a3bb154a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:17:58.047490 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-688338c8-ca41-48ac-bfe3-f1367957b1f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:58.048124 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-688338c8-ca41-48ac-bfe3-f1367957b1f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:58.049678 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1184/2368] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:17:57 2021] DELETE /identity/v3/projects/18be7da85589431b9e9fac3a3bb154a4 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:17:58.053748 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdc087-d33d-4a8b-8f20-16c224959637 service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:58.063809 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdc087-d33d-4a8b-8f20-16c224959637 service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:58.096676 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688338c8-ca41-48ac-bfe3-f1367957b1f5 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:58.098189 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-688338c8-ca41-48ac-bfe3-f1367957b1f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:58.125772 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186bf9a-b935-4f27-bd09-19bca9d72de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:58.126718 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186bf9a-b935-4f27-bd09-19bca9d72de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:58.127014 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186bf9a-b935-4f27-bd09-19bca9d72de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:58.127303 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186bf9a-b935-4f27-bd09-19bca9d72de3 admin admin] PATH_INFO: `/v3/users/a0b5d971d29f46be89f0147e0b0eabb5` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:58.128585 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186bf9a-b935-4f27-bd09-19bca9d72de3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0b5d971d29f46be89f0147e0b0eabb5)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:58.130674 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186bf9a-b935-4f27-bd09-19bca9d72de3 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:58.169335 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688338c8-ca41-48ac-bfe3-f1367957b1f5 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:58.174583 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0d500-c426-4eac-a712-debddd214ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:58.175445 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0d500-c426-4eac-a712-debddd214ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:58.175723 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0d500-c426-4eac-a712-debddd214ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:58.175995 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0d500-c426-4eac-a712-debddd214ea2 admin admin] PATH_INFO: `/v3/users/f14f97daab1d499b8027de90847e6757` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:58.177201 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a0d500-c426-4eac-a712-debddd214ea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f14f97daab1d499b8027de90847e6757)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:58.179150 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a0d500-c426-4eac-a712-debddd214ea2 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:58.346490 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-3186bf9a-b935-4f27-bd09-19bca9d72de3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0b5d971d29f46be89f0147e0b0eabb5'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:58.347050 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-3186bf9a-b935-4f27-bd09-19bca9d72de3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0b5d971d29f46be89f0147e0b0eabb5'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:58.353807 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-3186bf9a-b935-4f27-bd09-19bca9d72de3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0b5d971d29f46be89f0147e0b0eabb5'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:58.403262 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-c0a0d500-c426-4eac-a712-debddd214ea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f14f97daab1d499b8027de90847e6757'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:58.403922 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-c0a0d500-c426-4eac-a712-debddd214ea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f14f97daab1d499b8027de90847e6757'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:58.404577 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-c0a0d500-c426-4eac-a712-debddd214ea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f14f97daab1d499b8027de90847e6757'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:58.411979 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-c0a0d500-c426-4eac-a712-debddd214ea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f14f97daab1d499b8027de90847e6757'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:58.424584 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-3186bf9a-b935-4f27-bd09-19bca9d72de3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0b5d971d29f46be89f0147e0b0eabb5'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:58.437660 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-3186bf9a-b935-4f27-bd09-19bca9d72de3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0b5d971d29f46be89f0147e0b0eabb5'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:58.444185 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1185/2369] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:17:58 2021] DELETE /identity/v3/users/a0b5d971d29f46be89f0147e0b0eabb5 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:17:58.481666 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-c0a0d500-c426-4eac-a712-debddd214ea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f14f97daab1d499b8027de90847e6757'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:58.500097 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1185/2370] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:17:58 2021] DELETE /identity/v3/users/f14f97daab1d499b8027de90847e6757 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:17:58.820792 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186bf9a-b935-4f27-bd09-19bca9d72de3 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:58.821835 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-3186bf9a-b935-4f27-bd09-19bca9d72de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:58.907639 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186bf9a-b935-4f27-bd09-19bca9d72de3 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:58.962007 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b9136-8b4e-46e4-912d-40a897ed1b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:58.962880 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b9136-8b4e-46e4-912d-40a897ed1b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:58.963175 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b9136-8b4e-46e4-912d-40a897ed1b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:58.963466 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b9136-8b4e-46e4-912d-40a897ed1b34 admin admin] PATH_INFO: `/v3/projects/5939c75066cc45d8bfb227964729f041` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:58.964686 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b9136-8b4e-46e4-912d-40a897ed1b34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5939c75066cc45d8bfb227964729f041)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:58.966643 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b9136-8b4e-46e4-912d-40a897ed1b34 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:59.009281 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0d500-c426-4eac-a712-debddd214ea2 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:59.009926 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-c0a0d500-c426-4eac-a712-debddd214ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:59.023970 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0d500-c426-4eac-a712-debddd214ea2 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:59.028685 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc070bd-0fa8-4aa0-b258-944dd1137818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:59.038011 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc070bd-0fa8-4aa0-b258-944dd1137818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:59.038011 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc070bd-0fa8-4aa0-b258-944dd1137818 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:59.038011 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc070bd-0fa8-4aa0-b258-944dd1137818 admin admin] PATH_INFO: `/v3/projects/16ab0c859fb64f13b73d8bd02d7f1d42` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:59.038708 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc070bd-0fa8-4aa0-b258-944dd1137818 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16ab0c859fb64f13b73d8bd02d7f1d42)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:59.040304 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc070bd-0fa8-4aa0-b258-944dd1137818 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:59.103567 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-165b9136-8b4e-46e4-912d-40a897ed1b34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5939c75066cc45d8bfb227964729f041', 'request_id': 'req-165b9136-8b4e-46e4-912d-40a897ed1b34'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:59.183968 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-bbc070bd-0fa8-4aa0-b258-944dd1137818 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16ab0c859fb64f13b73d8bd02d7f1d42', 'request_id': 'req-bbc070bd-0fa8-4aa0-b258-944dd1137818'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:59.189602 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-165b9136-8b4e-46e4-912d-40a897ed1b34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5939c75066cc45d8bfb227964729f041', 'request_id': 'req-165b9136-8b4e-46e4-912d-40a897ed1b34'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:59.195521 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-165b9136-8b4e-46e4-912d-40a897ed1b34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5939c75066cc45d8bfb227964729f041', 'request_id': 'req-165b9136-8b4e-46e4-912d-40a897ed1b34'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:59.207285 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-165b9136-8b4e-46e4-912d-40a897ed1b34 admin admin] The token cache is being invalidate because project 5939c75066cc45d8bfb227964729f041 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:17:59.209740 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-165b9136-8b4e-46e4-912d-40a897ed1b34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:59.209740 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-165b9136-8b4e-46e4-912d-40a897ed1b34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:59.209948 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1186/2371] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:17:58 2021] DELETE /identity/v3/projects/5939c75066cc45d8bfb227964729f041 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:17:59.217121 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e2805-1ed9-4def-9cda-4428741c6324 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:59.217418 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e2805-1ed9-4def-9cda-4428741c6324 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:59.217708 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e2805-1ed9-4def-9cda-4428741c6324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:59.237697 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-3e1e2805-1ed9-4def-9cda-4428741c6324 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:59.238953 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-3e1e2805-1ed9-4def-9cda-4428741c6324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:59.258286 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-bbc070bd-0fa8-4aa0-b258-944dd1137818 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16ab0c859fb64f13b73d8bd02d7f1d42', 'request_id': 'req-bbc070bd-0fa8-4aa0-b258-944dd1137818'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:59.264615 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-bbc070bd-0fa8-4aa0-b258-944dd1137818 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16ab0c859fb64f13b73d8bd02d7f1d42', 'request_id': 'req-bbc070bd-0fa8-4aa0-b258-944dd1137818'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:59.277364 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-bbc070bd-0fa8-4aa0-b258-944dd1137818 admin admin] The token cache is being invalidate because project 16ab0c859fb64f13b73d8bd02d7f1d42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:17:59.277657 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-bbc070bd-0fa8-4aa0-b258-944dd1137818 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:59.278288 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-bbc070bd-0fa8-4aa0-b258-944dd1137818 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:17:59.279841 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1186/2372] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:17:59 2021] DELETE /identity/v3/projects/16ab0c859fb64f13b73d8bd02d7f1d42 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:17:59.287589 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d9dc0-bed3-4c0d-8ad5-afdb1dd6e644 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:59.289945 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d9dc0-bed3-4c0d-8ad5-afdb1dd6e644 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:59.289945 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d9dc0-bed3-4c0d-8ad5-afdb1dd6e644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:59.309140 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-0d7d9dc0-bed3-4c0d-8ad5-afdb1dd6e644 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:59.310374 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-0d7d9dc0-bed3-4c0d-8ad5-afdb1dd6e644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:59.318976 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1187/2373] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:17:59.324321 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1187/2374] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:17:59.327523 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89cd26-1ea8-48a9-a462-08ce193b208d None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:59.327830 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89cd26-1ea8-48a9-a462-08ce193b208d None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:59.328161 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89cd26-1ea8-48a9-a462-08ce193b208d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:59.332669 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734953a8-bca3-40ae-b62b-779a4f64cb5a None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:59.332965 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734953a8-bca3-40ae-b62b-779a4f64cb5a None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:59.333242 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734953a8-bca3-40ae-b62b-779a4f64cb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:59.347173 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-cc89cd26-1ea8-48a9-a462-08ce193b208d None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:59.353120 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-cc89cd26-1ea8-48a9-a462-08ce193b208d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:59.353256 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-734953a8-bca3-40ae-b62b-779a4f64cb5a None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:59.353256 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-734953a8-bca3-40ae-b62b-779a4f64cb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:59.356665 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1188/2375] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:17:59.360322 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1188/2376] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:17:59.360995 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89cd26-1ea8-48a9-a462-08ce193b208d None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:59.364060 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734953a8-bca3-40ae-b62b-779a4f64cb5a None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:59.369961 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89cd26-1ea8-48a9-a462-08ce193b208d None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:59.372975 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734953a8-bca3-40ae-b62b-779a4f64cb5a None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:59.374621 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539e767-097a-485f-8aa0-0791a550f8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:59.375767 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539e767-097a-485f-8aa0-0791a550f8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:59.376045 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539e767-097a-485f-8aa0-0791a550f8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:59.376315 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539e767-097a-485f-8aa0-0791a550f8d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:59.377062 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539e767-097a-485f-8aa0-0791a550f8d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:17:59.377361 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539e767-097a-485f-8aa0-0791a550f8d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:59.378216 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd00bed-73e9-4a92-a267-2dcca9f3fa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:59.378863 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd00bed-73e9-4a92-a267-2dcca9f3fa82 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:59.378978 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539e767-097a-485f-8aa0-0791a550f8d5 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:59.379151 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd00bed-73e9-4a92-a267-2dcca9f3fa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:59.379433 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd00bed-73e9-4a92-a267-2dcca9f3fa82 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:59.380149 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd00bed-73e9-4a92-a267-2dcca9f3fa82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:17:59.380462 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd00bed-73e9-4a92-a267-2dcca9f3fa82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:59.382071 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd00bed-73e9-4a92-a267-2dcca9f3fa82 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:59.390291 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1189/2377] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:17:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 03:17:59.394284 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1189/2378] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:17:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 03:17:59.395093 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539e767-097a-485f-8aa0-0791a550f8d5 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:59.397991 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd00bed-73e9-4a92-a267-2dcca9f3fa82 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:59.404446 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539e767-097a-485f-8aa0-0791a550f8d5 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:59.407282 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd00bed-73e9-4a92-a267-2dcca9f3fa82 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:59.409001 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b8d3e-4bf5-4d5b-b772-51b8648603cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:59.409628 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b8d3e-4bf5-4d5b-b772-51b8648603cb admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:59.409909 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b8d3e-4bf5-4d5b-b772-51b8648603cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:59.410185 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b8d3e-4bf5-4d5b-b772-51b8648603cb admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:59.410851 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b8d3e-4bf5-4d5b-b772-51b8648603cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:59.411961 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd958903-2381-4783-ab37-a0c5918013d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:59.412625 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd958903-2381-4783-ab37-a0c5918013d7 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:59.412746 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b8d3e-4bf5-4d5b-b772-51b8648603cb admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:59.412916 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd958903-2381-4783-ab37-a0c5918013d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:59.413194 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd958903-2381-4783-ab37-a0c5918013d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:59.413869 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd958903-2381-4783-ab37-a0c5918013d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:59.415725 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd958903-2381-4783-ab37-a0c5918013d7 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:59.525011 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1190/2379] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:17:59 2021] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:17:59.526005 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b8d3e-4bf5-4d5b-b772-51b8648603cb admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:59.528161 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1190/2380] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:17:59 2021] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:17:59.532344 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd958903-2381-4783-ab37-a0c5918013d7 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:59.585945 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b8d3e-4bf5-4d5b-b772-51b8648603cb admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:59.590636 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d63a79-af75-478d-b883-fa65c35ce8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:59.591301 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d63a79-af75-478d-b883-fa65c35ce8f9 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:59.591465 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd958903-2381-4783-ab37-a0c5918013d7 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:59.591595 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d63a79-af75-478d-b883-fa65c35ce8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:59.591843 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d63a79-af75-478d-b883-fa65c35ce8f9 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:59.592551 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d63a79-af75-478d-b883-fa65c35ce8f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:59.594485 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d63a79-af75-478d-b883-fa65c35ce8f9 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:59.596344 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af4755-1183-4cf6-8d81-9c9d5c3ea09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:59.597050 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af4755-1183-4cf6-8d81-9c9d5c3ea09f admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:59.597337 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af4755-1183-4cf6-8d81-9c9d5c3ea09f admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:59.597615 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af4755-1183-4cf6-8d81-9c9d5c3ea09f admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:59.598295 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af4755-1183-4cf6-8d81-9c9d5c3ea09f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:59.600201 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af4755-1183-4cf6-8d81-9c9d5c3ea09f admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:59.671033 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1191/2381] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:17:59 2021] POST /identity/v3/users => generated 283 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:17:59.675121 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d63a79-af75-478d-b883-fa65c35ce8f9 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:59.685142 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d63a79-af75-478d-b883-fa65c35ce8f9 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:59.690491 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265cae6-d05c-4d3c-9332-5780996052ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:59.691158 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265cae6-d05c-4d3c-9332-5780996052ec admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:59.691445 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265cae6-d05c-4d3c-9332-5780996052ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:59.691722 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265cae6-d05c-4d3c-9332-5780996052ec admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:59.692601 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265cae6-d05c-4d3c-9332-5780996052ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:59.694200 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265cae6-d05c-4d3c-9332-5780996052ec admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:59.704194 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1192/2382] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:17:59 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:17:59.708192 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265cae6-d05c-4d3c-9332-5780996052ec admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:59.717956 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265cae6-d05c-4d3c-9332-5780996052ec admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:59.722788 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e35680-327a-486e-b015-1b4eb1e89a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:59.723452 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e35680-327a-486e-b015-1b4eb1e89a72 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:59.723736 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e35680-327a-486e-b015-1b4eb1e89a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:59.724016 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e35680-327a-486e-b015-1b4eb1e89a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:59.724800 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e35680-327a-486e-b015-1b4eb1e89a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:59.726394 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e35680-327a-486e-b015-1b4eb1e89a72 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:59.733747 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1191/2383] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:17:59 2021] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:17:59.738602 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af4755-1183-4cf6-8d81-9c9d5c3ea09f admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:59.741930 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1193/2384] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:17:59 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:17:59.743171 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e35680-327a-486e-b015-1b4eb1e89a72 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:59.749452 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af4755-1183-4cf6-8d81-9c9d5c3ea09f admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:59.755162 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e7f0f-d537-4c23-8aa2-c2cb2867123a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:59.755623 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e35680-327a-486e-b015-1b4eb1e89a72 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:59.755845 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e7f0f-d537-4c23-8aa2-c2cb2867123a admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:59.756129 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e7f0f-d537-4c23-8aa2-c2cb2867123a admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:59.756408 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e7f0f-d537-4c23-8aa2-c2cb2867123a admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:59.757170 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e7f0f-d537-4c23-8aa2-c2cb2867123a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:59.758774 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e7f0f-d537-4c23-8aa2-c2cb2867123a admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:59.761078 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bb049-4450-47e4-8620-3ab2b21dc2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:59.765676 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bb049-4450-47e4-8620-3ab2b21dc2a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:59.765676 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bb049-4450-47e4-8620-3ab2b21dc2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:59.765676 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bb049-4450-47e4-8620-3ab2b21dc2a5 admin admin] PATH_INFO: `/v3/projects/fc12aabf4dbc4baba84fd7de2ea1db65/users/003a20cef6f7476b991fb93f34f0383b/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:59.769431 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1192/2385] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:17:59 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:17:59.773342 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e7f0f-d537-4c23-8aa2-c2cb2867123a admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:59.784732 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bb049-4450-47e4-8620-3ab2b21dc2a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc12aabf4dbc4baba84fd7de2ea1db65, user_id=003a20cef6f7476b991fb93f34f0383b, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:59.784732 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bb049-4450-47e4-8620-3ab2b21dc2a5 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:59.788664 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e7f0f-d537-4c23-8aa2-c2cb2867123a admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:59.788918 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb999114-5cbf-458e-b72a-e954fec7ca10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:59.789453 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb999114-5cbf-458e-b72a-e954fec7ca10 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:59.789739 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb999114-5cbf-458e-b72a-e954fec7ca10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:59.790020 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb999114-5cbf-458e-b72a-e954fec7ca10 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:59.790747 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb999114-5cbf-458e-b72a-e954fec7ca10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:59.792322 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb999114-5cbf-458e-b72a-e954fec7ca10 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:59.802608 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1193/2386] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:17:59 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:17:59.806632 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb999114-5cbf-458e-b72a-e954fec7ca10 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:17:59.817222 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb999114-5cbf-458e-b72a-e954fec7ca10 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:17:59.821932 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf145bd-d10f-44da-8480-87305790de72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:17:59.822766 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf145bd-d10f-44da-8480-87305790de72 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:59.823048 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf145bd-d10f-44da-8480-87305790de72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:59.823325 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf145bd-d10f-44da-8480-87305790de72 admin admin] PATH_INFO: `/v3/projects/d342da2ccebe4ccf9d40607782e2eb54/users/db531f61fb2a405baec24793c54c9538/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:59.837609 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf145bd-d10f-44da-8480-87305790de72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d342da2ccebe4ccf9d40607782e2eb54, user_id=db531f61fb2a405baec24793c54c9538, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:17:59.840247 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf145bd-d10f-44da-8480-87305790de72 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:17:59.875926 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1194/2387] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:17:59 2021] PUT /identity/v3/projects/fc12aabf4dbc4baba84fd7de2ea1db65/users/003a20cef6f7476b991fb93f34f0383b/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:17:59.886084 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efb02b-65d2-4d23-95e0-7151d3e3be47 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:59.886370 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efb02b-65d2-4d23-95e0-7151d3e3be47 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:59.886648 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efb02b-65d2-4d23-95e0-7151d3e3be47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:59.912854 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-22efb02b-65d2-4d23-95e0-7151d3e3be47 None None] MFA Rules not processed for user `003a20cef6f7476b991fb93f34f0383b`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:59.914175 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-22efb02b-65d2-4d23-95e0-7151d3e3be47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:17:59.947848 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1194/2388] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:17:59 2021] PUT /identity/v3/projects/d342da2ccebe4ccf9d40607782e2eb54/users/db531f61fb2a405baec24793c54c9538/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:17:59.955186 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac483729-9c0e-4bd4-8512-762a03e99b5c None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:17:59.955751 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac483729-9c0e-4bd4-8512-762a03e99b5c None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:17:59.956886 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac483729-9c0e-4bd4-8512-762a03e99b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:17:59.977706 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-ac483729-9c0e-4bd4-8512-762a03e99b5c None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:17:59.979021 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-ac483729-9c0e-4bd4-8512-762a03e99b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:00.000273 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1195/2389] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:59 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:18:00.004650 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efb02b-65d2-4d23-95e0-7151d3e3be47 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:00.038380 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1195/2390] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:17:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:18:00.048913 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac483729-9c0e-4bd4-8512-762a03e99b5c None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:00.050542 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-ac483729-9c0e-4bd4-8512-762a03e99b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:00.069145 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efb02b-65d2-4d23-95e0-7151d3e3be47 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:00.077076 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a7536-8729-4bc5-b4e6-2f4bbf3e5c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:00.077822 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a7536-8729-4bc5-b4e6-2f4bbf3e5c65 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:00.078169 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a7536-8729-4bc5-b4e6-2f4bbf3e5c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:00.078508 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a7536-8729-4bc5-b4e6-2f4bbf3e5c65 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:00.079262 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a7536-8729-4bc5-b4e6-2f4bbf3e5c65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:00.081777 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a7536-8729-4bc5-b4e6-2f4bbf3e5c65 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:00.107185 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac483729-9c0e-4bd4-8512-762a03e99b5c None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:00.112209 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b16b04-f017-42fa-8f4a-0f5473471d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:00.112209 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b16b04-f017-42fa-8f4a-0f5473471d29 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:00.112469 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b16b04-f017-42fa-8f4a-0f5473471d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:00.113111 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b16b04-f017-42fa-8f4a-0f5473471d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:00.123089 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b16b04-f017-42fa-8f4a-0f5473471d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:00.124817 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b16b04-f017-42fa-8f4a-0f5473471d29 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:00.135256 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1196/2391] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:18:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:18:00.158388 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1196/2392] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:18:00 2021] POST /identity/v3/projects => generated 367 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:18:00.162285 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b16b04-f017-42fa-8f4a-0f5473471d29 service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:00.171585 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b16b04-f017-42fa-8f4a-0f5473471d29 service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:00.228108 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd62146-8745-4c74-be68-ec47768d0258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:00.228827 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd62146-8745-4c74-be68-ec47768d0258 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:00.229114 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd62146-8745-4c74-be68-ec47768d0258 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:00.229389 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd62146-8745-4c74-be68-ec47768d0258 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:00.230070 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd62146-8745-4c74-be68-ec47768d0258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:00.232264 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd62146-8745-4c74-be68-ec47768d0258 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:00.355990 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1197/2393] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:18:00 2021] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:18:00.360448 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a7536-8729-4bc5-b4e6-2f4bbf3e5c65 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:00.370603 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a7536-8729-4bc5-b4e6-2f4bbf3e5c65 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:00.375079 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e39b92-1356-48e5-9684-696c63ecaf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:00.375735 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e39b92-1356-48e5-9684-696c63ecaf30 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:00.376013 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e39b92-1356-48e5-9684-696c63ecaf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:00.376285 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e39b92-1356-48e5-9684-696c63ecaf30 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:00.377111 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e39b92-1356-48e5-9684-696c63ecaf30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:00.378686 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e39b92-1356-48e5-9684-696c63ecaf30 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:00.393443 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1197/2394] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:18:00 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:18:00.396245 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd62146-8745-4c74-be68-ec47768d0258 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:00.403105 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e39b92-1356-48e5-9684-696c63ecaf30 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:00.405023 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-50e39b92-1356-48e5-9684-696c63ecaf30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:00.406824 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd62146-8745-4c74-be68-ec47768d0258 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:00.411511 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc82c6a-dd58-4dff-a631-697978b89d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:00.412362 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc82c6a-dd58-4dff-a631-697978b89d04 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:00.412669 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc82c6a-dd58-4dff-a631-697978b89d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:00.412942 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc82c6a-dd58-4dff-a631-697978b89d04 admin admin] PATH_INFO: `/v3/projects/9040a0a420084b1b8f969e267cb7c23d/users/d5d0a29c16a6403e942ae2605f8ce21d/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:00.418456 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e39b92-1356-48e5-9684-696c63ecaf30 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:00.423935 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32438c4-a0cd-4c53-8bfb-787b1e85e128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:00.424886 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32438c4-a0cd-4c53-8bfb-787b1e85e128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:00.425167 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32438c4-a0cd-4c53-8bfb-787b1e85e128 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:00.425437 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32438c4-a0cd-4c53-8bfb-787b1e85e128 admin admin] PATH_INFO: `/v3/users/c51af46549f342cb8395fea0684a95f1` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:00.426627 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32438c4-a0cd-4c53-8bfb-787b1e85e128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c51af46549f342cb8395fea0684a95f1)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:00.427729 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc82c6a-dd58-4dff-a631-697978b89d04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9040a0a420084b1b8f969e267cb7c23d, user_id=d5d0a29c16a6403e942ae2605f8ce21d, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:00.428602 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32438c4-a0cd-4c53-8bfb-787b1e85e128 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:00.430394 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc82c6a-dd58-4dff-a631-697978b89d04 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:00.500850 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1198/2395] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:18:00 2021] PUT /identity/v3/projects/9040a0a420084b1b8f969e267cb7c23d/users/d5d0a29c16a6403e942ae2605f8ce21d/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:00.504808 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc82c6a-dd58-4dff-a631-697978b89d04 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:00.568412 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc82c6a-dd58-4dff-a631-697978b89d04 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:00.573317 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3aa8e-513e-4017-aabd-4004251815af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:00.574010 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3aa8e-513e-4017-aabd-4004251815af admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:00.574297 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3aa8e-513e-4017-aabd-4004251815af admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:00.574607 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3aa8e-513e-4017-aabd-4004251815af admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:00.575348 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e3aa8e-513e-4017-aabd-4004251815af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:00.576996 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e3aa8e-513e-4017-aabd-4004251815af admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:00.591839 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1199/2396] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:18:00 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:18:00.596086 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3aa8e-513e-4017-aabd-4004251815af admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:00.605745 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3aa8e-513e-4017-aabd-4004251815af admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:00.610681 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04564e9f-f57c-4646-9734-4e6a5602dcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:00.611550 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04564e9f-f57c-4646-9734-4e6a5602dcac admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:00.611832 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04564e9f-f57c-4646-9734-4e6a5602dcac admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:00.612112 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04564e9f-f57c-4646-9734-4e6a5602dcac admin admin] PATH_INFO: `/v3/projects/9040a0a420084b1b8f969e267cb7c23d/users/d5d0a29c16a6403e942ae2605f8ce21d/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:00.614139 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04564e9f-f57c-4646-9734-4e6a5602dcac admin admin] RBAC: Authorizing `identity:create_grant(project_id=9040a0a420084b1b8f969e267cb7c23d, user_id=d5d0a29c16a6403e942ae2605f8ce21d, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:00.616906 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04564e9f-f57c-4646-9734-4e6a5602dcac admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:00.629065 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1200/2397] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:18:00 2021] PUT /identity/v3/projects/9040a0a420084b1b8f969e267cb7c23d/users/d5d0a29c16a6403e942ae2605f8ce21d/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:18:00.633545 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e32438c4-a0cd-4c53-8bfb-787b1e85e128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c51af46549f342cb8395fea0684a95f1'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:00.634269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e32438c4-a0cd-4c53-8bfb-787b1e85e128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c51af46549f342cb8395fea0684a95f1'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:00.634878 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e32438c4-a0cd-4c53-8bfb-787b1e85e128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c51af46549f342cb8395fea0684a95f1'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:00.639777 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930750e-ae62-41df-8f31-a805209989e6 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:00.640043 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930750e-ae62-41df-8f31-a805209989e6 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:00.640610 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930750e-ae62-41df-8f31-a805209989e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:00.643869 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e32438c4-a0cd-4c53-8bfb-787b1e85e128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c51af46549f342cb8395fea0684a95f1'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:00.667880 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-5930750e-ae62-41df-8f31-a805209989e6 None None] MFA Rules not processed for user `d5d0a29c16a6403e942ae2605f8ce21d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:00.669255 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-5930750e-ae62-41df-8f31-a805209989e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:00.721403 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e32438c4-a0cd-4c53-8bfb-787b1e85e128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c51af46549f342cb8395fea0684a95f1'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:00.744832 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1198/2398] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:18:00 2021] DELETE /identity/v3/users/c51af46549f342cb8395fea0684a95f1 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:18:00.749528 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dfe3f-59d5-45b2-a25a-8f5b85e88900 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:00.749925 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dfe3f-59d5-45b2-a25a-8f5b85e88900 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:00.750329 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dfe3f-59d5-45b2-a25a-8f5b85e88900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:00.753584 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1201/2399] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:00 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:18:00.764934 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930750e-ae62-41df-8f31-a805209989e6 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:00.766412 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-5930750e-ae62-41df-8f31-a805209989e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:00.770517 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-c14dfe3f-59d5-45b2-a25a-8f5b85e88900 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:00.771776 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-c14dfe3f-59d5-45b2-a25a-8f5b85e88900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:00.832045 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930750e-ae62-41df-8f31-a805209989e6 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:00.845294 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1199/2400] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:18:00.855271 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14dfe3f-59d5-45b2-a25a-8f5b85e88900 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:00.856963 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-c14dfe3f-59d5-45b2-a25a-8f5b85e88900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:00.882886 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d95a8-9476-4cad-bed3-099aaada2a7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:00.883697 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d95a8-9476-4cad-bed3-099aaada2a7e service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:00.884086 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d95a8-9476-4cad-bed3-099aaada2a7e service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:00.884465 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d95a8-9476-4cad-bed3-099aaada2a7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:00.923401 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14dfe3f-59d5-45b2-a25a-8f5b85e88900 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:00.923401 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23a435-fda2-43ba-8c1f-88a28a609d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:00.923401 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23a435-fda2-43ba-8c1f-88a28a609d65 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:00.923401 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23a435-fda2-43ba-8c1f-88a28a609d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:00.923832 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23a435-fda2-43ba-8c1f-88a28a609d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:00.930724 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23a435-fda2-43ba-8c1f-88a28a609d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:00.932223 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23a435-fda2-43ba-8c1f-88a28a609d65 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:00.943108 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1200/2401] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:18:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:18:00.956638 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d95a8-9476-4cad-bed3-099aaada2a7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:00.958101 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d95a8-9476-4cad-bed3-099aaada2a7e service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:00.978067 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1202/2402] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:18:00 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:18:01.109542 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23a435-fda2-43ba-8c1f-88a28a609d65 service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:01.111036 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-ba23a435-fda2-43ba-8c1f-88a28a609d65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:01.122724 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23a435-fda2-43ba-8c1f-88a28a609d65 service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:01.126379 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19b6a2-b0ce-4d0c-a465-d7e3a8713528 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:01.130105 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19b6a2-b0ce-4d0c-a465-d7e3a8713528 service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:01.130105 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19b6a2-b0ce-4d0c-a465-d7e3a8713528 service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:01.130105 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19b6a2-b0ce-4d0c-a465-d7e3a8713528 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:01.130105 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-2a19b6a2-b0ce-4d0c-a465-d7e3a8713528 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:01.188749 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19b6a2-b0ce-4d0c-a465-d7e3a8713528 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:01.190616 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19b6a2-b0ce-4d0c-a465-d7e3a8713528 service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:01.204973 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1201/2403] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:18:01 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:18:01.406664 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d95a8-9476-4cad-bed3-099aaada2a7e service cinder] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:01.406664 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-cc8d95a8-9476-4cad-bed3-099aaada2a7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:01.418882 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d95a8-9476-4cad-bed3-099aaada2a7e service cinder] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:01.424962 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a2ab4-ff02-4478-bed4-064f9f93276d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:01.425870 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a2ab4-ff02-4478-bed4-064f9f93276d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:01.426143 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a2ab4-ff02-4478-bed4-064f9f93276d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:01.426423 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a2ab4-ff02-4478-bed4-064f9f93276d admin admin] PATH_INFO: `/v3/projects/3e58ec06f1e646419f6cc969e98658aa` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:01.427622 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a2ab4-ff02-4478-bed4-064f9f93276d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e58ec06f1e646419f6cc969e98658aa)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:01.429578 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a2ab4-ff02-4478-bed4-064f9f93276d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:01.578903 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-077a2ab4-ff02-4478-bed4-064f9f93276d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e58ec06f1e646419f6cc969e98658aa', 'request_id': 'req-077a2ab4-ff02-4478-bed4-064f9f93276d'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:01.601557 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86c4cc-b564-4307-abc2-b90c9d6ac1f0 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:01.601557 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86c4cc-b564-4307-abc2-b90c9d6ac1f0 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:01.601745 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86c4cc-b564-4307-abc2-b90c9d6ac1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:01.629115 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-5a86c4cc-b564-4307-abc2-b90c9d6ac1f0 None None] MFA Rules not processed for user `db531f61fb2a405baec24793c54c9538`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:01.630555 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-5a86c4cc-b564-4307-abc2-b90c9d6ac1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:01.647608 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-077a2ab4-ff02-4478-bed4-064f9f93276d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e58ec06f1e646419f6cc969e98658aa', 'request_id': 'req-077a2ab4-ff02-4478-bed4-064f9f93276d'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:01.656686 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-077a2ab4-ff02-4478-bed4-064f9f93276d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e58ec06f1e646419f6cc969e98658aa', 'request_id': 'req-077a2ab4-ff02-4478-bed4-064f9f93276d'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:01.668273 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-077a2ab4-ff02-4478-bed4-064f9f93276d admin admin] The token cache is being invalidate because project 3e58ec06f1e646419f6cc969e98658aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:18:01.668669 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-077a2ab4-ff02-4478-bed4-064f9f93276d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:01.674725 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-077a2ab4-ff02-4478-bed4-064f9f93276d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:01.674725 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1203/2404] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:18:01 2021] DELETE /identity/v3/projects/3e58ec06f1e646419f6cc969e98658aa => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:01.675444 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a2ab4-ff02-4478-bed4-064f9f93276d admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:01.677527 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-077a2ab4-ff02-4478-bed4-064f9f93276d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:01.700450 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1202/2405] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:01 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:18:01.710995 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86c4cc-b564-4307-abc2-b90c9d6ac1f0 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:01.712524 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-5a86c4cc-b564-4307-abc2-b90c9d6ac1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:01.748187 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a2ab4-ff02-4478-bed4-064f9f93276d admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:01.753267 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ce49d-b2a4-4b84-8b4a-875c291fe925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:01.754141 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ce49d-b2a4-4b84-8b4a-875c291fe925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:01.754430 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ce49d-b2a4-4b84-8b4a-875c291fe925 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:01.754712 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ce49d-b2a4-4b84-8b4a-875c291fe925 admin admin] PATH_INFO: `/v3/users/bfe715fa235b48eb82d3152a00daaa91` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:01.756034 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ce49d-b2a4-4b84-8b4a-875c291fe925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfe715fa235b48eb82d3152a00daaa91)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:01.758082 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ce49d-b2a4-4b84-8b4a-875c291fe925 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:01.773242 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86c4cc-b564-4307-abc2-b90c9d6ac1f0 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:01.777095 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f331291-b5ed-4c4b-9cef-175dce8eac3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:01.777811 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f331291-b5ed-4c4b-9cef-175dce8eac3e service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:01.778096 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f331291-b5ed-4c4b-9cef-175dce8eac3e service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:01.778375 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f331291-b5ed-4c4b-9cef-175dce8eac3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:01.787557 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f331291-b5ed-4c4b-9cef-175dce8eac3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:01.789033 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f331291-b5ed-4c4b-9cef-175dce8eac3e service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:01.797947 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1203/2406] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:18:01 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:18:01.940544 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1b5ce49d-b2a4-4b84-8b4a-875c291fe925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfe715fa235b48eb82d3152a00daaa91'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:01.941197 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1b5ce49d-b2a4-4b84-8b4a-875c291fe925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfe715fa235b48eb82d3152a00daaa91'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:01.947965 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1b5ce49d-b2a4-4b84-8b4a-875c291fe925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfe715fa235b48eb82d3152a00daaa91'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:02.041313 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1b5ce49d-b2a4-4b84-8b4a-875c291fe925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfe715fa235b48eb82d3152a00daaa91'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:02.055662 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1b5ce49d-b2a4-4b84-8b4a-875c291fe925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfe715fa235b48eb82d3152a00daaa91'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:02.065476 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1204/2407] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:18:01 2021] DELETE /identity/v3/users/bfe715fa235b48eb82d3152a00daaa91 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:02.523230 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f331291-b5ed-4c4b-9cef-175dce8eac3e service cinder] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:02.550683 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f331291-b5ed-4c4b-9cef-175dce8eac3e service cinder] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:02.600201 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c6d28-06fb-482a-8c46-c1fd2df9e87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:02.601019 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c6d28-06fb-482a-8c46-c1fd2df9e87d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:02.601257 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c6d28-06fb-482a-8c46-c1fd2df9e87d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:02.601533 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c6d28-06fb-482a-8c46-c1fd2df9e87d admin admin] PATH_INFO: `/v3/projects/83548b9f55574ee2860166b19c85c959` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:02.602722 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c6d28-06fb-482a-8c46-c1fd2df9e87d admin admin] RBAC: Authorizing `identity:delete_project(project_id=83548b9f55574ee2860166b19c85c959)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:02.604641 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c6d28-06fb-482a-8c46-c1fd2df9e87d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:02.767553 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-2f9c6d28-06fb-482a-8c46-c1fd2df9e87d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83548b9f55574ee2860166b19c85c959', 'request_id': 'req-2f9c6d28-06fb-482a-8c46-c1fd2df9e87d'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:02.858443 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-2f9c6d28-06fb-482a-8c46-c1fd2df9e87d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83548b9f55574ee2860166b19c85c959', 'request_id': 'req-2f9c6d28-06fb-482a-8c46-c1fd2df9e87d'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:02.865269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-2f9c6d28-06fb-482a-8c46-c1fd2df9e87d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83548b9f55574ee2860166b19c85c959', 'request_id': 'req-2f9c6d28-06fb-482a-8c46-c1fd2df9e87d'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:02.876331 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-2f9c6d28-06fb-482a-8c46-c1fd2df9e87d admin admin] The token cache is being invalidate because project 83548b9f55574ee2860166b19c85c959 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:18:02.876674 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-2f9c6d28-06fb-482a-8c46-c1fd2df9e87d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:02.877297 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-2f9c6d28-06fb-482a-8c46-c1fd2df9e87d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:02.878850 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1204/2408] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:18:02 2021] DELETE /identity/v3/projects/83548b9f55574ee2860166b19c85c959 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:02.884915 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e90e5e-e37f-4393-a27c-151f2ad86c7a None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:02.885405 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e90e5e-e37f-4393-a27c-151f2ad86c7a None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:02.885499 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e90e5e-e37f-4393-a27c-151f2ad86c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:02.907368 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-86e90e5e-e37f-4393-a27c-151f2ad86c7a None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:02.908616 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-86e90e5e-e37f-4393-a27c-151f2ad86c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:02.964113 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1205/2409] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:18:02.972448 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80c464-befd-442c-ae05-4f9e6a42fb23 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:02.972767 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80c464-befd-442c-ae05-4f9e6a42fb23 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:02.973048 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80c464-befd-442c-ae05-4f9e6a42fb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:02.991889 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-ee80c464-befd-442c-ae05-4f9e6a42fb23 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:02.993136 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-ee80c464-befd-442c-ae05-4f9e6a42fb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:03.001648 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1205/2410] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:18:03.005586 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e90e5e-e37f-4393-a27c-151f2ad86c7a None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:03.014993 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e90e5e-e37f-4393-a27c-151f2ad86c7a None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:03.020224 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27025998-ad9c-4c41-bce7-81c2958de303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:03.020858 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27025998-ad9c-4c41-bce7-81c2958de303 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:03.021142 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27025998-ad9c-4c41-bce7-81c2958de303 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:03.021421 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27025998-ad9c-4c41-bce7-81c2958de303 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:03.022139 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27025998-ad9c-4c41-bce7-81c2958de303 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:18:03.022449 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27025998-ad9c-4c41-bce7-81c2958de303 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:03.024065 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27025998-ad9c-4c41-bce7-81c2958de303 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:03.035357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1206/2411] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:18:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:18:03.039501 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80c464-befd-442c-ae05-4f9e6a42fb23 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:03.048440 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80c464-befd-442c-ae05-4f9e6a42fb23 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:03.053206 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494caeae-a6ab-4ca6-b89c-4365ac7ac1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:03.053861 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494caeae-a6ab-4ca6-b89c-4365ac7ac1e3 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:03.054143 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494caeae-a6ab-4ca6-b89c-4365ac7ac1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:03.054417 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494caeae-a6ab-4ca6-b89c-4365ac7ac1e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:03.055103 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494caeae-a6ab-4ca6-b89c-4365ac7ac1e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:03.057045 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494caeae-a6ab-4ca6-b89c-4365ac7ac1e3 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:03.180155 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1206/2412] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:18:03 2021] POST /identity/v3/projects => generated 367 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:18:03.181130 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27025998-ad9c-4c41-bce7-81c2958de303 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:03.191758 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27025998-ad9c-4c41-bce7-81c2958de303 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:03.248856 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92143df7-5ba2-47e8-b9f7-7803a2c09dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:03.249538 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92143df7-5ba2-47e8-b9f7-7803a2c09dfd admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:03.249849 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92143df7-5ba2-47e8-b9f7-7803a2c09dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:03.250131 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92143df7-5ba2-47e8-b9f7-7803a2c09dfd admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:03.250818 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92143df7-5ba2-47e8-b9f7-7803a2c09dfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:03.252756 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92143df7-5ba2-47e8-b9f7-7803a2c09dfd admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:03.338543 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1207/2413] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:18:03 2021] POST /identity/v3/users => generated 284 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:18:03.342767 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494caeae-a6ab-4ca6-b89c-4365ac7ac1e3 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:03.353708 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494caeae-a6ab-4ca6-b89c-4365ac7ac1e3 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:03.358835 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d45c64-dc65-44da-9e29-a7952c25f02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:03.359563 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d45c64-dc65-44da-9e29-a7952c25f02c admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:03.359842 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d45c64-dc65-44da-9e29-a7952c25f02c admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:03.360114 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d45c64-dc65-44da-9e29-a7952c25f02c admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:03.360872 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d45c64-dc65-44da-9e29-a7952c25f02c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:03.362446 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d45c64-dc65-44da-9e29-a7952c25f02c admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:03.372656 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1207/2414] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:18:03 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:18:03.376396 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92143df7-5ba2-47e8-b9f7-7803a2c09dfd admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:03.386192 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92143df7-5ba2-47e8-b9f7-7803a2c09dfd admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:03.391430 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e9010-2247-4adf-864d-dba0f80ff2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:03.392089 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e9010-2247-4adf-864d-dba0f80ff2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:03.392373 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e9010-2247-4adf-864d-dba0f80ff2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:03.392694 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e9010-2247-4adf-864d-dba0f80ff2a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:03.393412 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e9010-2247-4adf-864d-dba0f80ff2a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:03.395033 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e9010-2247-4adf-864d-dba0f80ff2a6 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:03.405381 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1208/2415] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:18:03 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:18:03.409971 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d45c64-dc65-44da-9e29-a7952c25f02c admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:03.420208 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d45c64-dc65-44da-9e29-a7952c25f02c admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:03.427047 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8e536-86ee-4eaf-a089-22b288deb7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:03.427047 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8e536-86ee-4eaf-a089-22b288deb7f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:03.427047 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8e536-86ee-4eaf-a089-22b288deb7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:03.427047 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8e536-86ee-4eaf-a089-22b288deb7f8 admin admin] PATH_INFO: `/v3/projects/b0c7a29c64374e778bb1a00b653ab209/users/7fd15a462e45488093fd6300c5048fcc/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:03.441205 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8e536-86ee-4eaf-a089-22b288deb7f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0c7a29c64374e778bb1a00b653ab209, user_id=7fd15a462e45488093fd6300c5048fcc, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:03.443838 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8e536-86ee-4eaf-a089-22b288deb7f8 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:03.539169 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1208/2416] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:18:03 2021] PUT /identity/v3/projects/b0c7a29c64374e778bb1a00b653ab209/users/7fd15a462e45488093fd6300c5048fcc/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:03.549263 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5bb40-9a71-48c8-a514-7a032d9cc1ad None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:03.549591 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5bb40-9a71-48c8-a514-7a032d9cc1ad None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:03.549877 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5bb40-9a71-48c8-a514-7a032d9cc1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:03.576732 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-0af5bb40-9a71-48c8-a514-7a032d9cc1ad None None] MFA Rules not processed for user `7fd15a462e45488093fd6300c5048fcc`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:03.578425 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-0af5bb40-9a71-48c8-a514-7a032d9cc1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:03.628509 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566046b-af0d-44e5-9539-3b121067d641 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:03.628811 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566046b-af0d-44e5-9539-3b121067d641 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:03.629040 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566046b-af0d-44e5-9539-3b121067d641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:03.645851 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1209/2417] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:03 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:18:03.647324 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-1566046b-af0d-44e5-9539-3b121067d641 None None] MFA Rules not processed for user `db531f61fb2a405baec24793c54c9538`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:03.648577 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-1566046b-af0d-44e5-9539-3b121067d641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:03.650243 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5bb40-9a71-48c8-a514-7a032d9cc1ad None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:03.703584 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1209/2418] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:03 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:18:03.711264 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5bb40-9a71-48c8-a514-7a032d9cc1ad None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:03.716085 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95984aa9-4a7e-4ff4-9273-e9bd0ea577d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:03.716817 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95984aa9-4a7e-4ff4-9273-e9bd0ea577d4 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:03.717097 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95984aa9-4a7e-4ff4-9273-e9bd0ea577d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:03.717395 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95984aa9-4a7e-4ff4-9273-e9bd0ea577d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:03.718173 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95984aa9-4a7e-4ff4-9273-e9bd0ea577d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:03.721633 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95984aa9-4a7e-4ff4-9273-e9bd0ea577d4 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:03.830578 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1210/2419] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:18:03 2021] POST /identity/v3/projects => generated 367 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:18:03.831968 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566046b-af0d-44e5-9539-3b121067d641 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:03.843116 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566046b-af0d-44e5-9539-3b121067d641 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:03.907505 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c39a9-22ce-4883-96ce-b57a57df343b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:03.908193 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c39a9-22ce-4883-96ce-b57a57df343b admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:03.908507 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c39a9-22ce-4883-96ce-b57a57df343b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:03.908831 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c39a9-22ce-4883-96ce-b57a57df343b admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:03.909541 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c39a9-22ce-4883-96ce-b57a57df343b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:03.911591 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c39a9-22ce-4883-96ce-b57a57df343b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:03.948765 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95984aa9-4a7e-4ff4-9273-e9bd0ea577d4 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:03.950522 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-95984aa9-4a7e-4ff4-9273-e9bd0ea577d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:04.007018 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95984aa9-4a7e-4ff4-9273-e9bd0ea577d4 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:04.010720 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa6516-de97-4230-8e75-39f2c6b1b1ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:04.011406 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa6516-de97-4230-8e75-39f2c6b1b1ee service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:04.011691 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa6516-de97-4230-8e75-39f2c6b1b1ee service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:04.011969 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa6516-de97-4230-8e75-39f2c6b1b1ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:04.013745 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-cbfa6516-de97-4230-8e75-39f2c6b1b1ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:04.025759 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa6516-de97-4230-8e75-39f2c6b1b1ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:04.025759 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa6516-de97-4230-8e75-39f2c6b1b1ee service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:04.034524 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1211/2420] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:18:03 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:18:04.034888 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1210/2421] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:18:03 2021] POST /identity/v3/users => generated 290 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:18:04.036215 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c39a9-22ce-4883-96ce-b57a57df343b admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:04.048010 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c39a9-22ce-4883-96ce-b57a57df343b admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:04.053672 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bc4a4-fe0c-4657-a261-e8b4a163c06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:04.054403 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bc4a4-fe0c-4657-a261-e8b4a163c06e admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:04.054732 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bc4a4-fe0c-4657-a261-e8b4a163c06e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:04.055010 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bc4a4-fe0c-4657-a261-e8b4a163c06e admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:04.055884 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747bc4a4-fe0c-4657-a261-e8b4a163c06e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:04.057773 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747bc4a4-fe0c-4657-a261-e8b4a163c06e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:04.069768 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1211/2422] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:18:04 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:18:04.081282 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa6516-de97-4230-8e75-39f2c6b1b1ee service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:04.085906 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa6516-de97-4230-8e75-39f2c6b1b1ee service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:04.091597 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67de801-e13e-4bb3-82f4-b436082cf8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:04.092624 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67de801-e13e-4bb3-82f4-b436082cf8e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:04.092912 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67de801-e13e-4bb3-82f4-b436082cf8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:04.093191 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67de801-e13e-4bb3-82f4-b436082cf8e0 admin admin] PATH_INFO: `/v3/projects/ae98838dfd344dbd9cf369d3559f5f22/users/09af9c9140244dd0bf627eca33a3f5a3/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:04.108945 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67de801-e13e-4bb3-82f4-b436082cf8e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae98838dfd344dbd9cf369d3559f5f22, user_id=09af9c9140244dd0bf627eca33a3f5a3, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:04.115704 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67de801-e13e-4bb3-82f4-b436082cf8e0 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:04.179280 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1212/2423] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:18:04 2021] PUT /identity/v3/projects/ae98838dfd344dbd9cf369d3559f5f22/users/09af9c9140244dd0bf627eca33a3f5a3/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:04.183349 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bc4a4-fe0c-4657-a261-e8b4a163c06e admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:04.193991 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bc4a4-fe0c-4657-a261-e8b4a163c06e admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:04.252639 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11cb6f-593e-439a-b50c-9dff877079a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:04.253438 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11cb6f-593e-439a-b50c-9dff877079a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:04.253593 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11cb6f-593e-439a-b50c-9dff877079a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:04.253863 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11cb6f-593e-439a-b50c-9dff877079a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:04.254588 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11cb6f-593e-439a-b50c-9dff877079a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:04.256275 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11cb6f-593e-439a-b50c-9dff877079a8 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:04.266921 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1212/2424] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:18:04 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:18:04.271278 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67de801-e13e-4bb3-82f4-b436082cf8e0 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:04.281958 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67de801-e13e-4bb3-82f4-b436082cf8e0 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:04.286756 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757aba9-3abf-45f1-b0ec-4cc892a0e8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:04.287722 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757aba9-3abf-45f1-b0ec-4cc892a0e8c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:04.288005 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757aba9-3abf-45f1-b0ec-4cc892a0e8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:04.288282 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757aba9-3abf-45f1-b0ec-4cc892a0e8c6 admin admin] PATH_INFO: `/v3/projects/ae98838dfd344dbd9cf369d3559f5f22/users/09af9c9140244dd0bf627eca33a3f5a3/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:04.290300 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757aba9-3abf-45f1-b0ec-4cc892a0e8c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae98838dfd344dbd9cf369d3559f5f22, user_id=09af9c9140244dd0bf627eca33a3f5a3, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:04.292962 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757aba9-3abf-45f1-b0ec-4cc892a0e8c6 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:04.303108 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1213/2425] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:18:04 2021] PUT /identity/v3/projects/ae98838dfd344dbd9cf369d3559f5f22/users/09af9c9140244dd0bf627eca33a3f5a3/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:18:04.314064 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59616256-001e-4876-862d-9d01a7f28063 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:04.314354 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59616256-001e-4876-862d-9d01a7f28063 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:04.314637 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59616256-001e-4876-862d-9d01a7f28063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:04.326709 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757aba9-3abf-45f1-b0ec-4cc892a0e8c6 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:04.329227 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-9757aba9-3abf-45f1-b0ec-4cc892a0e8c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:04.341849 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-59616256-001e-4876-862d-9d01a7f28063 None None] MFA Rules not processed for user `09af9c9140244dd0bf627eca33a3f5a3`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:04.342999 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-59616256-001e-4876-862d-9d01a7f28063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:04.402310 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757aba9-3abf-45f1-b0ec-4cc892a0e8c6 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:04.411932 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfe7c5-84c0-49a2-bf11-f6a8a0886641 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:04.412843 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfe7c5-84c0-49a2-bf11-f6a8a0886641 service nova] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:04.413275 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfe7c5-84c0-49a2-bf11-f6a8a0886641 service nova] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:04.413770 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfe7c5-84c0-49a2-bf11-f6a8a0886641 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:04.415878 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-70dfe7c5-84c0-49a2-bf11-f6a8a0886641 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:04.430053 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1213/2426] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:04 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:18:04.431061 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59616256-001e-4876-862d-9d01a7f28063 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:04.432346 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-59616256-001e-4876-862d-9d01a7f28063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:04.485923 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dfe7c5-84c0-49a2-bf11-f6a8a0886641 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:04.487639 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dfe7c5-84c0-49a2-bf11-f6a8a0886641 service nova] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:04.497090 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1214/2427] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:18:04 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:18:04.497976 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfe7c5-84c0-49a2-bf11-f6a8a0886641 service nova] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:04.499420 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-70dfe7c5-84c0-49a2-bf11-f6a8a0886641 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:04.500307 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59616256-001e-4876-862d-9d01a7f28063 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:04.506836 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dae4c6-0156-4b82-9809-dca63bc49a06 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b7e780a23e4ee499cb7820a85feccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:04.507571 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dae4c6-0156-4b82-9809-dca63bc49a06 service placement] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:04.507930 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dae4c6-0156-4b82-9809-dca63bc49a06 service placement] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:04.508275 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dae4c6-0156-4b82-9809-dca63bc49a06 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:04.510259 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-d3dae4c6-0156-4b82-9809-dca63bc49a06 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:04.522102 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dae4c6-0156-4b82-9809-dca63bc49a06 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:04.523770 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dae4c6-0156-4b82-9809-dca63bc49a06 service placement] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:04.535320 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1214/2428] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:18:04 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:18:04.558552 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfe7c5-84c0-49a2-bf11-f6a8a0886641 service nova] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:04.563317 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13b526-bfd0-4631-91f9-960ff4585d2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:04.563967 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13b526-bfd0-4631-91f9-960ff4585d2e service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:04.564248 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13b526-bfd0-4631-91f9-960ff4585d2e service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:04.564547 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13b526-bfd0-4631-91f9-960ff4585d2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:04.574192 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13b526-bfd0-4631-91f9-960ff4585d2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:04.575617 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13b526-bfd0-4631-91f9-960ff4585d2e service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:04.585348 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1215/2429] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:18:04 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:18:06.345323 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dae4c6-0156-4b82-9809-dca63bc49a06 service placement] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:06.350602 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-d3dae4c6-0156-4b82-9809-dca63bc49a06 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:06.410326 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dae4c6-0156-4b82-9809-dca63bc49a06 service placement] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:06.418713 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d8cd6-4e53-4924-9ab7-e678b749b670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:06.418713 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d8cd6-4e53-4924-9ab7-e678b749b670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:06.418713 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d8cd6-4e53-4924-9ab7-e678b749b670 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:06.418713 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d8cd6-4e53-4924-9ab7-e678b749b670 admin admin] PATH_INFO: `/v3/users/003a20cef6f7476b991fb93f34f0383b` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:06.419121 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d8cd6-4e53-4924-9ab7-e678b749b670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=003a20cef6f7476b991fb93f34f0383b)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:06.419760 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d8cd6-4e53-4924-9ab7-e678b749b670 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:06.557058 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-fd2d8cd6-4e53-4924-9ab7-e678b749b670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '003a20cef6f7476b991fb93f34f0383b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:06.562028 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-fd2d8cd6-4e53-4924-9ab7-e678b749b670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '003a20cef6f7476b991fb93f34f0383b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:06.562028 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-fd2d8cd6-4e53-4924-9ab7-e678b749b670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '003a20cef6f7476b991fb93f34f0383b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:06.565566 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-fd2d8cd6-4e53-4924-9ab7-e678b749b670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '003a20cef6f7476b991fb93f34f0383b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:06.625380 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-fd2d8cd6-4e53-4924-9ab7-e678b749b670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '003a20cef6f7476b991fb93f34f0383b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:06.648594 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1215/2430] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:18:06 2021] DELETE /identity/v3/users/003a20cef6f7476b991fb93f34f0383b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:06.651065 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a3632-3bca-4013-b3f9-8ee42bd09472 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:06.651545 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a3632-3bca-4013-b3f9-8ee42bd09472 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:06.651823 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a3632-3bca-4013-b3f9-8ee42bd09472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:06.668602 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-e55a3632-3bca-4013-b3f9-8ee42bd09472 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:06.669794 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-e55a3632-3bca-4013-b3f9-8ee42bd09472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:06.725813 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1216/2431] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:18:06.736240 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d8cd6-4e53-4924-9ab7-e678b749b670 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:06.737763 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-fd2d8cd6-4e53-4924-9ab7-e678b749b670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:06.800319 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d8cd6-4e53-4924-9ab7-e678b749b670 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:06.804635 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d0304-0323-48ef-9934-4d2f94951472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:06.804884 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d0304-0323-48ef-9934-4d2f94951472 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:06.805162 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d0304-0323-48ef-9934-4d2f94951472 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:06.805439 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d0304-0323-48ef-9934-4d2f94951472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:06.816083 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d0304-0323-48ef-9934-4d2f94951472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:06.817584 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d0304-0323-48ef-9934-4d2f94951472 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:06.827985 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1216/2432] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:18:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:18:07.364103 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a3632-3bca-4013-b3f9-8ee42bd09472 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:07.365667 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-e55a3632-3bca-4013-b3f9-8ee42bd09472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:07.379671 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a3632-3bca-4013-b3f9-8ee42bd09472 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:07.383803 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c784bc1-828c-4b97-8ddb-94de5bb1ea47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:07.384993 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c784bc1-828c-4b97-8ddb-94de5bb1ea47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:07.385353 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c784bc1-828c-4b97-8ddb-94de5bb1ea47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:07.385708 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c784bc1-828c-4b97-8ddb-94de5bb1ea47 admin admin] PATH_INFO: `/v3/projects/fc12aabf4dbc4baba84fd7de2ea1db65` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:07.387000 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c784bc1-828c-4b97-8ddb-94de5bb1ea47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc12aabf4dbc4baba84fd7de2ea1db65)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:07.389058 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c784bc1-828c-4b97-8ddb-94de5bb1ea47 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:07.439541 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d0304-0323-48ef-9934-4d2f94951472 service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:07.441061 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-d93d0304-0323-48ef-9934-4d2f94951472 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:07.454230 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d0304-0323-48ef-9934-4d2f94951472 service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:07.458953 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2eba4-d987-45b8-8735-0251b2117bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:07.459818 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2eba4-d987-45b8-8735-0251b2117bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:07.460100 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2eba4-d987-45b8-8735-0251b2117bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:07.460378 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2eba4-d987-45b8-8735-0251b2117bdd admin admin] PATH_INFO: `/v3/users/7fd15a462e45488093fd6300c5048fcc` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:07.461606 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2eba4-d987-45b8-8735-0251b2117bdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fd15a462e45488093fd6300c5048fcc)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:07.463502 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2eba4-d987-45b8-8735-0251b2117bdd admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:07.488078 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1c784bc1-828c-4b97-8ddb-94de5bb1ea47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc12aabf4dbc4baba84fd7de2ea1db65', 'request_id': 'req-1c784bc1-828c-4b97-8ddb-94de5bb1ea47'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:07.550070 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1c784bc1-828c-4b97-8ddb-94de5bb1ea47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc12aabf4dbc4baba84fd7de2ea1db65', 'request_id': 'req-1c784bc1-828c-4b97-8ddb-94de5bb1ea47'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:07.556166 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1c784bc1-828c-4b97-8ddb-94de5bb1ea47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc12aabf4dbc4baba84fd7de2ea1db65', 'request_id': 'req-1c784bc1-828c-4b97-8ddb-94de5bb1ea47'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:07.567633 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1c784bc1-828c-4b97-8ddb-94de5bb1ea47 admin admin] The token cache is being invalidate because project fc12aabf4dbc4baba84fd7de2ea1db65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:18:07.567956 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1c784bc1-828c-4b97-8ddb-94de5bb1ea47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:07.568637 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1c784bc1-828c-4b97-8ddb-94de5bb1ea47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:07.570216 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1217/2433] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:18:07 2021] DELETE /identity/v3/projects/fc12aabf4dbc4baba84fd7de2ea1db65 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:07.573947 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c784bc1-828c-4b97-8ddb-94de5bb1ea47 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:07.575247 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-1c784bc1-828c-4b97-8ddb-94de5bb1ea47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:07.627133 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-26a2eba4-d987-45b8-8735-0251b2117bdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fd15a462e45488093fd6300c5048fcc'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:07.628015 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-26a2eba4-d987-45b8-8735-0251b2117bdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fd15a462e45488093fd6300c5048fcc'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:07.628849 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-26a2eba4-d987-45b8-8735-0251b2117bdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fd15a462e45488093fd6300c5048fcc'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:07.635827 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-26a2eba4-d987-45b8-8735-0251b2117bdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fd15a462e45488093fd6300c5048fcc'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:07.637600 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c784bc1-828c-4b97-8ddb-94de5bb1ea47 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:07.643334 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ddc16-ec76-4388-aa0d-ed8530090059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:07.644216 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ddc16-ec76-4388-aa0d-ed8530090059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:07.644528 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ddc16-ec76-4388-aa0d-ed8530090059 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:07.644818 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ddc16-ec76-4388-aa0d-ed8530090059 admin admin] PATH_INFO: `/v3/users/d5d0a29c16a6403e942ae2605f8ce21d` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:07.646314 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ddc16-ec76-4388-aa0d-ed8530090059 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5d0a29c16a6403e942ae2605f8ce21d)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:07.648252 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ddc16-ec76-4388-aa0d-ed8530090059 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:07.772555 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-26a2eba4-d987-45b8-8735-0251b2117bdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fd15a462e45488093fd6300c5048fcc'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:07.790478 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1217/2434] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:18:07 2021] DELETE /identity/v3/users/7fd15a462e45488093fd6300c5048fcc => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:18:07.794792 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc7d00-532b-4a40-8b4d-249b8a38996c None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:07.795080 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc7d00-532b-4a40-8b4d-249b8a38996c None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:07.795362 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc7d00-532b-4a40-8b4d-249b8a38996c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:07.813481 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-debc7d00-532b-4a40-8b4d-249b8a38996c None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:07.814683 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-debc7d00-532b-4a40-8b4d-249b8a38996c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:07.877683 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1218/2435] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:18:07.887058 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc7d00-532b-4a40-8b4d-249b8a38996c None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:07.890425 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-debc7d00-532b-4a40-8b4d-249b8a38996c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:07.947807 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc7d00-532b-4a40-8b4d-249b8a38996c None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:07.951574 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce52d5-5ec6-46a3-b4de-85dbc6ec6716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:07.952229 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce52d5-5ec6-46a3-b4de-85dbc6ec6716 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:07.953792 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce52d5-5ec6-46a3-b4de-85dbc6ec6716 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:07.953792 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce52d5-5ec6-46a3-b4de-85dbc6ec6716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:07.954744 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-3f2ddc16-ec76-4388-aa0d-ed8530090059 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5d0a29c16a6403e942ae2605f8ce21d'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:07.955442 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-3f2ddc16-ec76-4388-aa0d-ed8530090059 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5d0a29c16a6403e942ae2605f8ce21d'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:07.962236 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-3f2ddc16-ec76-4388-aa0d-ed8530090059 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5d0a29c16a6403e942ae2605f8ce21d'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:07.962733 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce52d5-5ec6-46a3-b4de-85dbc6ec6716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:07.964191 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce52d5-5ec6-46a3-b4de-85dbc6ec6716 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:07.973641 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1219/2436] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:18:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:18:08.047757 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-3f2ddc16-ec76-4388-aa0d-ed8530090059 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5d0a29c16a6403e942ae2605f8ce21d'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:08.061504 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-3f2ddc16-ec76-4388-aa0d-ed8530090059 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5d0a29c16a6403e942ae2605f8ce21d'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:08.068979 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1218/2437] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:18:07 2021] DELETE /identity/v3/users/d5d0a29c16a6403e942ae2605f8ce21d => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:18:08.711431 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce52d5-5ec6-46a3-b4de-85dbc6ec6716 service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:08.712981 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-63ce52d5-5ec6-46a3-b4de-85dbc6ec6716 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:08.726771 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce52d5-5ec6-46a3-b4de-85dbc6ec6716 service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:08.794925 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439ae1a-7636-464c-a286-187072292a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:08.796184 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439ae1a-7636-464c-a286-187072292a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:08.796315 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439ae1a-7636-464c-a286-187072292a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:08.797505 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439ae1a-7636-464c-a286-187072292a78 admin admin] PATH_INFO: `/v3/projects/b0c7a29c64374e778bb1a00b653ab209` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:08.801255 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f439ae1a-7636-464c-a286-187072292a78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0c7a29c64374e778bb1a00b653ab209)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:08.801255 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f439ae1a-7636-464c-a286-187072292a78 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:08.909985 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-f439ae1a-7636-464c-a286-187072292a78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0c7a29c64374e778bb1a00b653ab209', 'request_id': 'req-f439ae1a-7636-464c-a286-187072292a78'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:08.988989 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ddc16-ec76-4388-aa0d-ed8530090059 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:08.990595 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-3f2ddc16-ec76-4388-aa0d-ed8530090059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:09.001930 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-f439ae1a-7636-464c-a286-187072292a78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0c7a29c64374e778bb1a00b653ab209', 'request_id': 'req-f439ae1a-7636-464c-a286-187072292a78'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:09.005649 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ddc16-ec76-4388-aa0d-ed8530090059 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:09.008302 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-f439ae1a-7636-464c-a286-187072292a78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0c7a29c64374e778bb1a00b653ab209', 'request_id': 'req-f439ae1a-7636-464c-a286-187072292a78'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:09.020991 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-f439ae1a-7636-464c-a286-187072292a78 admin admin] The token cache is being invalidate because project b0c7a29c64374e778bb1a00b653ab209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:18:09.021297 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-f439ae1a-7636-464c-a286-187072292a78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:09.021958 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-f439ae1a-7636-464c-a286-187072292a78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:09.023530 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1220/2438] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:18:08 2021] DELETE /identity/v3/projects/b0c7a29c64374e778bb1a00b653ab209 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:09.027398 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439ae1a-7636-464c-a286-187072292a78 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:09.028806 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-f439ae1a-7636-464c-a286-187072292a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:09.070129 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e60ce-680d-4a30-8e35-c5f1f1aeb1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:09.071155 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e60ce-680d-4a30-8e35-c5f1f1aeb1b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:09.071447 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e60ce-680d-4a30-8e35-c5f1f1aeb1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:09.071726 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e60ce-680d-4a30-8e35-c5f1f1aeb1b2 admin admin] PATH_INFO: `/v3/projects/9040a0a420084b1b8f969e267cb7c23d` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:09.073229 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e60ce-680d-4a30-8e35-c5f1f1aeb1b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9040a0a420084b1b8f969e267cb7c23d)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:09.075198 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e60ce-680d-4a30-8e35-c5f1f1aeb1b2 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:09.096345 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439ae1a-7636-464c-a286-187072292a78 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:09.102637 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1a262-4fdf-49c5-96d8-54c4cafaa545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:09.103519 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1a262-4fdf-49c5-96d8-54c4cafaa545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:09.103800 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1a262-4fdf-49c5-96d8-54c4cafaa545 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:09.104071 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1a262-4fdf-49c5-96d8-54c4cafaa545 admin admin] PATH_INFO: `/v3/users/09af9c9140244dd0bf627eca33a3f5a3` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:09.105342 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1a262-4fdf-49c5-96d8-54c4cafaa545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09af9c9140244dd0bf627eca33a3f5a3)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:09.107550 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1a262-4fdf-49c5-96d8-54c4cafaa545 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:09.190415 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-523e60ce-680d-4a30-8e35-c5f1f1aeb1b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9040a0a420084b1b8f969e267cb7c23d', 'request_id': 'req-523e60ce-680d-4a30-8e35-c5f1f1aeb1b2'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:09.253108 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-523e60ce-680d-4a30-8e35-c5f1f1aeb1b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9040a0a420084b1b8f969e267cb7c23d', 'request_id': 'req-523e60ce-680d-4a30-8e35-c5f1f1aeb1b2'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:09.259150 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-523e60ce-680d-4a30-8e35-c5f1f1aeb1b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9040a0a420084b1b8f969e267cb7c23d', 'request_id': 'req-523e60ce-680d-4a30-8e35-c5f1f1aeb1b2'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:09.271013 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-523e60ce-680d-4a30-8e35-c5f1f1aeb1b2 admin admin] The token cache is being invalidate because project 9040a0a420084b1b8f969e267cb7c23d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:18:09.271302 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-523e60ce-680d-4a30-8e35-c5f1f1aeb1b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:09.271983 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-523e60ce-680d-4a30-8e35-c5f1f1aeb1b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:09.273574 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1219/2439] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:18:08 2021] DELETE /identity/v3/projects/9040a0a420084b1b8f969e267cb7c23d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:09.279607 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1dc5c-e8b2-42a9-b204-63b5f07ec65e None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:09.279905 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1dc5c-e8b2-42a9-b204-63b5f07ec65e None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:09.280186 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1dc5c-e8b2-42a9-b204-63b5f07ec65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:09.299005 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-f4c1dc5c-e8b2-42a9-b204-63b5f07ec65e None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:09.300222 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-f4c1dc5c-e8b2-42a9-b204-63b5f07ec65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:09.330315 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e3a1a262-4fdf-49c5-96d8-54c4cafaa545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09af9c9140244dd0bf627eca33a3f5a3'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:09.331003 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e3a1a262-4fdf-49c5-96d8-54c4cafaa545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09af9c9140244dd0bf627eca33a3f5a3'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:09.331617 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e3a1a262-4fdf-49c5-96d8-54c4cafaa545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09af9c9140244dd0bf627eca33a3f5a3'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:09.338586 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e3a1a262-4fdf-49c5-96d8-54c4cafaa545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09af9c9140244dd0bf627eca33a3f5a3'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:09.361278 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1220/2440] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:18:09.368760 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ee28a-0630-434d-bbe0-a831398c8e37 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:09.369078 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ee28a-0630-434d-bbe0-a831398c8e37 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:09.369357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ee28a-0630-434d-bbe0-a831398c8e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:09.387041 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-091ee28a-0630-434d-bbe0-a831398c8e37 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:09.391514 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-091ee28a-0630-434d-bbe0-a831398c8e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:09.396936 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1221/2441] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:18:09.401250 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ee28a-0630-434d-bbe0-a831398c8e37 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:09.401477 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e3a1a262-4fdf-49c5-96d8-54c4cafaa545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09af9c9140244dd0bf627eca33a3f5a3'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:09.411698 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ee28a-0630-434d-bbe0-a831398c8e37 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:09.417000 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce4a89-9113-48a4-890c-6d7c18638ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:09.417671 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce4a89-9113-48a4-890c-6d7c18638ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:09.417953 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce4a89-9113-48a4-890c-6d7c18638ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:09.418230 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce4a89-9113-48a4-890c-6d7c18638ef2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:09.418950 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce4a89-9113-48a4-890c-6d7c18638ef2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:18:09.419260 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce4a89-9113-48a4-890c-6d7c18638ef2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:09.420883 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce4a89-9113-48a4-890c-6d7c18638ef2 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:09.433459 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1222/2442] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:18:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 03:18:09.438102 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1221/2443] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:18:09 2021] DELETE /identity/v3/users/09af9c9140244dd0bf627eca33a3f5a3 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:09.441738 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce4a89-9113-48a4-890c-6d7c18638ef2 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:09.454094 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce4a89-9113-48a4-890c-6d7c18638ef2 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:09.514512 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9adfde-59a9-4bef-9cdb-052db9db3b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:09.516301 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9adfde-59a9-4bef-9cdb-052db9db3b83 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:09.517303 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9adfde-59a9-4bef-9cdb-052db9db3b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:09.517303 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9adfde-59a9-4bef-9cdb-052db9db3b83 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:09.518233 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9adfde-59a9-4bef-9cdb-052db9db3b83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:09.520282 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9adfde-59a9-4bef-9cdb-052db9db3b83 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:09.621896 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1223/2444] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:18:09 2021] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:18:09.622859 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1a262-4fdf-49c5-96d8-54c4cafaa545 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:09.633246 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1a262-4fdf-49c5-96d8-54c4cafaa545 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:09.705622 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac447163-d53f-4805-abb4-3b5e6ddfccdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:09.706783 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac447163-d53f-4805-abb4-3b5e6ddfccdd admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:09.707825 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac447163-d53f-4805-abb4-3b5e6ddfccdd admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:09.708312 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac447163-d53f-4805-abb4-3b5e6ddfccdd admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:09.713060 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac447163-d53f-4805-abb4-3b5e6ddfccdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:09.713060 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac447163-d53f-4805-abb4-3b5e6ddfccdd admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:09.836606 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1222/2445] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:18:09 2021] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:18:09.840425 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9adfde-59a9-4bef-9cdb-052db9db3b83 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:09.851957 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9adfde-59a9-4bef-9cdb-052db9db3b83 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:09.857092 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a15b8-8828-4427-acaa-15f4c408bae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:09.861786 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a15b8-8828-4427-acaa-15f4c408bae0 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:09.861786 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a15b8-8828-4427-acaa-15f4c408bae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:09.861786 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a15b8-8828-4427-acaa-15f4c408bae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:09.861786 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a15b8-8828-4427-acaa-15f4c408bae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:09.861786 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a15b8-8828-4427-acaa-15f4c408bae0 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:09.871307 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1224/2446] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:18:09 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:18:09.875236 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac447163-d53f-4805-abb4-3b5e6ddfccdd admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:09.885535 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac447163-d53f-4805-abb4-3b5e6ddfccdd admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:09.890711 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54600e67-e539-4da6-9721-d88cfda544cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:09.891410 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54600e67-e539-4da6-9721-d88cfda544cc admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:09.891696 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54600e67-e539-4da6-9721-d88cfda544cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:09.892005 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54600e67-e539-4da6-9721-d88cfda544cc admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:09.892765 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54600e67-e539-4da6-9721-d88cfda544cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:09.894348 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54600e67-e539-4da6-9721-d88cfda544cc admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:09.904408 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1223/2447] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:18:09 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:18:09.909290 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a15b8-8828-4427-acaa-15f4c408bae0 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:09.919702 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a15b8-8828-4427-acaa-15f4c408bae0 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:09.928627 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67532ef-2e4d-4824-86b6-b9416ac5f491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:09.929526 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67532ef-2e4d-4824-86b6-b9416ac5f491 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:09.929812 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67532ef-2e4d-4824-86b6-b9416ac5f491 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:09.930092 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67532ef-2e4d-4824-86b6-b9416ac5f491 admin admin] PATH_INFO: `/v3/projects/de190a3d4c424f6eaaab687a2a1b13d6/users/ade8dc3756904127a26e08c912c34142/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:09.945615 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67532ef-2e4d-4824-86b6-b9416ac5f491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de190a3d4c424f6eaaab687a2a1b13d6, user_id=ade8dc3756904127a26e08c912c34142, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:09.948384 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67532ef-2e4d-4824-86b6-b9416ac5f491 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:09.960529 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54600e67-e539-4da6-9721-d88cfda544cc admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:09.962531 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-54600e67-e539-4da6-9721-d88cfda544cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:09.977374 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54600e67-e539-4da6-9721-d88cfda544cc admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:09.982724 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57d806-37cb-467e-b438-b08a1198e271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:09.984005 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57d806-37cb-467e-b438-b08a1198e271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:09.984005 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57d806-37cb-467e-b438-b08a1198e271 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:09.984866 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57d806-37cb-467e-b438-b08a1198e271 admin admin] PATH_INFO: `/v3/projects/ae98838dfd344dbd9cf369d3559f5f22` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:09.986209 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57d806-37cb-467e-b438-b08a1198e271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae98838dfd344dbd9cf369d3559f5f22)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:09.988114 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57d806-37cb-467e-b438-b08a1198e271 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:10.030335 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1225/2448] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:18:09 2021] PUT /identity/v3/projects/de190a3d4c424f6eaaab687a2a1b13d6/users/ade8dc3756904127a26e08c912c34142/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:10.042831 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b6c3c-082e-44fb-9c19-b9d7713df71d None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:10.043193 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b6c3c-082e-44fb-9c19-b9d7713df71d None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:10.043546 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b6c3c-082e-44fb-9c19-b9d7713df71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:10.070580 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-740b6c3c-082e-44fb-9c19-b9d7713df71d None None] MFA Rules not processed for user `ade8dc3756904127a26e08c912c34142`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:10.071832 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-740b6c3c-082e-44fb-9c19-b9d7713df71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:10.086917 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-9a57d806-37cb-467e-b438-b08a1198e271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae98838dfd344dbd9cf369d3559f5f22', 'request_id': 'req-9a57d806-37cb-467e-b438-b08a1198e271'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:10.144773 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1226/2449] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:10 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:18:10.149324 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b6c3c-082e-44fb-9c19-b9d7713df71d None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:10.150025 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-9a57d806-37cb-467e-b438-b08a1198e271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae98838dfd344dbd9cf369d3559f5f22', 'request_id': 'req-9a57d806-37cb-467e-b438-b08a1198e271'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:10.157361 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-9a57d806-37cb-467e-b438-b08a1198e271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae98838dfd344dbd9cf369d3559f5f22', 'request_id': 'req-9a57d806-37cb-467e-b438-b08a1198e271'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:10.170488 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-9a57d806-37cb-467e-b438-b08a1198e271 admin admin] The token cache is being invalidate because project ae98838dfd344dbd9cf369d3559f5f22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:18:10.170766 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-9a57d806-37cb-467e-b438-b08a1198e271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:10.171758 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-9a57d806-37cb-467e-b438-b08a1198e271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:10.173334 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1224/2450] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:18:09 2021] DELETE /identity/v3/projects/ae98838dfd344dbd9cf369d3559f5f22 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:18:10.179187 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1788c-5058-4cb1-9137-809a14d441d9 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:10.179473 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1788c-5058-4cb1-9137-809a14d441d9 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:10.179746 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1788c-5058-4cb1-9137-809a14d441d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:10.197265 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-59d1788c-5058-4cb1-9137-809a14d441d9 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:10.198462 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-59d1788c-5058-4cb1-9137-809a14d441d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:10.212085 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b6c3c-082e-44fb-9c19-b9d7713df71d None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:10.216770 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ff1ee-7ac9-486e-9271-62a105a06775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:10.217431 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ff1ee-7ac9-486e-9271-62a105a06775 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:10.217721 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ff1ee-7ac9-486e-9271-62a105a06775 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:10.218005 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ff1ee-7ac9-486e-9271-62a105a06775 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:10.219251 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ff1ee-7ac9-486e-9271-62a105a06775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:10.221188 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ff1ee-7ac9-486e-9271-62a105a06775 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:10.254435 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1225/2451] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:18:10.262053 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cb7d7-401e-463f-aef8-57159a5699a3 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:10.262341 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cb7d7-401e-463f-aef8-57159a5699a3 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:10.262616 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cb7d7-401e-463f-aef8-57159a5699a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:10.280085 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-025cb7d7-401e-463f-aef8-57159a5699a3 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:10.281879 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-025cb7d7-401e-463f-aef8-57159a5699a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:10.289655 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1226/2452] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:18:10.293485 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cb7d7-401e-463f-aef8-57159a5699a3 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:10.306146 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cb7d7-401e-463f-aef8-57159a5699a3 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:10.312382 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44984f7-fadf-4a54-9e31-94aa855e7cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:10.313096 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44984f7-fadf-4a54-9e31-94aa855e7cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:10.313402 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44984f7-fadf-4a54-9e31-94aa855e7cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:10.313675 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44984f7-fadf-4a54-9e31-94aa855e7cf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:10.316099 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44984f7-fadf-4a54-9e31-94aa855e7cf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:18:10.316099 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44984f7-fadf-4a54-9e31-94aa855e7cf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:10.316359 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44984f7-fadf-4a54-9e31-94aa855e7cf9 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:10.328973 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1227/2453] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:18:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 03:18:10.333124 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44984f7-fadf-4a54-9e31-94aa855e7cf9 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:10.337984 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1227/2454] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:18:10 2021] POST /identity/v3/projects => generated 387 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:18:10.338910 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ff1ee-7ac9-486e-9271-62a105a06775 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:10.340637 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-a27ff1ee-7ac9-486e-9271-62a105a06775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:10.343152 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44984f7-fadf-4a54-9e31-94aa855e7cf9 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:10.401124 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04dfa91-6e15-498f-a27a-1d212772d2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:10.401784 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dfa91-6e15-498f-a27a-1d212772d2f7 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:10.402062 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dfa91-6e15-498f-a27a-1d212772d2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:10.402336 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dfa91-6e15-498f-a27a-1d212772d2f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:10.402815 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ff1ee-7ac9-486e-9271-62a105a06775 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:10.403013 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04dfa91-6e15-498f-a27a-1d212772d2f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:10.404923 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04dfa91-6e15-498f-a27a-1d212772d2f7 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:10.407982 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc092a-d03b-4fc5-928d-e36b342daca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:10.408708 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc092a-d03b-4fc5-928d-e36b342daca1 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:10.408995 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc092a-d03b-4fc5-928d-e36b342daca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:10.409273 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc092a-d03b-4fc5-928d-e36b342daca1 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:10.409957 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc092a-d03b-4fc5-928d-e36b342daca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:10.411849 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc092a-d03b-4fc5-928d-e36b342daca1 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:10.493366 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1228/2455] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:18:10 2021] POST /identity/v3/projects => generated 393 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:18:10.497383 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04dfa91-6e15-498f-a27a-1d212772d2f7 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:10.528383 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1228/2456] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:18:10 2021] POST /identity/v3/users => generated 300 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:18:10.532404 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc092a-d03b-4fc5-928d-e36b342daca1 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:10.541998 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc092a-d03b-4fc5-928d-e36b342daca1 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:10.559918 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04dfa91-6e15-498f-a27a-1d212772d2f7 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:10.567461 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c520625-a4ce-48c3-aeef-ae24e1830eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:10.568160 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c520625-a4ce-48c3-aeef-ae24e1830eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:10.568451 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c520625-a4ce-48c3-aeef-ae24e1830eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:10.568763 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c520625-a4ce-48c3-aeef-ae24e1830eb4 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:10.569856 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c520625-a4ce-48c3-aeef-ae24e1830eb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:10.573410 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c520625-a4ce-48c3-aeef-ae24e1830eb4 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:10.604847 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d532e-fc25-4877-8585-d5343854a074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:10.605531 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d532e-fc25-4877-8585-d5343854a074 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:10.605813 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d532e-fc25-4877-8585-d5343854a074 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:10.606086 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d532e-fc25-4877-8585-d5343854a074 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:10.607133 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d532e-fc25-4877-8585-d5343854a074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:10.608759 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d532e-fc25-4877-8585-d5343854a074 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:10.619203 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1229/2457] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:18:10 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:18:10.625252 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d532e-fc25-4877-8585-d5343854a074 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:10.635370 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d532e-fc25-4877-8585-d5343854a074 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:10.640046 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61e611-25fe-4542-a744-2da3b1ca2b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:10.641522 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61e611-25fe-4542-a744-2da3b1ca2b15 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:10.641801 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61e611-25fe-4542-a744-2da3b1ca2b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:10.642072 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61e611-25fe-4542-a744-2da3b1ca2b15 admin admin] PATH_INFO: `/v3/projects/3b244aa0fa4f410984d8f4d78f5b3ee2/users/f4b80d7712d04d45a0e228541ba4129a/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:10.659728 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61e611-25fe-4542-a744-2da3b1ca2b15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b244aa0fa4f410984d8f4d78f5b3ee2, user_id=f4b80d7712d04d45a0e228541ba4129a, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:10.662539 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61e611-25fe-4542-a744-2da3b1ca2b15 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:10.675759 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1229/2458] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:18:10 2021] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:18:10.676837 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c520625-a4ce-48c3-aeef-ae24e1830eb4 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:10.686674 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c520625-a4ce-48c3-aeef-ae24e1830eb4 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:10.692198 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8910eca-a680-4d1c-924a-d73ad5523105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:10.692912 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8910eca-a680-4d1c-924a-d73ad5523105 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:10.693196 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8910eca-a680-4d1c-924a-d73ad5523105 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:10.693469 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8910eca-a680-4d1c-924a-d73ad5523105 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:10.694224 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8910eca-a680-4d1c-924a-d73ad5523105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:10.695838 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8910eca-a680-4d1c-924a-d73ad5523105 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:10.706919 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1230/2459] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:18:10 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:18:10.710748 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8910eca-a680-4d1c-924a-d73ad5523105 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:10.720774 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8910eca-a680-4d1c-924a-d73ad5523105 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:10.725523 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f209331c-6529-4aaa-8a16-84f31056e88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:10.726137 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209331c-6529-4aaa-8a16-84f31056e88d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:10.726507 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209331c-6529-4aaa-8a16-84f31056e88d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:10.726687 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209331c-6529-4aaa-8a16-84f31056e88d admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:10.727414 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f209331c-6529-4aaa-8a16-84f31056e88d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:10.729031 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f209331c-6529-4aaa-8a16-84f31056e88d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:10.739976 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1231/2460] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:18:10 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:18:10.744059 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f209331c-6529-4aaa-8a16-84f31056e88d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:10.754761 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f209331c-6529-4aaa-8a16-84f31056e88d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:10.759415 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52457f71-64eb-4f39-9bd1-7b75512e0fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:10.760524 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52457f71-64eb-4f39-9bd1-7b75512e0fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:10.760673 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52457f71-64eb-4f39-9bd1-7b75512e0fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:10.760900 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52457f71-64eb-4f39-9bd1-7b75512e0fe4 admin admin] PATH_INFO: `/v3/projects/1269d404af1d4560b392313f7c5376bc/users/a90e9edfcc52487aa4c0bc8bd5ce5675/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:10.768320 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1230/2461] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:18:10 2021] PUT /identity/v3/projects/3b244aa0fa4f410984d8f4d78f5b3ee2/users/f4b80d7712d04d45a0e228541ba4129a/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:18:10.776794 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52457f71-64eb-4f39-9bd1-7b75512e0fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1269d404af1d4560b392313f7c5376bc, user_id=a90e9edfcc52487aa4c0bc8bd5ce5675, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:10.778813 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61e611-25fe-4542-a744-2da3b1ca2b15 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:10.779693 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52457f71-64eb-4f39-9bd1-7b75512e0fe4 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:10.840087 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61e611-25fe-4542-a744-2da3b1ca2b15 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:10.844794 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bed00-d7de-4651-baf4-2b0354476222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:10.845465 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bed00-d7de-4651-baf4-2b0354476222 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:10.845755 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bed00-d7de-4651-baf4-2b0354476222 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:10.846028 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bed00-d7de-4651-baf4-2b0354476222 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:10.846741 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3bed00-d7de-4651-baf4-2b0354476222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:10.848329 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3bed00-d7de-4651-baf4-2b0354476222 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:10.858043 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1231/2462] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:18:10 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:18:10.862670 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bed00-d7de-4651-baf4-2b0354476222 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:10.871933 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bed00-d7de-4651-baf4-2b0354476222 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:10.877213 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606cb48-0d7f-4bcc-8d90-c0c9f496518a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:10.878084 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606cb48-0d7f-4bcc-8d90-c0c9f496518a admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:10.878367 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606cb48-0d7f-4bcc-8d90-c0c9f496518a admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:10.878645 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606cb48-0d7f-4bcc-8d90-c0c9f496518a admin admin] PATH_INFO: `/v3/projects/3b244aa0fa4f410984d8f4d78f5b3ee2/users/f4b80d7712d04d45a0e228541ba4129a/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:10.880688 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606cb48-0d7f-4bcc-8d90-c0c9f496518a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b244aa0fa4f410984d8f4d78f5b3ee2, user_id=f4b80d7712d04d45a0e228541ba4129a, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:10.883312 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606cb48-0d7f-4bcc-8d90-c0c9f496518a admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:10.893333 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1232/2463] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:18:10 2021] PUT /identity/v3/projects/3b244aa0fa4f410984d8f4d78f5b3ee2/users/f4b80d7712d04d45a0e228541ba4129a/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:18:10.903734 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec4013-031c-42f4-8baa-9e3e9b66c160 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:10.904028 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec4013-031c-42f4-8baa-9e3e9b66c160 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:10.904322 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec4013-031c-42f4-8baa-9e3e9b66c160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:10.904749 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1232/2464] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:18:10 2021] PUT /identity/v3/projects/1269d404af1d4560b392313f7c5376bc/users/a90e9edfcc52487aa4c0bc8bd5ce5675/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:18:10.915912 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f031e-f30d-471a-9cb3-3bc3cf8e0326 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:10.916205 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f031e-f30d-471a-9cb3-3bc3cf8e0326 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:10.916504 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f031e-f30d-471a-9cb3-3bc3cf8e0326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:10.932964 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-55ec4013-031c-42f4-8baa-9e3e9b66c160 None None] MFA Rules not processed for user `f4b80d7712d04d45a0e228541ba4129a`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:10.934610 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-55ec4013-031c-42f4-8baa-9e3e9b66c160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:10.943656 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-6f9f031e-f30d-471a-9cb3-3bc3cf8e0326 None None] MFA Rules not processed for user `a90e9edfcc52487aa4c0bc8bd5ce5675`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:10.944869 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-6f9f031e-f30d-471a-9cb3-3bc3cf8e0326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:11.001310 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1233/2465] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:10 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:18:11.010213 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1233/2466] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:10 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:18:11.013656 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec4013-031c-42f4-8baa-9e3e9b66c160 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:11.013656 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-55ec4013-031c-42f4-8baa-9e3e9b66c160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:11.014590 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f031e-f30d-471a-9cb3-3bc3cf8e0326 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:11.067619 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec4013-031c-42f4-8baa-9e3e9b66c160 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:11.071202 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bd4ac-fae4-49a3-9291-d92e09880667 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:11.071845 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bd4ac-fae4-49a3-9291-d92e09880667 service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:11.072144 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bd4ac-fae4-49a3-9291-d92e09880667 service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:11.072419 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bd4ac-fae4-49a3-9291-d92e09880667 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:11.073726 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f031e-f30d-471a-9cb3-3bc3cf8e0326 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:11.078409 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b4e0a-e808-4348-a5b3-97711025e311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:11.079084 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b4e0a-e808-4348-a5b3-97711025e311 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:11.079368 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b4e0a-e808-4348-a5b3-97711025e311 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:11.079647 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b4e0a-e808-4348-a5b3-97711025e311 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:11.080341 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b4e0a-e808-4348-a5b3-97711025e311 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:11.081265 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30bd4ac-fae4-49a3-9291-d92e09880667 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:11.082349 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b4e0a-e808-4348-a5b3-97711025e311 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:11.082678 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30bd4ac-fae4-49a3-9291-d92e09880667 service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:11.091872 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1234/2467] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:18:11 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:18:11.156365 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bd4ac-fae4-49a3-9291-d92e09880667 service cinder] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:11.166970 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bd4ac-fae4-49a3-9291-d92e09880667 service cinder] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:11.173152 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab584b04-542f-4db0-9a0d-beb5477cc0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:11.174027 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab584b04-542f-4db0-9a0d-beb5477cc0bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:11.174308 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab584b04-542f-4db0-9a0d-beb5477cc0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:11.174587 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab584b04-542f-4db0-9a0d-beb5477cc0bd admin admin] PATH_INFO: `/v3/users/ade8dc3756904127a26e08c912c34142` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:11.175888 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab584b04-542f-4db0-9a0d-beb5477cc0bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ade8dc3756904127a26e08c912c34142)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:11.176774 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1234/2468] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:18:11 2021] POST /identity/v3/projects => generated 393 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:18:11.177854 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab584b04-542f-4db0-9a0d-beb5477cc0bd admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:11.180724 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b4e0a-e808-4348-a5b3-97711025e311 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:11.243331 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b4e0a-e808-4348-a5b3-97711025e311 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:11.248278 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a820df-004d-4b97-86ac-86e75e950036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:11.248995 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a820df-004d-4b97-86ac-86e75e950036 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:11.249286 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a820df-004d-4b97-86ac-86e75e950036 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:11.249556 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a820df-004d-4b97-86ac-86e75e950036 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:11.250352 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a820df-004d-4b97-86ac-86e75e950036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:11.252321 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a820df-004d-4b97-86ac-86e75e950036 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:11.316338 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-ab584b04-542f-4db0-9a0d-beb5477cc0bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ade8dc3756904127a26e08c912c34142'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:11.317037 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-ab584b04-542f-4db0-9a0d-beb5477cc0bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ade8dc3756904127a26e08c912c34142'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:11.323656 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-ab584b04-542f-4db0-9a0d-beb5477cc0bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ade8dc3756904127a26e08c912c34142'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:11.337680 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1235/2469] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:18:11 2021] POST /identity/v3/users => generated 303 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:18:11.341505 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a820df-004d-4b97-86ac-86e75e950036 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:11.352177 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a820df-004d-4b97-86ac-86e75e950036 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:11.357208 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4f7c0-bc48-4023-94fc-de00e2f0255f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:11.357987 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4f7c0-bc48-4023-94fc-de00e2f0255f admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:11.358269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4f7c0-bc48-4023-94fc-de00e2f0255f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:11.358574 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4f7c0-bc48-4023-94fc-de00e2f0255f admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:11.360057 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4f7c0-bc48-4023-94fc-de00e2f0255f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:11.361947 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4f7c0-bc48-4023-94fc-de00e2f0255f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:11.371855 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1236/2470] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:18:11 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:18:11.375774 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4f7c0-bc48-4023-94fc-de00e2f0255f admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:11.378070 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-ab584b04-542f-4db0-9a0d-beb5477cc0bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ade8dc3756904127a26e08c912c34142'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:11.385237 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4f7c0-bc48-4023-94fc-de00e2f0255f admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:11.389862 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58dde0-fb5b-4248-b9f1-9152126bd9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:11.390441 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-ab584b04-542f-4db0-9a0d-beb5477cc0bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ade8dc3756904127a26e08c912c34142'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:11.390801 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58dde0-fb5b-4248-b9f1-9152126bd9e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:11.391019 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58dde0-fb5b-4248-b9f1-9152126bd9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:11.391294 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58dde0-fb5b-4248-b9f1-9152126bd9e1 admin admin] PATH_INFO: `/v3/projects/720a2fe1dbcc47dd95866813f0980af3/users/065349feaf4d4dc8b80d353e6d8c0ab3/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:11.399048 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1235/2471] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:18:11 2021] DELETE /identity/v3/users/ade8dc3756904127a26e08c912c34142 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:18:11.400640 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1babe9-9c8f-44b1-8ce7-13436946c6d0 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:11.400939 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1babe9-9c8f-44b1-8ce7-13436946c6d0 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:11.401277 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1babe9-9c8f-44b1-8ce7-13436946c6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:11.411661 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58dde0-fb5b-4248-b9f1-9152126bd9e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=720a2fe1dbcc47dd95866813f0980af3, user_id=065349feaf4d4dc8b80d353e6d8c0ab3, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:11.414379 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58dde0-fb5b-4248-b9f1-9152126bd9e1 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:11.418325 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-fb1babe9-9c8f-44b1-8ce7-13436946c6d0 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:11.419544 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-fb1babe9-9c8f-44b1-8ce7-13436946c6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:11.476589 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1236/2472] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:18:11.481839 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1237/2473] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:18:11 2021] PUT /identity/v3/projects/720a2fe1dbcc47dd95866813f0980af3/users/065349feaf4d4dc8b80d353e6d8c0ab3/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:18:11.487568 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1babe9-9c8f-44b1-8ce7-13436946c6d0 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:11.487961 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58dde0-fb5b-4248-b9f1-9152126bd9e1 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:11.488989 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-fb1babe9-9c8f-44b1-8ce7-13436946c6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:11.489639 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-1c58dde0-fb5b-4248-b9f1-9152126bd9e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:11.543948 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1babe9-9c8f-44b1-8ce7-13436946c6d0 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:11.551068 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58dde0-fb5b-4248-b9f1-9152126bd9e1 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:11.555797 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586a401-6a3c-481e-b6d0-028552094d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:11.556470 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586a401-6a3c-481e-b6d0-028552094d21 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:11.556781 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586a401-6a3c-481e-b6d0-028552094d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:11.557069 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586a401-6a3c-481e-b6d0-028552094d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:11.557798 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8586a401-6a3c-481e-b6d0-028552094d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:11.559396 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8586a401-6a3c-481e-b6d0-028552094d21 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:11.569025 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1238/2474] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:18:11 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:18:11.573052 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586a401-6a3c-481e-b6d0-028552094d21 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:11.582845 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586a401-6a3c-481e-b6d0-028552094d21 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:11.587394 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d417144-242e-4669-b62d-e234e6922042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:11.588251 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d417144-242e-4669-b62d-e234e6922042 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:11.588569 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d417144-242e-4669-b62d-e234e6922042 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:11.588849 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d417144-242e-4669-b62d-e234e6922042 admin admin] PATH_INFO: `/v3/projects/720a2fe1dbcc47dd95866813f0980af3/users/065349feaf4d4dc8b80d353e6d8c0ab3/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:11.589833 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3f33a-b6f7-49f5-ac77-1e3aa1ca8be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:11.590483 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3f33a-b6f7-49f5-ac77-1e3aa1ca8be4 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:11.590792 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3f33a-b6f7-49f5-ac77-1e3aa1ca8be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:11.590895 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d417144-242e-4669-b62d-e234e6922042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=720a2fe1dbcc47dd95866813f0980af3, user_id=065349feaf4d4dc8b80d353e6d8c0ab3, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:11.591068 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3f33a-b6f7-49f5-ac77-1e3aa1ca8be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:11.593487 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d417144-242e-4669-b62d-e234e6922042 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:11.600700 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3f33a-b6f7-49f5-ac77-1e3aa1ca8be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:11.602121 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3f33a-b6f7-49f5-ac77-1e3aa1ca8be4 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:11.610900 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1239/2475] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:18:11 2021] PUT /identity/v3/projects/720a2fe1dbcc47dd95866813f0980af3/users/065349feaf4d4dc8b80d353e6d8c0ab3/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:18:11.612365 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1237/2476] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:18:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:18:11.620758 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799fa33-746a-4334-a332-032fe92fb5bd None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:11.621049 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799fa33-746a-4334-a332-032fe92fb5bd None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:11.621328 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799fa33-746a-4334-a332-032fe92fb5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:11.648461 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-c799fa33-746a-4334-a332-032fe92fb5bd None None] MFA Rules not processed for user `065349feaf4d4dc8b80d353e6d8c0ab3`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:11.649695 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-c799fa33-746a-4334-a332-032fe92fb5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:11.720392 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1240/2477] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:11 2021] POST /identity/v3/auth/tokens => generated 3480 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:18:11.729760 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3f33a-b6f7-49f5-ac77-1e3aa1ca8be4 service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:11.731229 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-52c3f33a-b6f7-49f5-ac77-1e3aa1ca8be4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:11.786631 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3f33a-b6f7-49f5-ac77-1e3aa1ca8be4 service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:11.842592 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d18f6-8677-4da9-a7d2-d637f27f6d0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:11.843345 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d18f6-8677-4da9-a7d2-d637f27f6d0c service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:11.844385 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d18f6-8677-4da9-a7d2-d637f27f6d0c service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:11.844787 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d18f6-8677-4da9-a7d2-d637f27f6d0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:11.858866 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d18f6-8677-4da9-a7d2-d637f27f6d0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:11.860481 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d18f6-8677-4da9-a7d2-d637f27f6d0c service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:11.871146 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1238/2478] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:18:11 2021] GET /identity/v3/auth/tokens => generated 3480 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:18:11.917743 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799fa33-746a-4334-a332-032fe92fb5bd None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:11.919399 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-c799fa33-746a-4334-a332-032fe92fb5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:11.938377 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799fa33-746a-4334-a332-032fe92fb5bd None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:11.944460 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba9ee2-a40d-4d7a-8f9f-1d3efb70ee36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:11.945627 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba9ee2-a40d-4d7a-8f9f-1d3efb70ee36 service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:11.946822 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba9ee2-a40d-4d7a-8f9f-1d3efb70ee36 service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:11.947403 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba9ee2-a40d-4d7a-8f9f-1d3efb70ee36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:11.954256 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-72ba9ee2-a40d-4d7a-8f9f-1d3efb70ee36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:12.035994 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba9ee2-a40d-4d7a-8f9f-1d3efb70ee36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:12.037485 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba9ee2-a40d-4d7a-8f9f-1d3efb70ee36 service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:12.046646 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1241/2479] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:18:11 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:18:12.134200 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d18f6-8677-4da9-a7d2-d637f27f6d0c service cinder] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:12.138035 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-1b6d18f6-8677-4da9-a7d2-d637f27f6d0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:12.209326 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d18f6-8677-4da9-a7d2-d637f27f6d0c service cinder] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:12.213945 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb46f6-d87b-4ef7-a05a-3ba4b1022c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:12.214802 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb46f6-d87b-4ef7-a05a-3ba4b1022c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:12.215087 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb46f6-d87b-4ef7-a05a-3ba4b1022c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:12.215359 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb46f6-d87b-4ef7-a05a-3ba4b1022c22 admin admin] PATH_INFO: `/v3/projects/de190a3d4c424f6eaaab687a2a1b13d6` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:12.216598 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb46f6-d87b-4ef7-a05a-3ba4b1022c22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de190a3d4c424f6eaaab687a2a1b13d6)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:12.219012 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb46f6-d87b-4ef7-a05a-3ba4b1022c22 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:12.304719 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-f7bb46f6-d87b-4ef7-a05a-3ba4b1022c22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de190a3d4c424f6eaaab687a2a1b13d6', 'request_id': 'req-f7bb46f6-d87b-4ef7-a05a-3ba4b1022c22'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:12.372606 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-f7bb46f6-d87b-4ef7-a05a-3ba4b1022c22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de190a3d4c424f6eaaab687a2a1b13d6', 'request_id': 'req-f7bb46f6-d87b-4ef7-a05a-3ba4b1022c22'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:12.379458 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-f7bb46f6-d87b-4ef7-a05a-3ba4b1022c22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de190a3d4c424f6eaaab687a2a1b13d6', 'request_id': 'req-f7bb46f6-d87b-4ef7-a05a-3ba4b1022c22'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:12.390229 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-f7bb46f6-d87b-4ef7-a05a-3ba4b1022c22 admin admin] The token cache is being invalidate because project de190a3d4c424f6eaaab687a2a1b13d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:18:12.390516 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-f7bb46f6-d87b-4ef7-a05a-3ba4b1022c22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:12.391158 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-f7bb46f6-d87b-4ef7-a05a-3ba4b1022c22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:12.392738 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1239/2480] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:18:12 2021] DELETE /identity/v3/projects/de190a3d4c424f6eaaab687a2a1b13d6 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:12.396770 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba9ee2-a40d-4d7a-8f9f-1d3efb70ee36 service cinder] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:12.408109 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba9ee2-a40d-4d7a-8f9f-1d3efb70ee36 service cinder] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:12.464338 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c08a0-60c2-4be1-b922-876b10d6b413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:12.465240 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c08a0-60c2-4be1-b922-876b10d6b413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:12.465519 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c08a0-60c2-4be1-b922-876b10d6b413 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:12.465790 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c08a0-60c2-4be1-b922-876b10d6b413 admin admin] PATH_INFO: `/v3/users/f4b80d7712d04d45a0e228541ba4129a` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:12.467867 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c08a0-60c2-4be1-b922-876b10d6b413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4b80d7712d04d45a0e228541ba4129a)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:12.469894 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c08a0-60c2-4be1-b922-876b10d6b413 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:12.657817 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-4a9c08a0-60c2-4be1-b922-876b10d6b413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4b80d7712d04d45a0e228541ba4129a'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:12.658473 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-4a9c08a0-60c2-4be1-b922-876b10d6b413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4b80d7712d04d45a0e228541ba4129a'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:12.659076 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-4a9c08a0-60c2-4be1-b922-876b10d6b413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4b80d7712d04d45a0e228541ba4129a'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:12.666166 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-4a9c08a0-60c2-4be1-b922-876b10d6b413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4b80d7712d04d45a0e228541ba4129a'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:12.755360 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-4a9c08a0-60c2-4be1-b922-876b10d6b413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4b80d7712d04d45a0e228541ba4129a'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:12.772730 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1242/2481] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:18:12 2021] DELETE /identity/v3/users/f4b80d7712d04d45a0e228541ba4129a => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:13.231234 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb46f6-d87b-4ef7-a05a-3ba4b1022c22 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:13.232983 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-f7bb46f6-d87b-4ef7-a05a-3ba4b1022c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:13.245670 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb46f6-d87b-4ef7-a05a-3ba4b1022c22 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:13.306732 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289cabb5-79ee-43ef-ad20-f49bdb12d511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:13.308721 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cabb5-79ee-43ef-ad20-f49bdb12d511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:13.309010 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cabb5-79ee-43ef-ad20-f49bdb12d511 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:13.310673 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cabb5-79ee-43ef-ad20-f49bdb12d511 admin admin] PATH_INFO: `/v3/projects/3b244aa0fa4f410984d8f4d78f5b3ee2` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:13.310673 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289cabb5-79ee-43ef-ad20-f49bdb12d511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b244aa0fa4f410984d8f4d78f5b3ee2)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:13.314596 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289cabb5-79ee-43ef-ad20-f49bdb12d511 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:13.424099 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-289cabb5-79ee-43ef-ad20-f49bdb12d511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b244aa0fa4f410984d8f4d78f5b3ee2', 'request_id': 'req-289cabb5-79ee-43ef-ad20-f49bdb12d511'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:13.487336 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-289cabb5-79ee-43ef-ad20-f49bdb12d511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b244aa0fa4f410984d8f4d78f5b3ee2', 'request_id': 'req-289cabb5-79ee-43ef-ad20-f49bdb12d511'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:13.493363 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-289cabb5-79ee-43ef-ad20-f49bdb12d511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b244aa0fa4f410984d8f4d78f5b3ee2', 'request_id': 'req-289cabb5-79ee-43ef-ad20-f49bdb12d511'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:13.504738 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-289cabb5-79ee-43ef-ad20-f49bdb12d511 admin admin] The token cache is being invalidate because project 3b244aa0fa4f410984d8f4d78f5b3ee2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:18:13.505367 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-289cabb5-79ee-43ef-ad20-f49bdb12d511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:13.505659 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-289cabb5-79ee-43ef-ad20-f49bdb12d511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:13.507204 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1240/2482] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:18:13 2021] DELETE /identity/v3/projects/3b244aa0fa4f410984d8f4d78f5b3ee2 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:13.512925 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f22cd3-267b-4ad4-9598-c5def2f952ad None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:13.513433 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f22cd3-267b-4ad4-9598-c5def2f952ad None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:13.513847 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f22cd3-267b-4ad4-9598-c5def2f952ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:13.532549 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-89f22cd3-267b-4ad4-9598-c5def2f952ad None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:13.533758 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-89f22cd3-267b-4ad4-9598-c5def2f952ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:13.591796 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1243/2483] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:18:13.600013 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f5fe4-7e62-4e48-93a3-6ca0fb419883 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:13.600307 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f5fe4-7e62-4e48-93a3-6ca0fb419883 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:13.600629 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f5fe4-7e62-4e48-93a3-6ca0fb419883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:13.619541 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-016f5fe4-7e62-4e48-93a3-6ca0fb419883 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:13.620819 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-016f5fe4-7e62-4e48-93a3-6ca0fb419883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:13.628933 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1241/2484] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:18:13.633023 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f22cd3-267b-4ad4-9598-c5def2f952ad None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:13.642642 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f22cd3-267b-4ad4-9598-c5def2f952ad None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:13.647253 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f70a0-c7ac-4ad0-84b2-af1e053a5f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:13.647917 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f70a0-c7ac-4ad0-84b2-af1e053a5f46 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:13.648201 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f70a0-c7ac-4ad0-84b2-af1e053a5f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:13.648476 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f70a0-c7ac-4ad0-84b2-af1e053a5f46 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:13.649224 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f70a0-c7ac-4ad0-84b2-af1e053a5f46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:18:13.649534 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f70a0-c7ac-4ad0-84b2-af1e053a5f46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:13.651126 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f70a0-c7ac-4ad0-84b2-af1e053a5f46 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:13.663628 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1244/2485] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:18:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 03:18:13.667985 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f5fe4-7e62-4e48-93a3-6ca0fb419883 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:13.677915 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f5fe4-7e62-4e48-93a3-6ca0fb419883 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:13.683211 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf88a9-0f2f-4439-b539-20010d1e0dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:13.683943 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf88a9-0f2f-4439-b539-20010d1e0dcf admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:13.684303 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf88a9-0f2f-4439-b539-20010d1e0dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:13.684682 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf88a9-0f2f-4439-b539-20010d1e0dcf admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:13.685585 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf88a9-0f2f-4439-b539-20010d1e0dcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:13.687437 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf88a9-0f2f-4439-b539-20010d1e0dcf admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:13.894770 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1242/2486] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:18:13 2021] POST /identity/v3/projects => generated 377 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:18:13.898910 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f70a0-c7ac-4ad0-84b2-af1e053a5f46 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:13.908832 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f70a0-c7ac-4ad0-84b2-af1e053a5f46 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:13.967874 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f09e2-2624-4f81-89f3-b0ba8d8d9807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:13.968469 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f09e2-2624-4f81-89f3-b0ba8d8d9807 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:13.968775 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f09e2-2624-4f81-89f3-b0ba8d8d9807 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:13.969052 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f09e2-2624-4f81-89f3-b0ba8d8d9807 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:13.969753 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f09e2-2624-4f81-89f3-b0ba8d8d9807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:13.971651 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f09e2-2624-4f81-89f3-b0ba8d8d9807 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:14.106259 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1245/2487] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:18:13 2021] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:18:14.109647 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf88a9-0f2f-4439-b539-20010d1e0dcf admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:14.119673 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf88a9-0f2f-4439-b539-20010d1e0dcf admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:14.124455 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b29818-69dd-4021-8aff-5cafc9aadbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:14.125222 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b29818-69dd-4021-8aff-5cafc9aadbcf admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:14.125513 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b29818-69dd-4021-8aff-5cafc9aadbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:14.125794 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b29818-69dd-4021-8aff-5cafc9aadbcf admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:14.126526 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b29818-69dd-4021-8aff-5cafc9aadbcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:14.128126 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b29818-69dd-4021-8aff-5cafc9aadbcf admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:14.138891 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1243/2488] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:18:14 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:18:14.143747 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f09e2-2624-4f81-89f3-b0ba8d8d9807 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:14.157497 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f09e2-2624-4f81-89f3-b0ba8d8d9807 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:14.162376 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54377cb5-4ed9-4139-9d7c-78b7a22e049f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:14.163048 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54377cb5-4ed9-4139-9d7c-78b7a22e049f admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:14.163334 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54377cb5-4ed9-4139-9d7c-78b7a22e049f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:14.163615 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54377cb5-4ed9-4139-9d7c-78b7a22e049f admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:14.164344 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54377cb5-4ed9-4139-9d7c-78b7a22e049f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:14.165986 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54377cb5-4ed9-4139-9d7c-78b7a22e049f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:14.176937 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1246/2489] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:18:14 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:18:14.181072 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b29818-69dd-4021-8aff-5cafc9aadbcf admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:14.190881 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b29818-69dd-4021-8aff-5cafc9aadbcf admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:14.195590 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5439336-34a2-4a61-8523-83aa1e4df39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:14.196470 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5439336-34a2-4a61-8523-83aa1e4df39e admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:14.196784 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5439336-34a2-4a61-8523-83aa1e4df39e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:14.197059 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5439336-34a2-4a61-8523-83aa1e4df39e admin admin] PATH_INFO: `/v3/projects/92b014c83af44a5989310576f642c3a5/users/e6822fa6126a49b3b3c752a8ad275417/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:14.212520 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5439336-34a2-4a61-8523-83aa1e4df39e admin admin] RBAC: Authorizing `identity:create_grant(project_id=92b014c83af44a5989310576f642c3a5, user_id=e6822fa6126a49b3b3c752a8ad275417, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:14.215320 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5439336-34a2-4a61-8523-83aa1e4df39e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:14.239119 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba0812-6d3f-44c9-9eb1-8f3973848eac None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:14.239404 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba0812-6d3f-44c9-9eb1-8f3973848eac None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:14.239687 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba0812-6d3f-44c9-9eb1-8f3973848eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:14.263039 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-fbba0812-6d3f-44c9-9eb1-8f3973848eac None None] MFA Rules not processed for user `96c9b76133d74b79a0d2da9a884651e1`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:14.267501 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-fbba0812-6d3f-44c9-9eb1-8f3973848eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:14.298310 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1244/2490] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:18:14 2021] PUT /identity/v3/projects/92b014c83af44a5989310576f642c3a5/users/e6822fa6126a49b3b3c752a8ad275417/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:14.308710 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654a77b-c32c-4897-b706-a3bba6d42731 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:14.309285 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654a77b-c32c-4897-b706-a3bba6d42731 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:14.309980 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654a77b-c32c-4897-b706-a3bba6d42731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:14.340134 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1247/2491] 10.222.0.23 () {58 vars in 968 bytes} [Thu Sep 23 03:18:14 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:18:14.346325 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-4654a77b-c32c-4897-b706-a3bba6d42731 None None] MFA Rules not processed for user `e6822fa6126a49b3b3c752a8ad275417`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:14.348017 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-4654a77b-c32c-4897-b706-a3bba6d42731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:14.354922 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba0812-6d3f-44c9-9eb1-8f3973848eac None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:14.356316 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-fbba0812-6d3f-44c9-9eb1-8f3973848eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:14.420045 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1245/2492] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:14 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:18:14.425320 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654a77b-c32c-4897-b706-a3bba6d42731 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:14.435571 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba0812-6d3f-44c9-9eb1-8f3973848eac None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:14.497160 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654a77b-c32c-4897-b706-a3bba6d42731 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:14.502336 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23810ce7-ff13-454e-a382-0705791461e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:14.502944 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23810ce7-ff13-454e-a382-0705791461e1 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:14.503226 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23810ce7-ff13-454e-a382-0705791461e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:14.503504 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23810ce7-ff13-454e-a382-0705791461e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:14.509874 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23810ce7-ff13-454e-a382-0705791461e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:14.509874 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23810ce7-ff13-454e-a382-0705791461e1 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:14.510112 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bae30-e814-4fd8-96a8-2b34deb46d25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df051fd059b34fe0993f501546d1610f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:14.510112 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bae30-e814-4fd8-96a8-2b34deb46d25 service swift] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:14.510112 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bae30-e814-4fd8-96a8-2b34deb46d25 service swift] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:14.510644 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bae30-e814-4fd8-96a8-2b34deb46d25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:14.578342 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bae30-e814-4fd8-96a8-2b34deb46d25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:14.580820 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bae30-e814-4fd8-96a8-2b34deb46d25 service swift] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:14.591110 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1248/2493] 10.222.0.23 () {60 vars in 1385 bytes} [Thu Sep 23 03:18:14 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 23 03:18:14.601999 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1246/2494] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:18:14 2021] POST /identity/v3/projects => generated 379 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:18:14.603472 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bae30-e814-4fd8-96a8-2b34deb46d25 service swift] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:14.615462 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bae30-e814-4fd8-96a8-2b34deb46d25 service swift] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:14.699819 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0556a8e-cd72-4a2e-b8c4-95c3666b8f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:14.700570 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0556a8e-cd72-4a2e-b8c4-95c3666b8f6f admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:14.700962 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0556a8e-cd72-4a2e-b8c4-95c3666b8f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:14.701343 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0556a8e-cd72-4a2e-b8c4-95c3666b8f6f admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:14.702144 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0556a8e-cd72-4a2e-b8c4-95c3666b8f6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:14.704817 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0556a8e-cd72-4a2e-b8c4-95c3666b8f6f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:14.853198 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1249/2495] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:18:14 2021] POST /identity/v3/users => generated 290 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:18:14.857507 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23810ce7-ff13-454e-a382-0705791461e1 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:14.868495 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23810ce7-ff13-454e-a382-0705791461e1 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:14.873416 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9acfe8-f9d0-4414-adc1-e3bf4c2cace6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:14.874165 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9acfe8-f9d0-4414-adc1-e3bf4c2cace6 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:14.874533 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9acfe8-f9d0-4414-adc1-e3bf4c2cace6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:14.874826 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9acfe8-f9d0-4414-adc1-e3bf4c2cace6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:14.875558 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9acfe8-f9d0-4414-adc1-e3bf4c2cace6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:14.877200 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9acfe8-f9d0-4414-adc1-e3bf4c2cace6 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:14.887966 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1247/2496] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:18:14 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:18:14.892678 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0556a8e-cd72-4a2e-b8c4-95c3666b8f6f admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:14.903407 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0556a8e-cd72-4a2e-b8c4-95c3666b8f6f admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:14.908864 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ed8cb-5767-4591-87e1-a2fa48d2b906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:14.909542 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ed8cb-5767-4591-87e1-a2fa48d2b906 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:14.909830 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ed8cb-5767-4591-87e1-a2fa48d2b906 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:14.910113 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ed8cb-5767-4591-87e1-a2fa48d2b906 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:14.910846 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ed8cb-5767-4591-87e1-a2fa48d2b906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:14.912449 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ed8cb-5767-4591-87e1-a2fa48d2b906 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:14.923519 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1250/2497] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:18:14 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:18:14.927731 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9acfe8-f9d0-4414-adc1-e3bf4c2cace6 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:14.937658 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9acfe8-f9d0-4414-adc1-e3bf4c2cace6 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:14.942284 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0990b-db85-4699-a598-f34ac68fe5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:14.943164 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0990b-db85-4699-a598-f34ac68fe5e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:14.943449 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0990b-db85-4699-a598-f34ac68fe5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:14.943731 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0990b-db85-4699-a598-f34ac68fe5e6 admin admin] PATH_INFO: `/v3/projects/71ab2f4fd8294ee3af6cbc498c82bb64/users/dfcdeb7475ac4346beff0b2b83215a46/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:14.957899 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0990b-db85-4699-a598-f34ac68fe5e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71ab2f4fd8294ee3af6cbc498c82bb64, user_id=dfcdeb7475ac4346beff0b2b83215a46, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:14.960627 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0990b-db85-4699-a598-f34ac68fe5e6 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:15.048886 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1248/2498] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:18:14 2021] PUT /identity/v3/projects/71ab2f4fd8294ee3af6cbc498c82bb64/users/dfcdeb7475ac4346beff0b2b83215a46/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:15.060033 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412b564-ee8f-4f45-ba7c-94f1361499c1 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:15.060339 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412b564-ee8f-4f45-ba7c-94f1361499c1 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:15.060634 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412b564-ee8f-4f45-ba7c-94f1361499c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:15.086209 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-b412b564-ee8f-4f45-ba7c-94f1361499c1 None None] MFA Rules not processed for user `dfcdeb7475ac4346beff0b2b83215a46`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:15.087435 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-b412b564-ee8f-4f45-ba7c-94f1361499c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:15.154546 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1251/2499] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:15 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:18:15.159650 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0990b-db85-4699-a598-f34ac68fe5e6 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:15.221773 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0990b-db85-4699-a598-f34ac68fe5e6 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:15.226643 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59112a0d-161a-4b5c-8922-678a50c32c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:15.227311 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59112a0d-161a-4b5c-8922-678a50c32c39 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:15.227597 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59112a0d-161a-4b5c-8922-678a50c32c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:15.227877 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59112a0d-161a-4b5c-8922-678a50c32c39 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:15.228604 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59112a0d-161a-4b5c-8922-678a50c32c39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:15.230501 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59112a0d-161a-4b5c-8922-678a50c32c39 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:15.290634 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1249/2500] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:18:15 2021] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:18:15.294729 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412b564-ee8f-4f45-ba7c-94f1361499c1 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:15.307179 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412b564-ee8f-4f45-ba7c-94f1361499c1 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:15.369567 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e41c07-6cff-414c-8989-04ca432793d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:15.370245 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e41c07-6cff-414c-8989-04ca432793d6 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:15.370529 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e41c07-6cff-414c-8989-04ca432793d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:15.370804 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e41c07-6cff-414c-8989-04ca432793d6 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:15.371531 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e41c07-6cff-414c-8989-04ca432793d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:15.373472 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e41c07-6cff-414c-8989-04ca432793d6 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:15.449913 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1252/2501] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:18:15 2021] POST /identity/v3/users => generated 296 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:18:15.451316 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59112a0d-161a-4b5c-8922-678a50c32c39 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:15.463096 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59112a0d-161a-4b5c-8922-678a50c32c39 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:15.470051 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5c40c-ae31-4920-a586-cda4e1a1014f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:15.470858 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5c40c-ae31-4920-a586-cda4e1a1014f admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:15.471150 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5c40c-ae31-4920-a586-cda4e1a1014f admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:15.474121 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5c40c-ae31-4920-a586-cda4e1a1014f admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:15.474121 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5c40c-ae31-4920-a586-cda4e1a1014f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:15.474121 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5c40c-ae31-4920-a586-cda4e1a1014f admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:15.485859 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1250/2502] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:18:15 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:18:15.490156 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e41c07-6cff-414c-8989-04ca432793d6 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:15.500810 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e41c07-6cff-414c-8989-04ca432793d6 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:15.506168 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a55cc-e565-4882-826e-5240cb570398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:15.506798 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a55cc-e565-4882-826e-5240cb570398 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:15.507078 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a55cc-e565-4882-826e-5240cb570398 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:15.507354 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a55cc-e565-4882-826e-5240cb570398 admin admin] PATH_INFO: `/v3/projects/e1459664598c4de1ab9e0cf8886a8285/users/610373bc039043a08e326230624cd951/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:15.524158 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a55cc-e565-4882-826e-5240cb570398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1459664598c4de1ab9e0cf8886a8285, user_id=610373bc039043a08e326230624cd951, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:15.526920 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a55cc-e565-4882-826e-5240cb570398 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:15.631248 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1253/2503] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:18:15 2021] PUT /identity/v3/projects/e1459664598c4de1ab9e0cf8886a8285/users/610373bc039043a08e326230624cd951/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:15.635916 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5c40c-ae31-4920-a586-cda4e1a1014f admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:15.648082 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5c40c-ae31-4920-a586-cda4e1a1014f admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:15.707580 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec0126-db30-4d98-9373-cc7177b1d172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:15.708712 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec0126-db30-4d98-9373-cc7177b1d172 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:15.709176 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec0126-db30-4d98-9373-cc7177b1d172 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:15.709631 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec0126-db30-4d98-9373-cc7177b1d172 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:15.710504 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec0126-db30-4d98-9373-cc7177b1d172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:15.712137 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec0126-db30-4d98-9373-cc7177b1d172 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:15.722388 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1251/2504] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:18:15 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:18:15.726835 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a55cc-e565-4882-826e-5240cb570398 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:15.738177 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a55cc-e565-4882-826e-5240cb570398 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:15.744269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530013d-499d-48c6-b0d1-6e145a64bfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:15.749460 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530013d-499d-48c6-b0d1-6e145a64bfc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:15.749460 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530013d-499d-48c6-b0d1-6e145a64bfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:15.749460 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530013d-499d-48c6-b0d1-6e145a64bfc0 admin admin] PATH_INFO: `/v3/projects/e1459664598c4de1ab9e0cf8886a8285/users/610373bc039043a08e326230624cd951/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:15.749460 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530013d-499d-48c6-b0d1-6e145a64bfc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1459664598c4de1ab9e0cf8886a8285, user_id=610373bc039043a08e326230624cd951, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:15.751991 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530013d-499d-48c6-b0d1-6e145a64bfc0 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:15.762796 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1254/2505] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:18:15 2021] PUT /identity/v3/projects/e1459664598c4de1ab9e0cf8886a8285/users/610373bc039043a08e326230624cd951/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:15.774790 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781600d8-022c-49b6-9377-c8307aed2bbb None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:15.775261 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781600d8-022c-49b6-9377-c8307aed2bbb None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:15.775549 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781600d8-022c-49b6-9377-c8307aed2bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:15.804332 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-781600d8-022c-49b6-9377-c8307aed2bbb None None] MFA Rules not processed for user `610373bc039043a08e326230624cd951`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:15.805806 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-781600d8-022c-49b6-9377-c8307aed2bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:15.889478 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1252/2506] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:15 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:18:15.900809 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530013d-499d-48c6-b0d1-6e145a64bfc0 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:15.903552 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-b530013d-499d-48c6-b0d1-6e145a64bfc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:15.999463 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530013d-499d-48c6-b0d1-6e145a64bfc0 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:16.005071 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c3bcc-0b0d-4d13-a1a4-58f0a91142a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:16.006254 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c3bcc-0b0d-4d13-a1a4-58f0a91142a2 service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:16.006254 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c3bcc-0b0d-4d13-a1a4-58f0a91142a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:16.006495 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c3bcc-0b0d-4d13-a1a4-58f0a91142a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:16.016337 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c3bcc-0b0d-4d13-a1a4-58f0a91142a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:16.017930 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c3bcc-0b0d-4d13-a1a4-58f0a91142a2 service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:16.028696 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1255/2507] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:18:15 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:18:16.142419 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781600d8-022c-49b6-9377-c8307aed2bbb None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:16.143887 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-781600d8-022c-49b6-9377-c8307aed2bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:16.156619 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781600d8-022c-49b6-9377-c8307aed2bbb None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:16.161250 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647b9a6-5140-439e-8d40-50617af87be4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:16.161933 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647b9a6-5140-439e-8d40-50617af87be4 service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:16.162274 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647b9a6-5140-439e-8d40-50617af87be4 service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:16.162563 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647b9a6-5140-439e-8d40-50617af87be4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:16.217739 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647b9a6-5140-439e-8d40-50617af87be4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:16.219306 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647b9a6-5140-439e-8d40-50617af87be4 service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:16.228984 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1253/2508] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:18:16 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:18:16.280738 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c3bcc-0b0d-4d13-a1a4-58f0a91142a2 service cinder] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:16.282203 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-158c3bcc-0b0d-4d13-a1a4-58f0a91142a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:16.338740 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c3bcc-0b0d-4d13-a1a4-58f0a91142a2 service cinder] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:16.343707 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a479a9-a96c-4791-96e3-094a261b8ead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:16.344404 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a479a9-a96c-4791-96e3-094a261b8ead service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:16.344728 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a479a9-a96c-4791-96e3-094a261b8ead service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:16.345011 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a479a9-a96c-4791-96e3-094a261b8ead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:16.346820 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-a8a479a9-a96c-4791-96e3-094a261b8ead service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:16.358112 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a479a9-a96c-4791-96e3-094a261b8ead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:16.359934 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a479a9-a96c-4791-96e3-094a261b8ead service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:16.368647 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1256/2509] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:18:16 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:18:17.023183 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647b9a6-5140-439e-8d40-50617af87be4 service cinder] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:17.026259 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-0647b9a6-5140-439e-8d40-50617af87be4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:17.100875 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647b9a6-5140-439e-8d40-50617af87be4 service cinder] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:17.103684 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aba2e1-b82f-48a3-bb56-5f2efd199145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:17.104535 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aba2e1-b82f-48a3-bb56-5f2efd199145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:17.104964 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aba2e1-b82f-48a3-bb56-5f2efd199145 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:17.105247 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aba2e1-b82f-48a3-bb56-5f2efd199145 admin admin] PATH_INFO: `/v3/users/a90e9edfcc52487aa4c0bc8bd5ce5675` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:17.106452 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aba2e1-b82f-48a3-bb56-5f2efd199145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a90e9edfcc52487aa4c0bc8bd5ce5675)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:17.108699 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aba2e1-b82f-48a3-bb56-5f2efd199145 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:17.271217 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-f0aba2e1-b82f-48a3-bb56-5f2efd199145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a90e9edfcc52487aa4c0bc8bd5ce5675'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:17.271794 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-f0aba2e1-b82f-48a3-bb56-5f2efd199145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a90e9edfcc52487aa4c0bc8bd5ce5675'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:17.278575 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-f0aba2e1-b82f-48a3-bb56-5f2efd199145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a90e9edfcc52487aa4c0bc8bd5ce5675'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:17.344742 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-f0aba2e1-b82f-48a3-bb56-5f2efd199145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a90e9edfcc52487aa4c0bc8bd5ce5675'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:17.356949 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-f0aba2e1-b82f-48a3-bb56-5f2efd199145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a90e9edfcc52487aa4c0bc8bd5ce5675'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:17.363457 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1254/2510] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:18:17 2021] DELETE /identity/v3/users/a90e9edfcc52487aa4c0bc8bd5ce5675 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:18:17.368088 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55908275-a176-4a8c-8528-ac6ac07064a8 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:17.368591 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55908275-a176-4a8c-8528-ac6ac07064a8 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:17.368746 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55908275-a176-4a8c-8528-ac6ac07064a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:17.386269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-55908275-a176-4a8c-8528-ac6ac07064a8 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:17.387562 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-55908275-a176-4a8c-8528-ac6ac07064a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:17.445336 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1257/2511] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:18:17.455222 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aba2e1-b82f-48a3-bb56-5f2efd199145 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:17.456668 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-f0aba2e1-b82f-48a3-bb56-5f2efd199145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:17.511681 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aba2e1-b82f-48a3-bb56-5f2efd199145 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:17.515872 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63cc6d-dbfd-4a85-8849-ae228053a1db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:17.516541 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63cc6d-dbfd-4a85-8849-ae228053a1db service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:17.516823 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63cc6d-dbfd-4a85-8849-ae228053a1db service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:17.517093 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63cc6d-dbfd-4a85-8849-ae228053a1db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:17.525905 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63cc6d-dbfd-4a85-8849-ae228053a1db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:17.527264 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63cc6d-dbfd-4a85-8849-ae228053a1db service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:17.537418 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1255/2512] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:18:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:18:18.346874 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55908275-a176-4a8c-8528-ac6ac07064a8 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:18.348369 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-55908275-a176-4a8c-8528-ac6ac07064a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:18.362940 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55908275-a176-4a8c-8528-ac6ac07064a8 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:18.368029 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084919b-df51-4bf5-87c0-5d1ea3ab9492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:18.369105 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084919b-df51-4bf5-87c0-5d1ea3ab9492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:18.369633 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084919b-df51-4bf5-87c0-5d1ea3ab9492 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:18.369728 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084919b-df51-4bf5-87c0-5d1ea3ab9492 admin admin] PATH_INFO: `/v3/projects/1269d404af1d4560b392313f7c5376bc` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:18.371459 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084919b-df51-4bf5-87c0-5d1ea3ab9492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1269d404af1d4560b392313f7c5376bc)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:18.373634 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084919b-df51-4bf5-87c0-5d1ea3ab9492 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:18.481320 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-a084919b-df51-4bf5-87c0-5d1ea3ab9492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1269d404af1d4560b392313f7c5376bc', 'request_id': 'req-a084919b-df51-4bf5-87c0-5d1ea3ab9492'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:18.555431 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-a084919b-df51-4bf5-87c0-5d1ea3ab9492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1269d404af1d4560b392313f7c5376bc', 'request_id': 'req-a084919b-df51-4bf5-87c0-5d1ea3ab9492'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:18.561342 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-a084919b-df51-4bf5-87c0-5d1ea3ab9492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1269d404af1d4560b392313f7c5376bc', 'request_id': 'req-a084919b-df51-4bf5-87c0-5d1ea3ab9492'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:18.572129 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-a084919b-df51-4bf5-87c0-5d1ea3ab9492 admin admin] The token cache is being invalidate because project 1269d404af1d4560b392313f7c5376bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:18:18.572416 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-a084919b-df51-4bf5-87c0-5d1ea3ab9492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:18.573072 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-a084919b-df51-4bf5-87c0-5d1ea3ab9492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:18.574602 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1258/2513] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:18:18 2021] DELETE /identity/v3/projects/1269d404af1d4560b392313f7c5376bc => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:18.578970 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63cc6d-dbfd-4a85-8849-ae228053a1db service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:18.588261 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63cc6d-dbfd-4a85-8849-ae228053a1db service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:18.641164 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd9e48-06bd-4c79-a0ab-59a3fdc62267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:18.642010 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd9e48-06bd-4c79-a0ab-59a3fdc62267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:18.642290 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd9e48-06bd-4c79-a0ab-59a3fdc62267 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:18.642562 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd9e48-06bd-4c79-a0ab-59a3fdc62267 admin admin] PATH_INFO: `/v3/users/065349feaf4d4dc8b80d353e6d8c0ab3` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:18.643719 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd9e48-06bd-4c79-a0ab-59a3fdc62267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=065349feaf4d4dc8b80d353e6d8c0ab3)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:18.645641 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd9e48-06bd-4c79-a0ab-59a3fdc62267 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:18.859900 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-34bd9e48-06bd-4c79-a0ab-59a3fdc62267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '065349feaf4d4dc8b80d353e6d8c0ab3'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:18.860751 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-34bd9e48-06bd-4c79-a0ab-59a3fdc62267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '065349feaf4d4dc8b80d353e6d8c0ab3'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:18.868780 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-34bd9e48-06bd-4c79-a0ab-59a3fdc62267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '065349feaf4d4dc8b80d353e6d8c0ab3'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:18.943915 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-34bd9e48-06bd-4c79-a0ab-59a3fdc62267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '065349feaf4d4dc8b80d353e6d8c0ab3'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:18.956290 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-34bd9e48-06bd-4c79-a0ab-59a3fdc62267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '065349feaf4d4dc8b80d353e6d8c0ab3'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:18.962394 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1256/2514] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:18:18 2021] DELETE /identity/v3/users/065349feaf4d4dc8b80d353e6d8c0ab3 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:19.626813 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084919b-df51-4bf5-87c0-5d1ea3ab9492 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:19.629100 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-a084919b-df51-4bf5-87c0-5d1ea3ab9492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:19.643115 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084919b-df51-4bf5-87c0-5d1ea3ab9492 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:19.711649 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef84b3-89fa-4cc2-970d-2262d0837169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:19.712870 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef84b3-89fa-4cc2-970d-2262d0837169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:19.713162 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef84b3-89fa-4cc2-970d-2262d0837169 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:19.713472 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef84b3-89fa-4cc2-970d-2262d0837169 admin admin] PATH_INFO: `/v3/projects/720a2fe1dbcc47dd95866813f0980af3` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:19.714784 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef84b3-89fa-4cc2-970d-2262d0837169 admin admin] RBAC: Authorizing `identity:delete_project(project_id=720a2fe1dbcc47dd95866813f0980af3)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:19.716715 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef84b3-89fa-4cc2-970d-2262d0837169 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:19.841122 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-cdef84b3-89fa-4cc2-970d-2262d0837169 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '720a2fe1dbcc47dd95866813f0980af3', 'request_id': 'req-cdef84b3-89fa-4cc2-970d-2262d0837169'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:19.915433 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-cdef84b3-89fa-4cc2-970d-2262d0837169 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '720a2fe1dbcc47dd95866813f0980af3', 'request_id': 'req-cdef84b3-89fa-4cc2-970d-2262d0837169'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:19.922495 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-cdef84b3-89fa-4cc2-970d-2262d0837169 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '720a2fe1dbcc47dd95866813f0980af3', 'request_id': 'req-cdef84b3-89fa-4cc2-970d-2262d0837169'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:19.934653 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-cdef84b3-89fa-4cc2-970d-2262d0837169 admin admin] The token cache is being invalidate because project 720a2fe1dbcc47dd95866813f0980af3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:18:19.934944 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-cdef84b3-89fa-4cc2-970d-2262d0837169 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:19.935618 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-cdef84b3-89fa-4cc2-970d-2262d0837169 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:19.937995 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1259/2515] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:18:19 2021] DELETE /identity/v3/projects/720a2fe1dbcc47dd95866813f0980af3 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:18:19.943846 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba025109-06a6-417a-825f-6b8a0afdd465 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:19.944315 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba025109-06a6-417a-825f-6b8a0afdd465 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:19.944432 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba025109-06a6-417a-825f-6b8a0afdd465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:19.961807 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-ba025109-06a6-417a-825f-6b8a0afdd465 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:19.963014 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-ba025109-06a6-417a-825f-6b8a0afdd465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:20.029767 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1257/2516] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:18:20.038236 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf84757-0ec8-4503-b684-562a2c7415cd None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:20.038586 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf84757-0ec8-4503-b684-562a2c7415cd None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:20.038921 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf84757-0ec8-4503-b684-562a2c7415cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:20.061161 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-0bf84757-0ec8-4503-b684-562a2c7415cd None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:20.063123 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-0bf84757-0ec8-4503-b684-562a2c7415cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:20.071493 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1260/2517] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:18:20.076158 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba025109-06a6-417a-825f-6b8a0afdd465 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:20.085811 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba025109-06a6-417a-825f-6b8a0afdd465 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:20.090678 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d46245-8743-465e-ab99-71d6f1248228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:20.091343 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d46245-8743-465e-ab99-71d6f1248228 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:20.091631 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d46245-8743-465e-ab99-71d6f1248228 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:20.091912 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d46245-8743-465e-ab99-71d6f1248228 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:20.092676 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d46245-8743-465e-ab99-71d6f1248228 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:18:20.092991 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d46245-8743-465e-ab99-71d6f1248228 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:20.095147 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d46245-8743-465e-ab99-71d6f1248228 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:20.107031 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1258/2518] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:18:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:18:20.111906 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf84757-0ec8-4503-b684-562a2c7415cd None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:20.121188 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf84757-0ec8-4503-b684-562a2c7415cd None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:20.125914 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf1ade-974d-4cdd-b26f-41bea76a0fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:20.126566 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf1ade-974d-4cdd-b26f-41bea76a0fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:20.126849 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf1ade-974d-4cdd-b26f-41bea76a0fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:20.127127 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf1ade-974d-4cdd-b26f-41bea76a0fe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:20.127812 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf1ade-974d-4cdd-b26f-41bea76a0fe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:20.129741 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf1ade-974d-4cdd-b26f-41bea76a0fe2 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:20.259085 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1261/2519] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:18:20 2021] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:18:20.263011 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d46245-8743-465e-ab99-71d6f1248228 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:20.273599 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d46245-8743-465e-ab99-71d6f1248228 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:20.333388 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffc968-8e82-40da-b6d6-405d93a126c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:20.334078 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffc968-8e82-40da-b6d6-405d93a126c4 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:20.334359 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffc968-8e82-40da-b6d6-405d93a126c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:20.334638 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffc968-8e82-40da-b6d6-405d93a126c4 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:20.335339 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffc968-8e82-40da-b6d6-405d93a126c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:20.337335 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffc968-8e82-40da-b6d6-405d93a126c4 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:20.395992 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1259/2520] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:18:20 2021] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:18:20.400225 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf1ade-974d-4cdd-b26f-41bea76a0fe2 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:20.410933 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf1ade-974d-4cdd-b26f-41bea76a0fe2 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:20.415594 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f781eec-2645-4538-a9dd-17d0db8640ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:20.416248 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f781eec-2645-4538-a9dd-17d0db8640ee admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:20.416620 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f781eec-2645-4538-a9dd-17d0db8640ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:20.416899 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f781eec-2645-4538-a9dd-17d0db8640ee admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:20.417618 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f781eec-2645-4538-a9dd-17d0db8640ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:20.419192 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f781eec-2645-4538-a9dd-17d0db8640ee admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:20.430163 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1262/2521] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:18:20 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:18:20.434029 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffc968-8e82-40da-b6d6-405d93a126c4 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:20.444258 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffc968-8e82-40da-b6d6-405d93a126c4 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:20.448968 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6dd1c-2cb5-4e95-a172-bc6c01115f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:20.449720 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6dd1c-2cb5-4e95-a172-bc6c01115f65 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:20.450008 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6dd1c-2cb5-4e95-a172-bc6c01115f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:20.450286 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6dd1c-2cb5-4e95-a172-bc6c01115f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:20.451628 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6dd1c-2cb5-4e95-a172-bc6c01115f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:20.453283 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6dd1c-2cb5-4e95-a172-bc6c01115f65 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:20.463526 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1260/2522] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:18:20 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:18:20.470131 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f781eec-2645-4538-a9dd-17d0db8640ee admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:20.480378 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f781eec-2645-4538-a9dd-17d0db8640ee admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:20.485338 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db6dcc-f1ba-4fca-af27-333db141c2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:20.486312 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db6dcc-f1ba-4fca-af27-333db141c2de admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:20.486597 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db6dcc-f1ba-4fca-af27-333db141c2de admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:20.486880 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db6dcc-f1ba-4fca-af27-333db141c2de admin admin] PATH_INFO: `/v3/projects/a216123d74e444d3a965aa6ba0d7e228/users/289627013dd9458085dba385d0ff7909/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:20.502880 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db6dcc-f1ba-4fca-af27-333db141c2de admin admin] RBAC: Authorizing `identity:create_grant(project_id=a216123d74e444d3a965aa6ba0d7e228, user_id=289627013dd9458085dba385d0ff7909, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:20.505560 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db6dcc-f1ba-4fca-af27-333db141c2de admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:20.607394 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1263/2523] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:18:20 2021] PUT /identity/v3/projects/a216123d74e444d3a965aa6ba0d7e228/users/289627013dd9458085dba385d0ff7909/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:18:20.619218 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eeda91-2f2f-4e7c-95a1-c9a79342543a None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:20.619570 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eeda91-2f2f-4e7c-95a1-c9a79342543a None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:20.619955 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eeda91-2f2f-4e7c-95a1-c9a79342543a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:20.647028 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-01eeda91-2f2f-4e7c-95a1-c9a79342543a None None] MFA Rules not processed for user `289627013dd9458085dba385d0ff7909`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:20.648373 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-01eeda91-2f2f-4e7c-95a1-c9a79342543a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:20.712537 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1261/2524] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:20 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:18:20.722949 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db6dcc-f1ba-4fca-af27-333db141c2de admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:20.724659 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-46db6dcc-f1ba-4fca-af27-333db141c2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:20.782347 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db6dcc-f1ba-4fca-af27-333db141c2de admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:20.785952 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552e4f9-f3b1-4cc8-9cc5-9348e08bdb87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:20.786591 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552e4f9-f3b1-4cc8-9cc5-9348e08bdb87 service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:20.786870 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552e4f9-f3b1-4cc8-9cc5-9348e08bdb87 service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:20.787145 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552e4f9-f3b1-4cc8-9cc5-9348e08bdb87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:20.795204 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552e4f9-f3b1-4cc8-9cc5-9348e08bdb87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:20.797304 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552e4f9-f3b1-4cc8-9cc5-9348e08bdb87 service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:20.806968 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1264/2525] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:18:20 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:18:20.828846 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eeda91-2f2f-4e7c-95a1-c9a79342543a None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:20.892669 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eeda91-2f2f-4e7c-95a1-c9a79342543a None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:20.897309 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132b23b-4909-4421-b5ba-1d3362fcb97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:20.898171 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132b23b-4909-4421-b5ba-1d3362fcb97e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:20.898451 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132b23b-4909-4421-b5ba-1d3362fcb97e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:20.898723 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132b23b-4909-4421-b5ba-1d3362fcb97e admin admin] PATH_INFO: `/v3/users/289627013dd9458085dba385d0ff7909` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:20.899925 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132b23b-4909-4421-b5ba-1d3362fcb97e admin admin] RBAC: Authorizing `identity:delete_user(user_id=289627013dd9458085dba385d0ff7909)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:20.901874 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132b23b-4909-4421-b5ba-1d3362fcb97e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:21.117491 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d132b23b-4909-4421-b5ba-1d3362fcb97e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '289627013dd9458085dba385d0ff7909'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:21.118202 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d132b23b-4909-4421-b5ba-1d3362fcb97e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '289627013dd9458085dba385d0ff7909'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:21.126551 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d132b23b-4909-4421-b5ba-1d3362fcb97e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '289627013dd9458085dba385d0ff7909'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:21.184027 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d132b23b-4909-4421-b5ba-1d3362fcb97e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '289627013dd9458085dba385d0ff7909'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:21.196443 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d132b23b-4909-4421-b5ba-1d3362fcb97e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '289627013dd9458085dba385d0ff7909'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:21.202192 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1262/2526] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:18:20 2021] DELETE /identity/v3/users/289627013dd9458085dba385d0ff7909 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:21.207409 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdf5fd-c887-448a-afb9-c627992b9714 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:21.207759 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdf5fd-c887-448a-afb9-c627992b9714 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:21.208036 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdf5fd-c887-448a-afb9-c627992b9714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:21.226432 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-24cdf5fd-c887-448a-afb9-c627992b9714 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:21.227639 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-24cdf5fd-c887-448a-afb9-c627992b9714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:21.285268 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1265/2527] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:18:21.295170 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132b23b-4909-4421-b5ba-1d3362fcb97e admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:21.297100 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-d132b23b-4909-4421-b5ba-1d3362fcb97e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:21.361925 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132b23b-4909-4421-b5ba-1d3362fcb97e admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:21.365742 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd62a6e-c1af-4707-8fd0-63cafd460277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:21.366395 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd62a6e-c1af-4707-8fd0-63cafd460277 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:21.375484 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd62a6e-c1af-4707-8fd0-63cafd460277 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:21.375484 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd62a6e-c1af-4707-8fd0-63cafd460277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:21.377180 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd62a6e-c1af-4707-8fd0-63cafd460277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:21.378619 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd62a6e-c1af-4707-8fd0-63cafd460277 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:21.388186 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1263/2528] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:18:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:18:21.483529 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdf5fd-c887-448a-afb9-c627992b9714 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:21.486363 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-24cdf5fd-c887-448a-afb9-c627992b9714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:21.498288 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdf5fd-c887-448a-afb9-c627992b9714 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:21.504706 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7c69b-3150-4933-af7f-d32a93487319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:21.505602 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7c69b-3150-4933-af7f-d32a93487319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:21.507818 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7c69b-3150-4933-af7f-d32a93487319 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:21.507818 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7c69b-3150-4933-af7f-d32a93487319 admin admin] PATH_INFO: `/v3/users/e6822fa6126a49b3b3c752a8ad275417` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:21.507818 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7c69b-3150-4933-af7f-d32a93487319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6822fa6126a49b3b3c752a8ad275417)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:21.509759 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7c69b-3150-4933-af7f-d32a93487319 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:21.729175 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-47b7c69b-3150-4933-af7f-d32a93487319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6822fa6126a49b3b3c752a8ad275417'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:21.729876 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-47b7c69b-3150-4933-af7f-d32a93487319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6822fa6126a49b3b3c752a8ad275417'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:21.730441 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-47b7c69b-3150-4933-af7f-d32a93487319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6822fa6126a49b3b3c752a8ad275417'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:21.738200 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-47b7c69b-3150-4933-af7f-d32a93487319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6822fa6126a49b3b3c752a8ad275417'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:21.848894 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd62a6e-c1af-4707-8fd0-63cafd460277 service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:21.850438 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-3fd62a6e-c1af-4707-8fd0-63cafd460277 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:21.866701 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd62a6e-c1af-4707-8fd0-63cafd460277 service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:21.870088 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-47b7c69b-3150-4933-af7f-d32a93487319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6822fa6126a49b3b3c752a8ad275417'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:21.871865 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b32f2d-a37a-4516-95ca-950b4c07133c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:21.873524 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b32f2d-a37a-4516-95ca-950b4c07133c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:21.873524 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b32f2d-a37a-4516-95ca-950b4c07133c admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:21.873524 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b32f2d-a37a-4516-95ca-950b4c07133c admin admin] PATH_INFO: `/v3/projects/a216123d74e444d3a965aa6ba0d7e228` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:21.875154 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b32f2d-a37a-4516-95ca-950b4c07133c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a216123d74e444d3a965aa6ba0d7e228)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:21.877371 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b32f2d-a37a-4516-95ca-950b4c07133c admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:21.891245 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1266/2529] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:18:21 2021] DELETE /identity/v3/users/e6822fa6126a49b3b3c752a8ad275417 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:18:21.895570 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fabd3a-7f1c-4fd3-b983-aa6d9636bd97 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:21.895854 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fabd3a-7f1c-4fd3-b983-aa6d9636bd97 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:21.896129 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fabd3a-7f1c-4fd3-b983-aa6d9636bd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:21.914699 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-39fabd3a-7f1c-4fd3-b983-aa6d9636bd97 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:21.915845 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-39fabd3a-7f1c-4fd3-b983-aa6d9636bd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:21.975073 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1267/2530] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:18:21.987637 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fabd3a-7f1c-4fd3-b983-aa6d9636bd97 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:21.990084 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-39fabd3a-7f1c-4fd3-b983-aa6d9636bd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:22.011595 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-16b32f2d-a37a-4516-95ca-950b4c07133c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a216123d74e444d3a965aa6ba0d7e228', 'request_id': 'req-16b32f2d-a37a-4516-95ca-950b4c07133c'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:22.053475 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fabd3a-7f1c-4fd3-b983-aa6d9636bd97 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:22.092738 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-16b32f2d-a37a-4516-95ca-950b4c07133c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a216123d74e444d3a965aa6ba0d7e228', 'request_id': 'req-16b32f2d-a37a-4516-95ca-950b4c07133c'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:22.099413 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-16b32f2d-a37a-4516-95ca-950b4c07133c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a216123d74e444d3a965aa6ba0d7e228', 'request_id': 'req-16b32f2d-a37a-4516-95ca-950b4c07133c'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:22.102393 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad507263-6fd4-4baa-ac72-fb1581eca63f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:22.103233 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad507263-6fd4-4baa-ac72-fb1581eca63f service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:22.103357 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad507263-6fd4-4baa-ac72-fb1581eca63f service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:22.103597 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad507263-6fd4-4baa-ac72-fb1581eca63f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:22.111079 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-16b32f2d-a37a-4516-95ca-950b4c07133c admin admin] The token cache is being invalidate because project a216123d74e444d3a965aa6ba0d7e228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:18:22.111387 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-16b32f2d-a37a-4516-95ca-950b4c07133c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:22.112042 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-16b32f2d-a37a-4516-95ca-950b4c07133c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:22.114025 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1264/2531] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:18:21 2021] DELETE /identity/v3/projects/a216123d74e444d3a965aa6ba0d7e228 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:18:22.170127 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad507263-6fd4-4baa-ac72-fb1581eca63f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:22.171551 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad507263-6fd4-4baa-ac72-fb1581eca63f service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:22.182658 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1268/2532] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:18:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:18:22.602968 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b32f2d-a37a-4516-95ca-950b4c07133c admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:22.604419 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-16b32f2d-a37a-4516-95ca-950b4c07133c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:22.618694 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b32f2d-a37a-4516-95ca-950b4c07133c admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:22.623659 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802add5-4d84-4dc4-808f-227329ef1e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:22.625143 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802add5-4d84-4dc4-808f-227329ef1e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:22.625462 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802add5-4d84-4dc4-808f-227329ef1e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:22.625700 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802add5-4d84-4dc4-808f-227329ef1e1f admin admin] PATH_INFO: `/v3/projects/92b014c83af44a5989310576f642c3a5` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:22.627560 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802add5-4d84-4dc4-808f-227329ef1e1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=92b014c83af44a5989310576f642c3a5)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:22.629737 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802add5-4d84-4dc4-808f-227329ef1e1f admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:22.758519 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1802add5-4d84-4dc4-808f-227329ef1e1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92b014c83af44a5989310576f642c3a5', 'request_id': 'req-1802add5-4d84-4dc4-808f-227329ef1e1f'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:22.847159 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1802add5-4d84-4dc4-808f-227329ef1e1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92b014c83af44a5989310576f642c3a5', 'request_id': 'req-1802add5-4d84-4dc4-808f-227329ef1e1f'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:22.854056 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1802add5-4d84-4dc4-808f-227329ef1e1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92b014c83af44a5989310576f642c3a5', 'request_id': 'req-1802add5-4d84-4dc4-808f-227329ef1e1f'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:22.870472 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1802add5-4d84-4dc4-808f-227329ef1e1f admin admin] The token cache is being invalidate because project 92b014c83af44a5989310576f642c3a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:18:22.870770 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1802add5-4d84-4dc4-808f-227329ef1e1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:22.872577 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1802add5-4d84-4dc4-808f-227329ef1e1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:22.876477 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1265/2533] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:18:22 2021] DELETE /identity/v3/projects/92b014c83af44a5989310576f642c3a5 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:22.880773 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad507263-6fd4-4baa-ac72-fb1581eca63f service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:22.882320 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-ad507263-6fd4-4baa-ac72-fb1581eca63f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:22.895120 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad507263-6fd4-4baa-ac72-fb1581eca63f service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:22.954893 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8cd04-2a4b-4c0a-9cc3-dfa80d5d6252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:22.955789 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8cd04-2a4b-4c0a-9cc3-dfa80d5d6252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:22.956075 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8cd04-2a4b-4c0a-9cc3-dfa80d5d6252 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:22.956353 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8cd04-2a4b-4c0a-9cc3-dfa80d5d6252 admin admin] PATH_INFO: `/v3/users/dfcdeb7475ac4346beff0b2b83215a46` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:22.957616 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a8cd04-2a4b-4c0a-9cc3-dfa80d5d6252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfcdeb7475ac4346beff0b2b83215a46)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:22.959539 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a8cd04-2a4b-4c0a-9cc3-dfa80d5d6252 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:23.207975 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b4a8cd04-2a4b-4c0a-9cc3-dfa80d5d6252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfcdeb7475ac4346beff0b2b83215a46'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:23.208690 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b4a8cd04-2a4b-4c0a-9cc3-dfa80d5d6252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfcdeb7475ac4346beff0b2b83215a46'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:23.209301 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b4a8cd04-2a4b-4c0a-9cc3-dfa80d5d6252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfcdeb7475ac4346beff0b2b83215a46'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:23.217405 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b4a8cd04-2a4b-4c0a-9cc3-dfa80d5d6252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfcdeb7475ac4346beff0b2b83215a46'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:23.304497 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b4a8cd04-2a4b-4c0a-9cc3-dfa80d5d6252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfcdeb7475ac4346beff0b2b83215a46'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:23.322329 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1269/2534] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:18:22 2021] DELETE /identity/v3/users/dfcdeb7475ac4346beff0b2b83215a46 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:23.763371 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802add5-4d84-4dc4-808f-227329ef1e1f admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:23.768072 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-1802add5-4d84-4dc4-808f-227329ef1e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:23.790288 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802add5-4d84-4dc4-808f-227329ef1e1f admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:23.848146 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b48f5e-a01c-4231-b95f-41f118029105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:23.849095 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b48f5e-a01c-4231-b95f-41f118029105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:23.849526 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b48f5e-a01c-4231-b95f-41f118029105 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:23.849787 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b48f5e-a01c-4231-b95f-41f118029105 admin admin] PATH_INFO: `/v3/projects/71ab2f4fd8294ee3af6cbc498c82bb64` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:23.851086 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b48f5e-a01c-4231-b95f-41f118029105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71ab2f4fd8294ee3af6cbc498c82bb64)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:23.853054 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b48f5e-a01c-4231-b95f-41f118029105 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:23.993203 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-82b48f5e-a01c-4231-b95f-41f118029105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71ab2f4fd8294ee3af6cbc498c82bb64', 'request_id': 'req-82b48f5e-a01c-4231-b95f-41f118029105'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:24.064981 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-82b48f5e-a01c-4231-b95f-41f118029105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71ab2f4fd8294ee3af6cbc498c82bb64', 'request_id': 'req-82b48f5e-a01c-4231-b95f-41f118029105'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:24.072400 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-82b48f5e-a01c-4231-b95f-41f118029105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71ab2f4fd8294ee3af6cbc498c82bb64', 'request_id': 'req-82b48f5e-a01c-4231-b95f-41f118029105'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:24.083600 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-82b48f5e-a01c-4231-b95f-41f118029105 admin admin] The token cache is being invalidate because project 71ab2f4fd8294ee3af6cbc498c82bb64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:18:24.083885 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-82b48f5e-a01c-4231-b95f-41f118029105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:24.084552 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-82b48f5e-a01c-4231-b95f-41f118029105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:24.086093 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1266/2535] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:18:23 2021] DELETE /identity/v3/projects/71ab2f4fd8294ee3af6cbc498c82bb64 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:24.090146 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8cd04-2a4b-4c0a-9cc3-dfa80d5d6252 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:24.091670 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-b4a8cd04-2a4b-4c0a-9cc3-dfa80d5d6252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:24.104480 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8cd04-2a4b-4c0a-9cc3-dfa80d5d6252 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:24.160877 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b5910-a590-422f-9ac2-42199aad599e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:24.161780 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b5910-a590-422f-9ac2-42199aad599e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:24.162063 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b5910-a590-422f-9ac2-42199aad599e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:24.162340 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b5910-a590-422f-9ac2-42199aad599e admin admin] PATH_INFO: `/v3/users/610373bc039043a08e326230624cd951` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:24.163524 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b5910-a590-422f-9ac2-42199aad599e admin admin] RBAC: Authorizing `identity:delete_user(user_id=610373bc039043a08e326230624cd951)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:24.165489 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b5910-a590-422f-9ac2-42199aad599e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:24.691267 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-054b5910-a590-422f-9ac2-42199aad599e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '610373bc039043a08e326230624cd951'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:24.691958 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-054b5910-a590-422f-9ac2-42199aad599e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '610373bc039043a08e326230624cd951'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:24.692596 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-054b5910-a590-422f-9ac2-42199aad599e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '610373bc039043a08e326230624cd951'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:24.700144 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-054b5910-a590-422f-9ac2-42199aad599e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '610373bc039043a08e326230624cd951'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:24.813419 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-054b5910-a590-422f-9ac2-42199aad599e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '610373bc039043a08e326230624cd951'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:24.831538 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1270/2536] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:18:24 2021] DELETE /identity/v3/users/610373bc039043a08e326230624cd951 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:18:25.282562 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b48f5e-a01c-4231-b95f-41f118029105 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:25.284023 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-82b48f5e-a01c-4231-b95f-41f118029105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:25.302012 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b48f5e-a01c-4231-b95f-41f118029105 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:25.377370 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b427f0b-bc31-4e01-a162-4a3855ce9fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:25.378248 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b427f0b-bc31-4e01-a162-4a3855ce9fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:25.378535 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b427f0b-bc31-4e01-a162-4a3855ce9fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:25.378817 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b427f0b-bc31-4e01-a162-4a3855ce9fbd admin admin] PATH_INFO: `/v3/projects/e1459664598c4de1ab9e0cf8886a8285` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:25.380016 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b427f0b-bc31-4e01-a162-4a3855ce9fbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1459664598c4de1ab9e0cf8886a8285)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:25.381954 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b427f0b-bc31-4e01-a162-4a3855ce9fbd admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:25.494513 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-6b427f0b-bc31-4e01-a162-4a3855ce9fbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1459664598c4de1ab9e0cf8886a8285', 'request_id': 'req-6b427f0b-bc31-4e01-a162-4a3855ce9fbd'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:25.578254 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-6b427f0b-bc31-4e01-a162-4a3855ce9fbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1459664598c4de1ab9e0cf8886a8285', 'request_id': 'req-6b427f0b-bc31-4e01-a162-4a3855ce9fbd'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:25.584103 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-6b427f0b-bc31-4e01-a162-4a3855ce9fbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1459664598c4de1ab9e0cf8886a8285', 'request_id': 'req-6b427f0b-bc31-4e01-a162-4a3855ce9fbd'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:25.595535 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-6b427f0b-bc31-4e01-a162-4a3855ce9fbd admin admin] The token cache is being invalidate because project e1459664598c4de1ab9e0cf8886a8285 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:18:25.595825 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-6b427f0b-bc31-4e01-a162-4a3855ce9fbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:25.596535 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-6b427f0b-bc31-4e01-a162-4a3855ce9fbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:25.598161 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1267/2537] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:18:25 2021] DELETE /identity/v3/projects/e1459664598c4de1ab9e0cf8886a8285 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:25.611254 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ca74c-fdbc-4bb1-9124-28fd22bd9f5c None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:25.611806 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ca74c-fdbc-4bb1-9124-28fd22bd9f5c None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:25.611908 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ca74c-fdbc-4bb1-9124-28fd22bd9f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:25.630594 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-2d3ca74c-fdbc-4bb1-9124-28fd22bd9f5c None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:25.631810 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-2d3ca74c-fdbc-4bb1-9124-28fd22bd9f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:25.690554 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1271/2538] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:18:25.699157 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a5927-26e6-4d6a-b14e-ba75781ddfcb None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:25.699452 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a5927-26e6-4d6a-b14e-ba75781ddfcb None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:25.699734 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a5927-26e6-4d6a-b14e-ba75781ddfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:25.718960 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-5d5a5927-26e6-4d6a-b14e-ba75781ddfcb None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:25.720213 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-5d5a5927-26e6-4d6a-b14e-ba75781ddfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:25.728398 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1268/2539] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:18:25.733083 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ca74c-fdbc-4bb1-9124-28fd22bd9f5c None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:25.743793 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ca74c-fdbc-4bb1-9124-28fd22bd9f5c None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:25.748438 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921b0ab-4f0b-497b-9c8d-145a88bc97b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:25.749126 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921b0ab-4f0b-497b-9c8d-145a88bc97b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:25.749406 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921b0ab-4f0b-497b-9c8d-145a88bc97b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:25.749678 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921b0ab-4f0b-497b-9c8d-145a88bc97b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:25.750400 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921b0ab-4f0b-497b-9c8d-145a88bc97b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:18:25.750694 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921b0ab-4f0b-497b-9c8d-145a88bc97b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:25.752295 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921b0ab-4f0b-497b-9c8d-145a88bc97b1 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:25.763576 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1272/2540] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:18:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:18:25.768796 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a5927-26e6-4d6a-b14e-ba75781ddfcb None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:25.777852 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a5927-26e6-4d6a-b14e-ba75781ddfcb None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:25.783122 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4d8f7-4e62-4b7a-acf5-4f2d35c83961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:25.783778 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4d8f7-4e62-4b7a-acf5-4f2d35c83961 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:25.784060 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4d8f7-4e62-4b7a-acf5-4f2d35c83961 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:25.784335 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4d8f7-4e62-4b7a-acf5-4f2d35c83961 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:25.785071 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4d8f7-4e62-4b7a-acf5-4f2d35c83961 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:25.786975 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4d8f7-4e62-4b7a-acf5-4f2d35c83961 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:25.876897 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1269/2541] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:18:25 2021] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:18:25.881251 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921b0ab-4f0b-497b-9c8d-145a88bc97b1 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:25.891559 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921b0ab-4f0b-497b-9c8d-145a88bc97b1 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:25.947680 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746225e5-3bf8-43d9-909d-c4f3707ad2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:25.948360 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746225e5-3bf8-43d9-909d-c4f3707ad2f8 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:25.948707 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746225e5-3bf8-43d9-909d-c4f3707ad2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:25.948973 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746225e5-3bf8-43d9-909d-c4f3707ad2f8 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:25.949670 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746225e5-3bf8-43d9-909d-c4f3707ad2f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:25.951579 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746225e5-3bf8-43d9-909d-c4f3707ad2f8 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:26.014258 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1273/2542] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:18:25 2021] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:18:26.017332 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4d8f7-4e62-4b7a-acf5-4f2d35c83961 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:26.027544 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4d8f7-4e62-4b7a-acf5-4f2d35c83961 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:26.032129 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a303bdd-aeb3-461c-b88c-81928383e2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:26.032862 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a303bdd-aeb3-461c-b88c-81928383e2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:26.033143 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a303bdd-aeb3-461c-b88c-81928383e2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:26.033420 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a303bdd-aeb3-461c-b88c-81928383e2c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:26.034147 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a303bdd-aeb3-461c-b88c-81928383e2c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:26.035730 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a303bdd-aeb3-461c-b88c-81928383e2c5 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:26.047345 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1270/2543] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:18:26 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:18:26.052358 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746225e5-3bf8-43d9-909d-c4f3707ad2f8 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:26.064046 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746225e5-3bf8-43d9-909d-c4f3707ad2f8 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:26.069050 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6a36f-49d3-42e7-8e8e-e60d1b7421af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:26.069722 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6a36f-49d3-42e7-8e8e-e60d1b7421af admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:26.070005 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6a36f-49d3-42e7-8e8e-e60d1b7421af admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:26.070284 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6a36f-49d3-42e7-8e8e-e60d1b7421af admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:26.071019 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6a36f-49d3-42e7-8e8e-e60d1b7421af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:26.072725 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6a36f-49d3-42e7-8e8e-e60d1b7421af admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:26.083143 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1274/2544] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:18:26 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:18:26.087259 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a303bdd-aeb3-461c-b88c-81928383e2c5 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:26.097642 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a303bdd-aeb3-461c-b88c-81928383e2c5 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:26.102275 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1ac1b-ce3d-41fe-9629-7e8b2a9456e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:26.103173 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1ac1b-ce3d-41fe-9629-7e8b2a9456e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:26.103446 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1ac1b-ce3d-41fe-9629-7e8b2a9456e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:26.103722 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1ac1b-ce3d-41fe-9629-7e8b2a9456e2 admin admin] PATH_INFO: `/v3/projects/7a08751de05f4888ab7cc78f74b0f2e2/users/8e8305da5eff4cb19d658ea7106f594f/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:26.119278 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1ac1b-ce3d-41fe-9629-7e8b2a9456e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a08751de05f4888ab7cc78f74b0f2e2, user_id=8e8305da5eff4cb19d658ea7106f594f, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:26.121952 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1ac1b-ce3d-41fe-9629-7e8b2a9456e2 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:26.207635 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1271/2545] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:18:26 2021] PUT /identity/v3/projects/7a08751de05f4888ab7cc78f74b0f2e2/users/8e8305da5eff4cb19d658ea7106f594f/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:26.219450 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c2ecb-b6fe-4c4b-b60c-337ea395c077 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:26.219743 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c2ecb-b6fe-4c4b-b60c-337ea395c077 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:26.220026 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c2ecb-b6fe-4c4b-b60c-337ea395c077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:26.245920 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-c31c2ecb-b6fe-4c4b-b60c-337ea395c077 None None] MFA Rules not processed for user `8e8305da5eff4cb19d658ea7106f594f`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:26.247118 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-c31c2ecb-b6fe-4c4b-b60c-337ea395c077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:26.312937 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1275/2546] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:26 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:18:26.324398 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1ac1b-ce3d-41fe-9629-7e8b2a9456e2 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:26.326125 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-01d1ac1b-ce3d-41fe-9629-7e8b2a9456e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:26.383385 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1ac1b-ce3d-41fe-9629-7e8b2a9456e2 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:26.387054 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec6d79-ad39-499f-8b0b-767b18dc63c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83242c1ef12d4a5b800e67346f4ad963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:26.387711 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec6d79-ad39-499f-8b0b-767b18dc63c8 service glance] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:26.387991 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec6d79-ad39-499f-8b0b-767b18dc63c8 service glance] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:26.388265 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec6d79-ad39-499f-8b0b-767b18dc63c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:26.397462 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec6d79-ad39-499f-8b0b-767b18dc63c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:26.398892 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec6d79-ad39-499f-8b0b-767b18dc63c8 service glance] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:26.407640 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1272/2547] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:18:26 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:18:58.669313 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c2ecb-b6fe-4c4b-b60c-337ea395c077 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:58.729593 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c2ecb-b6fe-4c4b-b60c-337ea395c077 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:58.734923 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703b72e-f44b-494a-975a-79ab80e84aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:58.735782 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703b72e-f44b-494a-975a-79ab80e84aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:58.736064 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703b72e-f44b-494a-975a-79ab80e84aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:58.736339 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703b72e-f44b-494a-975a-79ab80e84aa5 admin admin] PATH_INFO: `/v3/users/8e8305da5eff4cb19d658ea7106f594f` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:58.737546 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703b72e-f44b-494a-975a-79ab80e84aa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e8305da5eff4cb19d658ea7106f594f)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:58.739448 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703b72e-f44b-494a-975a-79ab80e84aa5 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:58.910058 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-c703b72e-f44b-494a-975a-79ab80e84aa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e8305da5eff4cb19d658ea7106f594f'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:58.910642 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-c703b72e-f44b-494a-975a-79ab80e84aa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e8305da5eff4cb19d658ea7106f594f'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:58.911246 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-c703b72e-f44b-494a-975a-79ab80e84aa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e8305da5eff4cb19d658ea7106f594f'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:58.918031 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-c703b72e-f44b-494a-975a-79ab80e84aa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e8305da5eff4cb19d658ea7106f594f'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:59.000401 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-c703b72e-f44b-494a-975a-79ab80e84aa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e8305da5eff4cb19d658ea7106f594f'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:59.018657 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1276/2548] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:18:58 2021] DELETE /identity/v3/users/8e8305da5eff4cb19d658ea7106f594f => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:59.023842 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75969aed-7296-4d3c-87b1-8a750fc4389a None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:59.024324 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75969aed-7296-4d3c-87b1-8a750fc4389a None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:59.024427 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75969aed-7296-4d3c-87b1-8a750fc4389a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:59.041763 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-75969aed-7296-4d3c-87b1-8a750fc4389a None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:59.042946 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-75969aed-7296-4d3c-87b1-8a750fc4389a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:59.098515 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1273/2549] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:18:59.108448 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703b72e-f44b-494a-975a-79ab80e84aa5 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:59.109884 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-c703b72e-f44b-494a-975a-79ab80e84aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:59.163916 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703b72e-f44b-494a-975a-79ab80e84aa5 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:59.167488 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a6377-52b1-4ef0-bffc-b78432ed4f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:59.168128 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a6377-52b1-4ef0-bffc-b78432ed4f28 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:59.168411 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a6377-52b1-4ef0-bffc-b78432ed4f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:59.168714 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a6377-52b1-4ef0-bffc-b78432ed4f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:59.177424 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a6377-52b1-4ef0-bffc-b78432ed4f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:59.178842 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a6377-52b1-4ef0-bffc-b78432ed4f28 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:59.188511 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1277/2550] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:18:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:18:59.614859 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75969aed-7296-4d3c-87b1-8a750fc4389a None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:59.616294 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-75969aed-7296-4d3c-87b1-8a750fc4389a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:59.629333 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75969aed-7296-4d3c-87b1-8a750fc4389a None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:59.635852 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750e34e-a6a2-42f2-b2ac-ed9635754cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:59.636071 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750e34e-a6a2-42f2-b2ac-ed9635754cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:59.636310 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750e34e-a6a2-42f2-b2ac-ed9635754cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:59.636614 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750e34e-a6a2-42f2-b2ac-ed9635754cb6 admin admin] PATH_INFO: `/v3/projects/7a08751de05f4888ab7cc78f74b0f2e2` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:59.637826 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750e34e-a6a2-42f2-b2ac-ed9635754cb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a08751de05f4888ab7cc78f74b0f2e2)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:59.639878 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750e34e-a6a2-42f2-b2ac-ed9635754cb6 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:59.749218 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d750e34e-a6a2-42f2-b2ac-ed9635754cb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a08751de05f4888ab7cc78f74b0f2e2', 'request_id': 'req-d750e34e-a6a2-42f2-b2ac-ed9635754cb6'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:59.823680 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d750e34e-a6a2-42f2-b2ac-ed9635754cb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a08751de05f4888ab7cc78f74b0f2e2', 'request_id': 'req-d750e34e-a6a2-42f2-b2ac-ed9635754cb6'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:59.829657 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d750e34e-a6a2-42f2-b2ac-ed9635754cb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a08751de05f4888ab7cc78f74b0f2e2', 'request_id': 'req-d750e34e-a6a2-42f2-b2ac-ed9635754cb6'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:59.840443 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d750e34e-a6a2-42f2-b2ac-ed9635754cb6 admin admin] The token cache is being invalidate because project 7a08751de05f4888ab7cc78f74b0f2e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:18:59.840758 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d750e34e-a6a2-42f2-b2ac-ed9635754cb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:59.841373 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d750e34e-a6a2-42f2-b2ac-ed9635754cb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:18:59.843401 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1274/2551] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:18:59 2021] DELETE /identity/v3/projects/7a08751de05f4888ab7cc78f74b0f2e2 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:18:59.849293 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056dad1-ddef-43fb-83d0-eb783b13bfe5 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:59.849814 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056dad1-ddef-43fb-83d0-eb783b13bfe5 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:59.849922 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056dad1-ddef-43fb-83d0-eb783b13bfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:59.869213 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-7056dad1-ddef-43fb-83d0-eb783b13bfe5 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:59.870401 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-7056dad1-ddef-43fb-83d0-eb783b13bfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:59.927163 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1278/2552] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:18:59.935161 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553f04f-14c5-401a-99cf-60c953b89d9a None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:59.935453 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553f04f-14c5-401a-99cf-60c953b89d9a None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:59.935735 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553f04f-14c5-401a-99cf-60c953b89d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:59.954037 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-2553f04f-14c5-401a-99cf-60c953b89d9a None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:18:59.955251 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-2553f04f-14c5-401a-99cf-60c953b89d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:18:59.963639 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1275/2553] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:18:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:18:59.968326 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056dad1-ddef-43fb-83d0-eb783b13bfe5 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:18:59.977960 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056dad1-ddef-43fb-83d0-eb783b13bfe5 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:18:59.983383 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1be207-5b59-41a6-a180-b7c276b02dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:18:59.984044 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1be207-5b59-41a6-a180-b7c276b02dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:18:59.984327 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1be207-5b59-41a6-a180-b7c276b02dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:18:59.984665 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1be207-5b59-41a6-a180-b7c276b02dc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:18:59.985371 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1be207-5b59-41a6-a180-b7c276b02dc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:18:59.985681 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1be207-5b59-41a6-a180-b7c276b02dc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:18:59.987272 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1be207-5b59-41a6-a180-b7c276b02dc0 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:18:59.999277 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1279/2554] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:18:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:19:00.003535 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553f04f-14c5-401a-99cf-60c953b89d9a None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:19:00.012727 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553f04f-14c5-401a-99cf-60c953b89d9a None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:19:00.017960 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c406a2c-de46-4be8-9cc6-0e7a981fd106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:19:00.018639 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c406a2c-de46-4be8-9cc6-0e7a981fd106 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:19:00.018926 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c406a2c-de46-4be8-9cc6-0e7a981fd106 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:19:00.019208 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c406a2c-de46-4be8-9cc6-0e7a981fd106 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:19:00.019895 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c406a2c-de46-4be8-9cc6-0e7a981fd106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:19:00.021835 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c406a2c-de46-4be8-9cc6-0e7a981fd106 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:19:00.104525 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1276/2555] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:19:00 2021] POST /identity/v3/projects => generated 369 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:19:00.109620 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1be207-5b59-41a6-a180-b7c276b02dc0 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:19:00.119694 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1be207-5b59-41a6-a180-b7c276b02dc0 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:19:00.176042 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fe7ea-1a4b-4717-a009-d7fcb94abb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:19:00.176741 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fe7ea-1a4b-4717-a009-d7fcb94abb39 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:19:00.177020 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fe7ea-1a4b-4717-a009-d7fcb94abb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:19:00.177294 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fe7ea-1a4b-4717-a009-d7fcb94abb39 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:19:00.177969 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5fe7ea-1a4b-4717-a009-d7fcb94abb39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:19:00.179870 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5fe7ea-1a4b-4717-a009-d7fcb94abb39 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:19:00.240810 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1280/2556] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:19:00 2021] POST /identity/v3/users => generated 285 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:19:00.244995 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c406a2c-de46-4be8-9cc6-0e7a981fd106 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:19:00.256183 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c406a2c-de46-4be8-9cc6-0e7a981fd106 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:19:00.264781 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed6d29-5dfc-4fe1-9918-b9434905df9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:19:00.265472 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed6d29-5dfc-4fe1-9918-b9434905df9e admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:19:00.265767 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed6d29-5dfc-4fe1-9918-b9434905df9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:19:00.266073 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed6d29-5dfc-4fe1-9918-b9434905df9e admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:19:00.266802 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed6d29-5dfc-4fe1-9918-b9434905df9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:19:00.268407 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed6d29-5dfc-4fe1-9918-b9434905df9e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:19:00.279245 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1277/2557] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:19:00 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:19:00.283845 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fe7ea-1a4b-4717-a009-d7fcb94abb39 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:19:00.293886 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fe7ea-1a4b-4717-a009-d7fcb94abb39 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:19:00.298563 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354c0a5-2c92-4d54-9d4c-2ea1cb2573ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:19:00.299232 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354c0a5-2c92-4d54-9d4c-2ea1cb2573ed admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:19:00.299518 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354c0a5-2c92-4d54-9d4c-2ea1cb2573ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:19:00.299827 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354c0a5-2c92-4d54-9d4c-2ea1cb2573ed admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:19:00.300613 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354c0a5-2c92-4d54-9d4c-2ea1cb2573ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:19:00.302191 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354c0a5-2c92-4d54-9d4c-2ea1cb2573ed admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:19:00.312314 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1281/2558] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:19:00 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:19:00.316555 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed6d29-5dfc-4fe1-9918-b9434905df9e admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:19:00.326944 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed6d29-5dfc-4fe1-9918-b9434905df9e admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:19:00.331910 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c7ead-e718-4178-bec5-9d4c846ca596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:19:00.332837 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c7ead-e718-4178-bec5-9d4c846ca596 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:19:00.333148 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c7ead-e718-4178-bec5-9d4c846ca596 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:19:00.333428 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c7ead-e718-4178-bec5-9d4c846ca596 admin admin] PATH_INFO: `/v3/projects/bf813a4e2b1c42b7a2b9941d837e72da/users/a5925228bbe04dbe9e8c4118f80145c6/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:19:00.348509 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c7ead-e718-4178-bec5-9d4c846ca596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf813a4e2b1c42b7a2b9941d837e72da, user_id=a5925228bbe04dbe9e8c4118f80145c6, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:19:00.357294 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c7ead-e718-4178-bec5-9d4c846ca596 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:19:00.429225 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1278/2559] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:19:00 2021] PUT /identity/v3/projects/bf813a4e2b1c42b7a2b9941d837e72da/users/a5925228bbe04dbe9e8c4118f80145c6/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:19:00.440106 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf0fac-7d51-4e9a-b78f-6a9612b100e7 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:19:00.440401 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf0fac-7d51-4e9a-b78f-6a9612b100e7 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:19:00.440726 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf0fac-7d51-4e9a-b78f-6a9612b100e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:19:00.467852 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-1adf0fac-7d51-4e9a-b78f-6a9612b100e7 None None] MFA Rules not processed for user `a5925228bbe04dbe9e8c4118f80145c6`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:19:00.469444 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-1adf0fac-7d51-4e9a-b78f-6a9612b100e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:19:00.532339 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1282/2560] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:19:00 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:19:00.548685 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c7ead-e718-4178-bec5-9d4c846ca596 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:19:00.548685 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-9c4c7ead-e718-4178-bec5-9d4c846ca596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:19:00.611814 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c7ead-e718-4178-bec5-9d4c846ca596 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:19:00.615627 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdec83c-fe12-49e5-873a-c135b31a3713 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83242c1ef12d4a5b800e67346f4ad963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:19:00.619853 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdec83c-fe12-49e5-873a-c135b31a3713 service glance] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:19:00.620152 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdec83c-fe12-49e5-873a-c135b31a3713 service glance] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:19:00.620442 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdec83c-fe12-49e5-873a-c135b31a3713 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:19:00.632499 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdec83c-fe12-49e5-873a-c135b31a3713 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:19:00.634187 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdec83c-fe12-49e5-873a-c135b31a3713 service glance] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:19:00.646054 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1279/2561] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:19:00 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:19:31.253634 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf0fac-7d51-4e9a-b78f-6a9612b100e7 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:19:31.255133 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-1adf0fac-7d51-4e9a-b78f-6a9612b100e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:19:31.332980 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf0fac-7d51-4e9a-b78f-6a9612b100e7 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:19:31.338471 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd4f51-c3bf-4610-924a-77da9ba6a287 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:19:31.339126 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd4f51-c3bf-4610-924a-77da9ba6a287 service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:19:31.339407 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd4f51-c3bf-4610-924a-77da9ba6a287 service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:19:31.339689 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd4f51-c3bf-4610-924a-77da9ba6a287 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:19:31.342032 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-31cd4f51-c3bf-4610-924a-77da9ba6a287 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:19:31.353853 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd4f51-c3bf-4610-924a-77da9ba6a287 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:19:31.355424 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd4f51-c3bf-4610-924a-77da9ba6a287 service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:19:31.365990 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1283/2562] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:19:31 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:19:50.376510 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06029cda-9050-47ee-960f-a3065541c92c None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:19:50.377014 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06029cda-9050-47ee-960f-a3065541c92c None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:19:50.377116 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06029cda-9050-47ee-960f-a3065541c92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:19:50.394409 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-06029cda-9050-47ee-960f-a3065541c92c None None] MFA Rules not processed for user `db531f61fb2a405baec24793c54c9538`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:19:50.395588 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-06029cda-9050-47ee-960f-a3065541c92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:19:50.447092 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1280/2563] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:19:50 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:20:05.033048 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd4f51-c3bf-4610-924a-77da9ba6a287 service nova] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:20:05.094897 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd4f51-c3bf-4610-924a-77da9ba6a287 service nova] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:20:05.099553 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903439c-6e33-4a31-a263-666117b5808e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:20:05.100432 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903439c-6e33-4a31-a263-666117b5808e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:20:05.100746 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903439c-6e33-4a31-a263-666117b5808e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:20:05.101055 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903439c-6e33-4a31-a263-666117b5808e admin admin] PATH_INFO: `/v3/users/a5925228bbe04dbe9e8c4118f80145c6` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:20:05.102250 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903439c-6e33-4a31-a263-666117b5808e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5925228bbe04dbe9e8c4118f80145c6)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:20:05.104168 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903439c-6e33-4a31-a263-666117b5808e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:20:05.247467 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b903439c-6e33-4a31-a263-666117b5808e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5925228bbe04dbe9e8c4118f80145c6'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:20:05.248033 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b903439c-6e33-4a31-a263-666117b5808e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5925228bbe04dbe9e8c4118f80145c6'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:20:05.248665 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b903439c-6e33-4a31-a263-666117b5808e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5925228bbe04dbe9e8c4118f80145c6'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:20:05.255264 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b903439c-6e33-4a31-a263-666117b5808e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5925228bbe04dbe9e8c4118f80145c6'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:20:05.308855 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-b903439c-6e33-4a31-a263-666117b5808e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5925228bbe04dbe9e8c4118f80145c6'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:20:05.325752 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1284/2564] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:20:05 2021] DELETE /identity/v3/users/a5925228bbe04dbe9e8c4118f80145c6 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:20:05.330251 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97811e-66f7-48fb-8868-f517a0a38583 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:20:05.330738 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97811e-66f7-48fb-8868-f517a0a38583 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:20:05.330855 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97811e-66f7-48fb-8868-f517a0a38583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:20:05.348957 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-7e97811e-66f7-48fb-8868-f517a0a38583 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:20:05.350142 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-7e97811e-66f7-48fb-8868-f517a0a38583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:20:05.404496 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1281/2565] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:20:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:20:05.414374 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903439c-6e33-4a31-a263-666117b5808e admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:20:05.415798 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-b903439c-6e33-4a31-a263-666117b5808e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:20:05.470384 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903439c-6e33-4a31-a263-666117b5808e admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:20:05.474031 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f90c4-a16b-4e6b-85bf-103b39cc939c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:20:05.474677 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f90c4-a16b-4e6b-85bf-103b39cc939c service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:20:05.474953 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f90c4-a16b-4e6b-85bf-103b39cc939c service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:20:05.475226 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f90c4-a16b-4e6b-85bf-103b39cc939c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:20:05.484931 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f90c4-a16b-4e6b-85bf-103b39cc939c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:20:05.486355 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f90c4-a16b-4e6b-85bf-103b39cc939c service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:20:05.495580 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1285/2566] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:20:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:20:05.870907 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97811e-66f7-48fb-8868-f517a0a38583 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:20:05.873820 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-7e97811e-66f7-48fb-8868-f517a0a38583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:20:05.896063 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97811e-66f7-48fb-8868-f517a0a38583 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:20:05.904258 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25620f7-2da3-4359-a102-82e55d75b213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:20:05.905162 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25620f7-2da3-4359-a102-82e55d75b213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:20:05.905445 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25620f7-2da3-4359-a102-82e55d75b213 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:20:05.906551 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25620f7-2da3-4359-a102-82e55d75b213 admin admin] PATH_INFO: `/v3/projects/bf813a4e2b1c42b7a2b9941d837e72da` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:20:05.908135 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25620f7-2da3-4359-a102-82e55d75b213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf813a4e2b1c42b7a2b9941d837e72da)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:20:05.910178 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25620f7-2da3-4359-a102-82e55d75b213 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:20:05.994765 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d25620f7-2da3-4359-a102-82e55d75b213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf813a4e2b1c42b7a2b9941d837e72da', 'request_id': 'req-d25620f7-2da3-4359-a102-82e55d75b213'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:20:06.063199 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d25620f7-2da3-4359-a102-82e55d75b213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf813a4e2b1c42b7a2b9941d837e72da', 'request_id': 'req-d25620f7-2da3-4359-a102-82e55d75b213'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:20:06.075569 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d25620f7-2da3-4359-a102-82e55d75b213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf813a4e2b1c42b7a2b9941d837e72da', 'request_id': 'req-d25620f7-2da3-4359-a102-82e55d75b213'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:20:06.086841 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d25620f7-2da3-4359-a102-82e55d75b213 admin admin] The token cache is being invalidate because project bf813a4e2b1c42b7a2b9941d837e72da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:20:06.087125 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d25620f7-2da3-4359-a102-82e55d75b213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:20:06.087767 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-d25620f7-2da3-4359-a102-82e55d75b213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:20:06.089326 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1282/2567] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:20:05 2021] DELETE /identity/v3/projects/bf813a4e2b1c42b7a2b9941d837e72da => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:20:06.097687 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce47821-c527-4cad-b9dd-995fa78fd064 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:20:06.098167 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce47821-c527-4cad-b9dd-995fa78fd064 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:20:06.098272 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce47821-c527-4cad-b9dd-995fa78fd064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:20:06.117194 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-cce47821-c527-4cad-b9dd-995fa78fd064 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:20:06.118381 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-cce47821-c527-4cad-b9dd-995fa78fd064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:20:06.174254 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1286/2568] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:20:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:20:06.182129 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243d920-2697-44dc-9262-fea85cb6d2f0 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:20:06.182443 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243d920-2697-44dc-9262-fea85cb6d2f0 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:20:06.182719 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243d920-2697-44dc-9262-fea85cb6d2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:20:06.201666 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-2243d920-2697-44dc-9262-fea85cb6d2f0 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:20:06.202849 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-2243d920-2697-44dc-9262-fea85cb6d2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:20:06.210595 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1283/2569] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:20:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:20:06.214822 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce47821-c527-4cad-b9dd-995fa78fd064 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:20:06.224448 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce47821-c527-4cad-b9dd-995fa78fd064 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:20:06.229035 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05521c24-812f-4530-bd9e-d7b1640e39bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:20:06.229693 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05521c24-812f-4530-bd9e-d7b1640e39bc admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:20:06.229982 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05521c24-812f-4530-bd9e-d7b1640e39bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:20:06.230256 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05521c24-812f-4530-bd9e-d7b1640e39bc admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:20:06.231752 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05521c24-812f-4530-bd9e-d7b1640e39bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:20:06.232060 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05521c24-812f-4530-bd9e-d7b1640e39bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:20:06.233665 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05521c24-812f-4530-bd9e-d7b1640e39bc admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:20:06.244989 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1287/2570] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:20:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:20:06.249791 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243d920-2697-44dc-9262-fea85cb6d2f0 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:20:06.258724 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243d920-2697-44dc-9262-fea85cb6d2f0 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:20:06.263318 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6902a76-afaf-4141-954d-c0a2e84c7980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:20:06.263967 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6902a76-afaf-4141-954d-c0a2e84c7980 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:20:06.264246 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6902a76-afaf-4141-954d-c0a2e84c7980 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:20:06.264558 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6902a76-afaf-4141-954d-c0a2e84c7980 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:20:06.265239 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6902a76-afaf-4141-954d-c0a2e84c7980 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:20:06.267114 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6902a76-afaf-4141-954d-c0a2e84c7980 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:20:06.369976 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1284/2571] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:20:06 2021] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:20:06.371245 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05521c24-812f-4530-bd9e-d7b1640e39bc admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:20:06.381681 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05521c24-812f-4530-bd9e-d7b1640e39bc admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:20:06.434769 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58105bbe-db08-45ee-8219-8aa0a884c0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:20:06.435430 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58105bbe-db08-45ee-8219-8aa0a884c0a4 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:20:06.435725 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58105bbe-db08-45ee-8219-8aa0a884c0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:20:06.435985 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58105bbe-db08-45ee-8219-8aa0a884c0a4 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:20:06.436705 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58105bbe-db08-45ee-8219-8aa0a884c0a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:20:06.438626 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58105bbe-db08-45ee-8219-8aa0a884c0a4 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:20:06.540669 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1288/2572] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:20:06 2021] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:20:06.541944 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6902a76-afaf-4141-954d-c0a2e84c7980 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:20:06.552918 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6902a76-afaf-4141-954d-c0a2e84c7980 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:20:06.558491 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43ee68-1f75-4d0c-a628-95dfe583b35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:20:06.559880 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43ee68-1f75-4d0c-a628-95dfe583b35d admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:20:06.560278 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43ee68-1f75-4d0c-a628-95dfe583b35d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:20:06.560680 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43ee68-1f75-4d0c-a628-95dfe583b35d admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:20:06.561592 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43ee68-1f75-4d0c-a628-95dfe583b35d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:20:06.563377 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43ee68-1f75-4d0c-a628-95dfe583b35d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:20:06.571819 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58105bbe-db08-45ee-8219-8aa0a884c0a4 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:20:06.573693 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-58105bbe-db08-45ee-8219-8aa0a884c0a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:20:06.579166 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1285/2573] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:20:06 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:20:06.580880 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43ee68-1f75-4d0c-a628-95dfe583b35d admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:20:06.591967 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43ee68-1f75-4d0c-a628-95dfe583b35d admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:20:06.597265 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2c3b7-b833-4205-bbe4-581b5425536a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:20:06.597943 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2c3b7-b833-4205-bbe4-581b5425536a admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:20:06.598223 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2c3b7-b833-4205-bbe4-581b5425536a admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:20:06.598498 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2c3b7-b833-4205-bbe4-581b5425536a admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:20:06.599400 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2c3b7-b833-4205-bbe4-581b5425536a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:20:06.600990 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2c3b7-b833-4205-bbe4-581b5425536a admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:20:06.612515 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1286/2574] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:20:06 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:20:06.616592 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2c3b7-b833-4205-bbe4-581b5425536a admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:20:06.627588 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2c3b7-b833-4205-bbe4-581b5425536a admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:20:06.632874 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a2d35-a390-4642-8453-fff868228b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:20:06.633772 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a2d35-a390-4642-8453-fff868228b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:20:06.634208 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a2d35-a390-4642-8453-fff868228b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:20:06.634497 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a2d35-a390-4642-8453-fff868228b76 admin admin] PATH_INFO: `/v3/projects/e1ade6b0f3e94e54acedf7f18385ee63/users/2b42de90db8a4c078cf81246ccbf4686/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:20:06.654056 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a2d35-a390-4642-8453-fff868228b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ade6b0f3e94e54acedf7f18385ee63, user_id=2b42de90db8a4c078cf81246ccbf4686, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:20:06.656855 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a2d35-a390-4642-8453-fff868228b76 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:20:06.660338 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58105bbe-db08-45ee-8219-8aa0a884c0a4 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:20:06.670296 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71743a39-b772-46fe-85c8-c61d92d48fc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:20:06.671245 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71743a39-b772-46fe-85c8-c61d92d48fc8 service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:20:06.671403 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71743a39-b772-46fe-85c8-c61d92d48fc8 service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:20:06.671648 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71743a39-b772-46fe-85c8-c61d92d48fc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:20:06.676417 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-71743a39-b772-46fe-85c8-c61d92d48fc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:20:06.690578 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71743a39-b772-46fe-85c8-c61d92d48fc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:20:06.692269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71743a39-b772-46fe-85c8-c61d92d48fc8 service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:20:06.709371 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1289/2575] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:20:06 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:20:06.721885 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1287/2576] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:20:06 2021] PUT /identity/v3/projects/e1ade6b0f3e94e54acedf7f18385ee63/users/2b42de90db8a4c078cf81246ccbf4686/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:20:06.733750 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89080973-c6f5-4381-9878-c13c3c49eb5c None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:20:06.734038 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89080973-c6f5-4381-9878-c13c3c49eb5c None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:20:06.734316 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89080973-c6f5-4381-9878-c13c3c49eb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:20:06.762078 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-89080973-c6f5-4381-9878-c13c3c49eb5c None None] MFA Rules not processed for user `2b42de90db8a4c078cf81246ccbf4686`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:20:06.763287 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-89080973-c6f5-4381-9878-c13c3c49eb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:20:06.848647 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1290/2577] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:20:06 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:20:06.860908 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a2d35-a390-4642-8453-fff868228b76 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:20:06.862607 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-065a2d35-a390-4642-8453-fff868228b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:20:06.917684 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a2d35-a390-4642-8453-fff868228b76 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:20:06.921433 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4baf0-dbe9-4839-aabb-1a4895a09100 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83242c1ef12d4a5b800e67346f4ad963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:20:06.922083 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4baf0-dbe9-4839-aabb-1a4895a09100 service glance] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:20:06.922366 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4baf0-dbe9-4839-aabb-1a4895a09100 service glance] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:20:06.922646 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4baf0-dbe9-4839-aabb-1a4895a09100 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:20:06.930702 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4baf0-dbe9-4839-aabb-1a4895a09100 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:20:06.932123 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4baf0-dbe9-4839-aabb-1a4895a09100 service glance] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:20:06.941588 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1288/2578] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:20:06 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:20:20.379731 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ac0ff-e0dc-4ab4-adf3-5c3e13fc523f None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:20:20.380267 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ac0ff-e0dc-4ab4-adf3-5c3e13fc523f None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:20:20.380267 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ac0ff-e0dc-4ab4-adf3-5c3e13fc523f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:20:20.398252 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-929ac0ff-e0dc-4ab4-adf3-5c3e13fc523f None None] MFA Rules not processed for user `bea2a7d9c3724d8b947a0a6363d2f5bd`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:20:20.399438 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-929ac0ff-e0dc-4ab4-adf3-5c3e13fc523f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:20:20.453394 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1291/2579] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:20:20 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:20:20.748213 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4baf0-dbe9-4839-aabb-1a4895a09100 service glance] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:20:20.749765 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-b3d4baf0-dbe9-4839-aabb-1a4895a09100 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:20:20.803056 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4baf0-dbe9-4839-aabb-1a4895a09100 service glance] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:20:20.806744 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf6546-9d5f-4403-a15b-78ef051e35e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:20:20.807397 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf6546-9d5f-4403-a15b-78ef051e35e3 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:20:20.807679 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf6546-9d5f-4403-a15b-78ef051e35e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:20:20.808008 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf6546-9d5f-4403-a15b-78ef051e35e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:20:20.809763 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-5fbf6546-9d5f-4403-a15b-78ef051e35e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:20:20.819602 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf6546-9d5f-4403-a15b-78ef051e35e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:20:20.821090 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf6546-9d5f-4403-a15b-78ef051e35e3 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:20:20.830289 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1289/2580] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:20:20 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:20:47.566606 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ac0ff-e0dc-4ab4-adf3-5c3e13fc523f None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:20:47.638534 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ac0ff-e0dc-4ab4-adf3-5c3e13fc523f None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:20:47.644054 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6497e1d-e898-4afa-a407-db29047ed84f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:20:47.644744 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6497e1d-e898-4afa-a407-db29047ed84f service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:20:47.645026 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6497e1d-e898-4afa-a407-db29047ed84f service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:20:47.645303 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6497e1d-e898-4afa-a407-db29047ed84f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:20:47.647071 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-e6497e1d-e898-4afa-a407-db29047ed84f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:20:47.659281 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6497e1d-e898-4afa-a407-db29047ed84f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:20:47.660905 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6497e1d-e898-4afa-a407-db29047ed84f service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:20:47.671989 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1292/2581] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:20:47 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:20:59.688666 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf6546-9d5f-4403-a15b-78ef051e35e3 service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:20:59.747321 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf6546-9d5f-4403-a15b-78ef051e35e3 service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:20:59.751847 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d793c07-a991-481d-8aa7-94d2eb735404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:20:59.752730 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d793c07-a991-481d-8aa7-94d2eb735404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:20:59.753012 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d793c07-a991-481d-8aa7-94d2eb735404 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:20:59.753287 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d793c07-a991-481d-8aa7-94d2eb735404 admin admin] PATH_INFO: `/v3/users/2b42de90db8a4c078cf81246ccbf4686` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:20:59.754445 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d793c07-a991-481d-8aa7-94d2eb735404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b42de90db8a4c078cf81246ccbf4686)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:20:59.756417 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d793c07-a991-481d-8aa7-94d2eb735404 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:20:59.927399 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-8d793c07-a991-481d-8aa7-94d2eb735404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b42de90db8a4c078cf81246ccbf4686'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:20:59.928064 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-8d793c07-a991-481d-8aa7-94d2eb735404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b42de90db8a4c078cf81246ccbf4686'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:20:59.934663 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-8d793c07-a991-481d-8aa7-94d2eb735404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b42de90db8a4c078cf81246ccbf4686'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:21:00.005553 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-8d793c07-a991-481d-8aa7-94d2eb735404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b42de90db8a4c078cf81246ccbf4686'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:21:00.017220 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-8d793c07-a991-481d-8aa7-94d2eb735404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b42de90db8a4c078cf81246ccbf4686'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:21:00.023134 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1290/2582] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:20:59 2021] DELETE /identity/v3/users/2b42de90db8a4c078cf81246ccbf4686 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:21:00.028151 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad21640-d65b-4121-a3e5-ec17eafe4a38 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:21:00.028637 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad21640-d65b-4121-a3e5-ec17eafe4a38 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:21:00.028758 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad21640-d65b-4121-a3e5-ec17eafe4a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:21:00.046303 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-7ad21640-d65b-4121-a3e5-ec17eafe4a38 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:21:00.047555 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-7ad21640-d65b-4121-a3e5-ec17eafe4a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:21:00.103023 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1293/2583] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:21:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:21:00.113400 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d793c07-a991-481d-8aa7-94d2eb735404 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:21:00.116758 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-8d793c07-a991-481d-8aa7-94d2eb735404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:21:00.170179 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d793c07-a991-481d-8aa7-94d2eb735404 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:21:00.173799 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabc81b-a6de-4bea-a6dd-c8ed675bcfb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:21:00.174475 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabc81b-a6de-4bea-a6dd-c8ed675bcfb5 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:21:00.174755 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabc81b-a6de-4bea-a6dd-c8ed675bcfb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:21:00.175030 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabc81b-a6de-4bea-a6dd-c8ed675bcfb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:21:00.183720 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfabc81b-a6de-4bea-a6dd-c8ed675bcfb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:21:00.185185 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfabc81b-a6de-4bea-a6dd-c8ed675bcfb5 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:21:00.194392 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1291/2584] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:21:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:21:00.642464 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad21640-d65b-4121-a3e5-ec17eafe4a38 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:21:00.644025 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-7ad21640-d65b-4121-a3e5-ec17eafe4a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:21:00.658715 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad21640-d65b-4121-a3e5-ec17eafe4a38 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:21:00.665206 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e5255-d906-4703-9c8e-76ce414f1b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:21:00.674685 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e5255-d906-4703-9c8e-76ce414f1b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:21:00.674685 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e5255-d906-4703-9c8e-76ce414f1b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:21:00.674685 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e5255-d906-4703-9c8e-76ce414f1b46 admin admin] PATH_INFO: `/v3/projects/e1ade6b0f3e94e54acedf7f18385ee63` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:21:00.674685 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e5255-d906-4703-9c8e-76ce414f1b46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1ade6b0f3e94e54acedf7f18385ee63)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:21:00.674685 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e5255-d906-4703-9c8e-76ce414f1b46 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:21:00.759793 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e57e5255-d906-4703-9c8e-76ce414f1b46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1ade6b0f3e94e54acedf7f18385ee63', 'request_id': 'req-e57e5255-d906-4703-9c8e-76ce414f1b46'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:21:00.822790 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e57e5255-d906-4703-9c8e-76ce414f1b46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1ade6b0f3e94e54acedf7f18385ee63', 'request_id': 'req-e57e5255-d906-4703-9c8e-76ce414f1b46'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:21:00.829788 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e57e5255-d906-4703-9c8e-76ce414f1b46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1ade6b0f3e94e54acedf7f18385ee63', 'request_id': 'req-e57e5255-d906-4703-9c8e-76ce414f1b46'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:21:00.841111 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e57e5255-d906-4703-9c8e-76ce414f1b46 admin admin] The token cache is being invalidate because project e1ade6b0f3e94e54acedf7f18385ee63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:21:00.841405 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e57e5255-d906-4703-9c8e-76ce414f1b46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:21:00.842043 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e57e5255-d906-4703-9c8e-76ce414f1b46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:21:00.843583 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1294/2585] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:21:00 2021] DELETE /identity/v3/projects/e1ade6b0f3e94e54acedf7f18385ee63 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:21:19.995794 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabc81b-a6de-4bea-a6dd-c8ed675bcfb5 service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:21:19.997315 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-bfabc81b-a6de-4bea-a6dd-c8ed675bcfb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:21:20.010809 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabc81b-a6de-4bea-a6dd-c8ed675bcfb5 service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:21:20.063848 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3c800-408a-43f1-9ae2-37eb64fb2461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:21:20.064749 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3c800-408a-43f1-9ae2-37eb64fb2461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:21:20.065036 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3c800-408a-43f1-9ae2-37eb64fb2461 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:21:20.065315 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3c800-408a-43f1-9ae2-37eb64fb2461 admin admin] PATH_INFO: `/v3/users/db531f61fb2a405baec24793c54c9538` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:21:20.066496 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3c800-408a-43f1-9ae2-37eb64fb2461 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db531f61fb2a405baec24793c54c9538)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:21:20.068410 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3c800-408a-43f1-9ae2-37eb64fb2461 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:21:20.264387 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-19d3c800-408a-43f1-9ae2-37eb64fb2461 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db531f61fb2a405baec24793c54c9538'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:21:20.265056 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-19d3c800-408a-43f1-9ae2-37eb64fb2461 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db531f61fb2a405baec24793c54c9538'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:21:20.271576 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-19d3c800-408a-43f1-9ae2-37eb64fb2461 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db531f61fb2a405baec24793c54c9538'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:21:20.347845 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-19d3c800-408a-43f1-9ae2-37eb64fb2461 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db531f61fb2a405baec24793c54c9538'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:21:20.360115 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-19d3c800-408a-43f1-9ae2-37eb64fb2461 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db531f61fb2a405baec24793c54c9538'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:21:20.365951 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1292/2586] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:21:19 2021] DELETE /identity/v3/users/db531f61fb2a405baec24793c54c9538 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:21:20.585430 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e5255-d906-4703-9c8e-76ce414f1b46 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:21:20.587028 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-e57e5255-d906-4703-9c8e-76ce414f1b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:21:20.600877 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e5255-d906-4703-9c8e-76ce414f1b46 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:21:20.657013 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa07bd-c2da-4109-97de-3fa8a2df2d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:21:20.657873 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa07bd-c2da-4109-97de-3fa8a2df2d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:21:20.658151 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa07bd-c2da-4109-97de-3fa8a2df2d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:21:20.658420 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa07bd-c2da-4109-97de-3fa8a2df2d34 admin admin] PATH_INFO: `/v3/projects/d342da2ccebe4ccf9d40607782e2eb54` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:21:20.659588 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa07bd-c2da-4109-97de-3fa8a2df2d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d342da2ccebe4ccf9d40607782e2eb54)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:21:20.661517 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa07bd-c2da-4109-97de-3fa8a2df2d34 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:21:20.800729 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-40aa07bd-c2da-4109-97de-3fa8a2df2d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd342da2ccebe4ccf9d40607782e2eb54', 'request_id': 'req-40aa07bd-c2da-4109-97de-3fa8a2df2d34'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:21:20.875144 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-40aa07bd-c2da-4109-97de-3fa8a2df2d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd342da2ccebe4ccf9d40607782e2eb54', 'request_id': 'req-40aa07bd-c2da-4109-97de-3fa8a2df2d34'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:21:20.883300 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-40aa07bd-c2da-4109-97de-3fa8a2df2d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd342da2ccebe4ccf9d40607782e2eb54', 'request_id': 'req-40aa07bd-c2da-4109-97de-3fa8a2df2d34'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:21:20.897931 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-40aa07bd-c2da-4109-97de-3fa8a2df2d34 admin admin] The token cache is being invalidate because project d342da2ccebe4ccf9d40607782e2eb54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:21:20.898216 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-40aa07bd-c2da-4109-97de-3fa8a2df2d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:21:20.898898 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-40aa07bd-c2da-4109-97de-3fa8a2df2d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:21:20.900465 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1295/2587] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:21:20 2021] DELETE /identity/v3/projects/d342da2ccebe4ccf9d40607782e2eb54 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:21:20.908761 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71004d4b-ff63-47a0-ba07-dee4216e5ca9 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:21:20.909052 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71004d4b-ff63-47a0-ba07-dee4216e5ca9 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:21:20.909330 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71004d4b-ff63-47a0-ba07-dee4216e5ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:21:20.927678 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-71004d4b-ff63-47a0-ba07-dee4216e5ca9 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:21:20.928906 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-71004d4b-ff63-47a0-ba07-dee4216e5ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:21:20.984103 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1293/2588] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:21:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:21:20.991800 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4860d-2838-46cf-a019-48a338a11765 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:21:20.992093 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4860d-2838-46cf-a019-48a338a11765 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:21:20.992372 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4860d-2838-46cf-a019-48a338a11765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:21:21.011816 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-7cf4860d-2838-46cf-a019-48a338a11765 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:21:21.013042 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-7cf4860d-2838-46cf-a019-48a338a11765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:21:21.020867 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1296/2589] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:21:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:21:21.024845 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71004d4b-ff63-47a0-ba07-dee4216e5ca9 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:21:21.034176 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71004d4b-ff63-47a0-ba07-dee4216e5ca9 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:21:21.038793 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b52be-3843-4756-a1b2-5c3d65016c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:21:21.039447 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b52be-3843-4756-a1b2-5c3d65016c23 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:21:21.039731 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b52be-3843-4756-a1b2-5c3d65016c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:21:21.040009 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b52be-3843-4756-a1b2-5c3d65016c23 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:21:21.040764 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b52be-3843-4756-a1b2-5c3d65016c23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:21:21.041102 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b52be-3843-4756-a1b2-5c3d65016c23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:21:21.042691 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b52be-3843-4756-a1b2-5c3d65016c23 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:21:21.053894 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1294/2590] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:21:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:21:21.058379 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4860d-2838-46cf-a019-48a338a11765 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:21:21.067420 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4860d-2838-46cf-a019-48a338a11765 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:21:21.072197 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab1cc6-55ad-4b00-9b9e-1ccc4987f81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:21:21.073494 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab1cc6-55ad-4b00-9b9e-1ccc4987f81c admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:21:21.073776 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab1cc6-55ad-4b00-9b9e-1ccc4987f81c admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:21:21.074049 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab1cc6-55ad-4b00-9b9e-1ccc4987f81c admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:21:21.074764 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab1cc6-55ad-4b00-9b9e-1ccc4987f81c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:21:21.076728 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab1cc6-55ad-4b00-9b9e-1ccc4987f81c admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:21:21.171864 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1297/2591] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:21:21 2021] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:21:21.175866 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b52be-3843-4756-a1b2-5c3d65016c23 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:21:21.186191 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b52be-3843-4756-a1b2-5c3d65016c23 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:21:21.239726 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdbd74-1d24-428f-85a5-70ada939f648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:21:21.240390 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdbd74-1d24-428f-85a5-70ada939f648 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:21:21.240703 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdbd74-1d24-428f-85a5-70ada939f648 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:21:21.240984 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdbd74-1d24-428f-85a5-70ada939f648 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:21:21.241675 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cdbd74-1d24-428f-85a5-70ada939f648 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:21:21.243572 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cdbd74-1d24-428f-85a5-70ada939f648 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:21:21.318961 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1295/2592] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:21:21 2021] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:21:21.323173 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab1cc6-55ad-4b00-9b9e-1ccc4987f81c admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:21:21.333177 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab1cc6-55ad-4b00-9b9e-1ccc4987f81c admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:21:21.337788 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e93830-2b48-413c-8faa-bd02e71e1fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:21:21.338445 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e93830-2b48-413c-8faa-bd02e71e1fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:21:21.338724 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e93830-2b48-413c-8faa-bd02e71e1fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:21:21.338998 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e93830-2b48-413c-8faa-bd02e71e1fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:21:21.339711 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e93830-2b48-413c-8faa-bd02e71e1fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:21:21.341318 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e93830-2b48-413c-8faa-bd02e71e1fe1 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:21:21.351597 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1298/2593] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:21:21 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:21:21.356032 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdbd74-1d24-428f-85a5-70ada939f648 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:21:21.365638 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdbd74-1d24-428f-85a5-70ada939f648 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:21:21.370867 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1bfef-7ac9-4ec6-930e-b54972c4e545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:21:21.371515 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1bfef-7ac9-4ec6-930e-b54972c4e545 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:21:21.371799 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1bfef-7ac9-4ec6-930e-b54972c4e545 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:21:21.372079 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1bfef-7ac9-4ec6-930e-b54972c4e545 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:21:21.372832 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f1bfef-7ac9-4ec6-930e-b54972c4e545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:21:21.374408 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f1bfef-7ac9-4ec6-930e-b54972c4e545 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:21:21.385956 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1296/2594] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:21:21 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:21:21.390045 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e93830-2b48-413c-8faa-bd02e71e1fe1 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:21:21.399882 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e93830-2b48-413c-8faa-bd02e71e1fe1 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:21:21.404736 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411db72-6f7c-48d9-8547-6e2230b8393a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:21:21.405617 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411db72-6f7c-48d9-8547-6e2230b8393a admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:21:21.405899 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411db72-6f7c-48d9-8547-6e2230b8393a admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:21:21.406175 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411db72-6f7c-48d9-8547-6e2230b8393a admin admin] PATH_INFO: `/v3/projects/6c9295094fe94cc69e88db5d29658b1b/users/e083df39fb8c475ab468e84c6134c764/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:21:21.420698 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411db72-6f7c-48d9-8547-6e2230b8393a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c9295094fe94cc69e88db5d29658b1b, user_id=e083df39fb8c475ab468e84c6134c764, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:21:21.423382 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411db72-6f7c-48d9-8547-6e2230b8393a admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:21:21.477764 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1299/2595] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:21:21 2021] PUT /identity/v3/projects/6c9295094fe94cc69e88db5d29658b1b/users/e083df39fb8c475ab468e84c6134c764/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:21:21.483420 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283192e-c660-413c-8355-61159c445074 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:21:21.483715 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283192e-c660-413c-8355-61159c445074 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:21:21.483998 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283192e-c660-413c-8355-61159c445074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:21:21.501491 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-5283192e-c660-413c-8355-61159c445074 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:21:21.502717 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-5283192e-c660-413c-8355-61159c445074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:21:21.559864 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1297/2596] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:21:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:21:21.570140 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411db72-6f7c-48d9-8547-6e2230b8393a admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:21:21.571629 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-f411db72-6f7c-48d9-8547-6e2230b8393a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:21:21.627056 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411db72-6f7c-48d9-8547-6e2230b8393a admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:21:21.630916 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211aa9f-79c0-443f-9309-33e2e4f5983b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:21:21.631575 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211aa9f-79c0-443f-9309-33e2e4f5983b service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:21:21.631889 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211aa9f-79c0-443f-9309-33e2e4f5983b service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:21:21.632177 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211aa9f-79c0-443f-9309-33e2e4f5983b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:21:21.641754 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211aa9f-79c0-443f-9309-33e2e4f5983b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:21:21.643180 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211aa9f-79c0-443f-9309-33e2e4f5983b service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:21:21.652474 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1300/2597] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:21:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:21:27.383728 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056507e4-174f-439f-834b-fdb1d29bd050 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:21:27.384261 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056507e4-174f-439f-834b-fdb1d29bd050 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:21:27.384371 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056507e4-174f-439f-834b-fdb1d29bd050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:21:27.412458 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-056507e4-174f-439f-834b-fdb1d29bd050 None None] MFA Rules not processed for user `e083df39fb8c475ab468e84c6134c764`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:21:27.413741 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-056507e4-174f-439f-834b-fdb1d29bd050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:21:27.484764 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1298/2598] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:21:27 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:21:27.489317 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211aa9f-79c0-443f-9309-33e2e4f5983b service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:21:27.499790 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211aa9f-79c0-443f-9309-33e2e4f5983b service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:21:27.504560 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38642094-9cc5-46fa-a726-ec3042cb8901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:21:27.505298 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38642094-9cc5-46fa-a726-ec3042cb8901 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:21:27.505648 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38642094-9cc5-46fa-a726-ec3042cb8901 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:21:27.505991 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38642094-9cc5-46fa-a726-ec3042cb8901 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:21:27.506764 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38642094-9cc5-46fa-a726-ec3042cb8901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:21:27.508784 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38642094-9cc5-46fa-a726-ec3042cb8901 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:21:27.602860 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1301/2599] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:21:27 2021] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:21:27.607821 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056507e4-174f-439f-834b-fdb1d29bd050 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:21:27.618942 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056507e4-174f-439f-834b-fdb1d29bd050 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:21:27.676412 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793395b-d0a5-4517-abe5-5cba49374215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:21:27.678625 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793395b-d0a5-4517-abe5-5cba49374215 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:21:27.678625 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793395b-d0a5-4517-abe5-5cba49374215 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:21:27.678625 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793395b-d0a5-4517-abe5-5cba49374215 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:21:27.678625 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793395b-d0a5-4517-abe5-5cba49374215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:21:27.680206 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793395b-d0a5-4517-abe5-5cba49374215 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:21:27.765936 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1299/2600] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:21:27 2021] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:21:27.769912 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38642094-9cc5-46fa-a726-ec3042cb8901 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:21:27.780136 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38642094-9cc5-46fa-a726-ec3042cb8901 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:21:27.784810 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6b5d5-8ca8-4a5b-a61f-b4636cc064cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:21:27.785476 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6b5d5-8ca8-4a5b-a61f-b4636cc064cf admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:21:27.785759 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6b5d5-8ca8-4a5b-a61f-b4636cc064cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:21:27.786040 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6b5d5-8ca8-4a5b-a61f-b4636cc064cf admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:21:27.786884 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6b5d5-8ca8-4a5b-a61f-b4636cc064cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:21:27.788393 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6b5d5-8ca8-4a5b-a61f-b4636cc064cf admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:21:27.798762 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1302/2601] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:21:27 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:21:27.802828 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793395b-d0a5-4517-abe5-5cba49374215 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:21:27.813355 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793395b-d0a5-4517-abe5-5cba49374215 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:21:27.818159 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b8aae-2f78-4333-997f-6e14f17eeeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:21:27.819053 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b8aae-2f78-4333-997f-6e14f17eeeb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:21:27.819336 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b8aae-2f78-4333-997f-6e14f17eeeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:21:27.819612 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b8aae-2f78-4333-997f-6e14f17eeeb1 admin admin] PATH_INFO: `/v3/projects/c2cc9420de8f40cfbed777f55b86e5d9/users/be1f83167fbc41e3bd9dce3dcb2144f9/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:21:27.835220 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b8aae-2f78-4333-997f-6e14f17eeeb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2cc9420de8f40cfbed777f55b86e5d9, user_id=be1f83167fbc41e3bd9dce3dcb2144f9, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:21:27.837900 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b8aae-2f78-4333-997f-6e14f17eeeb1 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:21:27.908765 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1300/2602] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:21:27 2021] PUT /identity/v3/projects/c2cc9420de8f40cfbed777f55b86e5d9/users/be1f83167fbc41e3bd9dce3dcb2144f9/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:21:27.912844 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6b5d5-8ca8-4a5b-a61f-b4636cc064cf admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:21:27.922738 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6b5d5-8ca8-4a5b-a61f-b4636cc064cf admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:21:27.976420 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d0287-19af-4e1b-8a90-45064a229812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:21:27.977121 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d0287-19af-4e1b-8a90-45064a229812 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:21:27.977406 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d0287-19af-4e1b-8a90-45064a229812 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:21:27.977687 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d0287-19af-4e1b-8a90-45064a229812 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:21:27.978938 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d0287-19af-4e1b-8a90-45064a229812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:21:27.980830 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d0287-19af-4e1b-8a90-45064a229812 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:21:27.990400 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1303/2603] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:21:27 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:21:27.995075 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b8aae-2f78-4333-997f-6e14f17eeeb1 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:21:28.005413 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b8aae-2f78-4333-997f-6e14f17eeeb1 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:21:28.010196 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69277576-0eae-424a-9aca-718e00a02162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:21:28.011100 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69277576-0eae-424a-9aca-718e00a02162 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:21:28.011386 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69277576-0eae-424a-9aca-718e00a02162 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:21:28.011664 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69277576-0eae-424a-9aca-718e00a02162 admin admin] PATH_INFO: `/v3/projects/c2cc9420de8f40cfbed777f55b86e5d9/users/be1f83167fbc41e3bd9dce3dcb2144f9/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:21:28.013657 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69277576-0eae-424a-9aca-718e00a02162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2cc9420de8f40cfbed777f55b86e5d9, user_id=be1f83167fbc41e3bd9dce3dcb2144f9, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:21:28.016356 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69277576-0eae-424a-9aca-718e00a02162 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:21:28.026240 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1301/2604] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:21:27 2021] PUT /identity/v3/projects/c2cc9420de8f40cfbed777f55b86e5d9/users/be1f83167fbc41e3bd9dce3dcb2144f9/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:21:33.229407 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41208c-ca9f-4bf2-a160-8df8ffb7ff7d None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:21:33.229920 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41208c-ca9f-4bf2-a160-8df8ffb7ff7d None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:21:33.230024 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41208c-ca9f-4bf2-a160-8df8ffb7ff7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:21:33.258149 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-4e41208c-ca9f-4bf2-a160-8df8ffb7ff7d None None] MFA Rules not processed for user `be1f83167fbc41e3bd9dce3dcb2144f9`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:21:33.259450 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-4e41208c-ca9f-4bf2-a160-8df8ffb7ff7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:21:33.343240 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1304/2605] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:21:33 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:21:33.358243 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69277576-0eae-424a-9aca-718e00a02162 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:21:33.360117 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-69277576-0eae-424a-9aca-718e00a02162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:21:33.437923 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69277576-0eae-424a-9aca-718e00a02162 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:21:33.443932 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e2f85-48f5-4e60-8338-2c81d1f30a8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:21:33.444635 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e2f85-48f5-4e60-8338-2c81d1f30a8f service nova] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:21:33.444919 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e2f85-48f5-4e60-8338-2c81d1f30a8f service nova] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:21:33.445194 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e2f85-48f5-4e60-8338-2c81d1f30a8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:21:33.503363 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e2f85-48f5-4e60-8338-2c81d1f30a8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:21:33.505012 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e2f85-48f5-4e60-8338-2c81d1f30a8f service nova] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:21:33.514808 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1302/2606] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:21:33 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:21:36.188361 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad967e-4a24-462c-8ead-1cfa3d345c94 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:21:36.189022 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad967e-4a24-462c-8ead-1cfa3d345c94 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:21:36.189141 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad967e-4a24-462c-8ead-1cfa3d345c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:21:36.207765 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-46ad967e-4a24-462c-8ead-1cfa3d345c94 None None] MFA Rules not processed for user `e083df39fb8c475ab468e84c6134c764`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:21:36.209480 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-46ad967e-4a24-462c-8ead-1cfa3d345c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:21:36.233534 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1305/2607] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:21:36 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:22:05.397960 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e2f85-48f5-4e60-8338-2c81d1f30a8f service nova] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:22:05.399508 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-b26e2f85-48f5-4e60-8338-2c81d1f30a8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:22:05.465622 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e2f85-48f5-4e60-8338-2c81d1f30a8f service nova] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:22:05.470610 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc301a7-7ea8-472b-982e-d60ea7f72c6a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b7e780a23e4ee499cb7820a85feccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:22:05.471252 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc301a7-7ea8-472b-982e-d60ea7f72c6a service placement] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:22:05.471534 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc301a7-7ea8-472b-982e-d60ea7f72c6a service placement] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:22:05.471807 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc301a7-7ea8-472b-982e-d60ea7f72c6a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:22:05.473560 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-2fc301a7-7ea8-472b-982e-d60ea7f72c6a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:22:05.485200 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc301a7-7ea8-472b-982e-d60ea7f72c6a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:22:05.486764 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc301a7-7ea8-472b-982e-d60ea7f72c6a service placement] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:22:05.496798 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1303/2608] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:22:05 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:22:22.952917 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad967e-4a24-462c-8ead-1cfa3d345c94 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:22:23.005895 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad967e-4a24-462c-8ead-1cfa3d345c94 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:22:23.009518 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02256e01-fd56-4943-a4f6-8686e80c7370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:22:23.010175 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02256e01-fd56-4943-a4f6-8686e80c7370 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:22:23.010478 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02256e01-fd56-4943-a4f6-8686e80c7370 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:22:23.010735 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02256e01-fd56-4943-a4f6-8686e80c7370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:22:23.023791 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02256e01-fd56-4943-a4f6-8686e80c7370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:22:23.025257 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02256e01-fd56-4943-a4f6-8686e80c7370 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:22:23.034687 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1306/2609] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:22:22 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:22:35.130199 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0901759-ad17-44b8-b191-c7ecb91aec35 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:22:35.131023 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0901759-ad17-44b8-b191-c7ecb91aec35 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:22:35.131210 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0901759-ad17-44b8-b191-c7ecb91aec35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:22:35.148791 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-c0901759-ad17-44b8-b191-c7ecb91aec35 None None] MFA Rules not processed for user `96c9b76133d74b79a0d2da9a884651e1`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:22:35.150391 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-c0901759-ad17-44b8-b191-c7ecb91aec35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:22:35.205398 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1304/2610] 10.222.0.23 () {58 vars in 1010 bytes} [Thu Sep 23 03:22:35 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:22:35.350294 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02256e01-fd56-4943-a4f6-8686e80c7370 service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:22:35.352253 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-02256e01-fd56-4943-a4f6-8686e80c7370 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:22:35.420387 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02256e01-fd56-4943-a4f6-8686e80c7370 service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:22:35.425418 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c9f87-92dd-4ae1-ab02-bbf0de3de3bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df051fd059b34fe0993f501546d1610f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:22:35.426072 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c9f87-92dd-4ae1-ab02-bbf0de3de3bd service swift] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:22:35.426352 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c9f87-92dd-4ae1-ab02-bbf0de3de3bd service swift] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:22:35.426628 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c9f87-92dd-4ae1-ab02-bbf0de3de3bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:22:35.434828 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c9f87-92dd-4ae1-ab02-bbf0de3de3bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:22:35.436441 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c9f87-92dd-4ae1-ab02-bbf0de3de3bd service swift] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:22:35.444386 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1307/2611] 10.222.0.23 () {60 vars in 1385 bytes} [Thu Sep 23 03:22:35 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 03:22:53.916883 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0901759-ad17-44b8-b191-c7ecb91aec35 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:22:53.918283 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-c0901759-ad17-44b8-b191-c7ecb91aec35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:22:53.973678 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0901759-ad17-44b8-b191-c7ecb91aec35 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:22:53.984800 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1d34c-952a-4d12-b531-9df394350bca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83242c1ef12d4a5b800e67346f4ad963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:22:53.985473 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1d34c-952a-4d12-b531-9df394350bca service glance] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:22:53.985770 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1d34c-952a-4d12-b531-9df394350bca service glance] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:22:53.986026 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1d34c-952a-4d12-b531-9df394350bca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:22:53.989357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-fcc1d34c-952a-4d12-b531-9df394350bca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:22:54.013220 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1d34c-952a-4d12-b531-9df394350bca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:22:54.014652 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1d34c-952a-4d12-b531-9df394350bca service glance] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:22:54.025925 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1305/2612] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:22:53 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:22:54.207452 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c9f87-92dd-4ae1-ab02-bbf0de3de3bd service swift] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:22:54.208925 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-e73c9f87-92dd-4ae1-ab02-bbf0de3de3bd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:22:54.220575 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c9f87-92dd-4ae1-ab02-bbf0de3de3bd service swift] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:22:54.224136 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7003e-fd1e-4e2b-9fb4-db33c64f1391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:22:54.224808 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7003e-fd1e-4e2b-9fb4-db33c64f1391 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:22:54.225092 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7003e-fd1e-4e2b-9fb4-db33c64f1391 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:22:54.225848 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7003e-fd1e-4e2b-9fb4-db33c64f1391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:22:54.227506 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-13c7003e-fd1e-4e2b-9fb4-db33c64f1391 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:22:54.236853 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7003e-fd1e-4e2b-9fb4-db33c64f1391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:22:54.238314 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7003e-fd1e-4e2b-9fb4-db33c64f1391 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:22:54.246917 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1308/2613] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:22:54 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:22:56.182447 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1d34c-952a-4d12-b531-9df394350bca service glance] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:22:56.191613 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1d34c-952a-4d12-b531-9df394350bca service glance] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:22:56.195360 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03661ad-9daf-480f-a334-06668abf1135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:22:56.196001 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03661ad-9daf-480f-a334-06668abf1135 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:22:56.196281 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03661ad-9daf-480f-a334-06668abf1135 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:22:56.196594 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03661ad-9daf-480f-a334-06668abf1135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:22:56.198319 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-a03661ad-9daf-480f-a334-06668abf1135 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:22:56.212622 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03661ad-9daf-480f-a334-06668abf1135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:22:56.214281 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03661ad-9daf-480f-a334-06668abf1135 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:22:56.225543 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1306/2614] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:22:56 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:22:57.387540 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7003e-fd1e-4e2b-9fb4-db33c64f1391 service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:22:57.396059 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7003e-fd1e-4e2b-9fb4-db33c64f1391 service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:22:57.399669 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11019d-78de-4309-9723-021a7f3010d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:22:57.400307 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11019d-78de-4309-9723-021a7f3010d4 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:22:57.400624 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11019d-78de-4309-9723-021a7f3010d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:22:57.400920 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11019d-78de-4309-9723-021a7f3010d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:22:57.402656 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-aa11019d-78de-4309-9723-021a7f3010d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:22:57.416710 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11019d-78de-4309-9723-021a7f3010d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:22:57.418203 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11019d-78de-4309-9723-021a7f3010d4 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:22:57.431323 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1309/2615] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:22:57 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:22:58.609397 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76d3f7-325a-41be-a753-a8d87bfec3f9 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:22:58.609870 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76d3f7-325a-41be-a753-a8d87bfec3f9 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:22:58.609964 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76d3f7-325a-41be-a753-a8d87bfec3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:22:58.627182 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-cb76d3f7-325a-41be-a753-a8d87bfec3f9 None None] MFA Rules not processed for user `96c9b76133d74b79a0d2da9a884651e1`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:22:58.628386 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-cb76d3f7-325a-41be-a753-a8d87bfec3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:22:58.635659 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1307/2616] 10.222.0.23 () {58 vars in 1010 bytes} [Thu Sep 23 03:22:58 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:22:58.649224 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11019d-78de-4309-9723-021a7f3010d4 service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:22:58.660249 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11019d-78de-4309-9723-021a7f3010d4 service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:22:58.665778 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e75b1-4b7a-45ca-89aa-7e082f52821e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df051fd059b34fe0993f501546d1610f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:22:58.666452 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e75b1-4b7a-45ca-89aa-7e082f52821e service swift] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:22:58.666732 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e75b1-4b7a-45ca-89aa-7e082f52821e service swift] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:22:58.667009 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e75b1-4b7a-45ca-89aa-7e082f52821e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:22:58.675119 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e75b1-4b7a-45ca-89aa-7e082f52821e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:22:58.676651 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e75b1-4b7a-45ca-89aa-7e082f52821e service swift] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:22:58.685072 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1310/2617] 10.222.0.23 () {60 vars in 1385 bytes} [Thu Sep 23 03:22:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 23 03:23:04.383429 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76d3f7-325a-41be-a753-a8d87bfec3f9 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:23:04.396356 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76d3f7-325a-41be-a753-a8d87bfec3f9 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:23:04.402209 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9317c9-c186-4547-b6d8-0c755c8e677f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:23:04.402862 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9317c9-c186-4547-b6d8-0c755c8e677f service nova] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:23:04.403280 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9317c9-c186-4547-b6d8-0c755c8e677f service nova] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:23:04.403433 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9317c9-c186-4547-b6d8-0c755c8e677f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:23:04.405231 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-9a9317c9-c186-4547-b6d8-0c755c8e677f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:23:04.488191 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9317c9-c186-4547-b6d8-0c755c8e677f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:23:04.489904 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9317c9-c186-4547-b6d8-0c755c8e677f service nova] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:23:04.508673 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1308/2618] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:23:04 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:23:18.344711 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e75b1-4b7a-45ca-89aa-7e082f52821e service swift] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:23:18.354309 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e75b1-4b7a-45ca-89aa-7e082f52821e service swift] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:23:18.357960 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495a48d-55ae-442d-a03a-6d75401275af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:23:18.358593 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495a48d-55ae-442d-a03a-6d75401275af service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:23:18.358872 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495a48d-55ae-442d-a03a-6d75401275af service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:23:18.359147 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495a48d-55ae-442d-a03a-6d75401275af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:23:18.361033 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-b495a48d-55ae-442d-a03a-6d75401275af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:23:18.370251 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495a48d-55ae-442d-a03a-6d75401275af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:23:18.371657 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495a48d-55ae-442d-a03a-6d75401275af service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:23:18.379400 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1311/2619] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:23:18 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:23:19.949700 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68661a2-06ee-4d34-8b82-d9e405d9e4a4 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:23:19.950190 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68661a2-06ee-4d34-8b82-d9e405d9e4a4 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:23:19.950291 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68661a2-06ee-4d34-8b82-d9e405d9e4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:23:19.967725 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-a68661a2-06ee-4d34-8b82-d9e405d9e4a4 None None] MFA Rules not processed for user `96c9b76133d74b79a0d2da9a884651e1`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:23:19.968902 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-a68661a2-06ee-4d34-8b82-d9e405d9e4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:23:19.976017 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1309/2620] 10.222.0.23 () {58 vars in 968 bytes} [Thu Sep 23 03:23:19 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:23:19.989190 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495a48d-55ae-442d-a03a-6d75401275af service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:23:20.001254 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495a48d-55ae-442d-a03a-6d75401275af service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:23:20.007029 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f70727-6cf9-486f-9c05-bb12743aec49 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df051fd059b34fe0993f501546d1610f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:23:20.007681 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f70727-6cf9-486f-9c05-bb12743aec49 service swift] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:23:20.007964 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f70727-6cf9-486f-9c05-bb12743aec49 service swift] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:23:20.008240 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f70727-6cf9-486f-9c05-bb12743aec49 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:23:20.016517 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f70727-6cf9-486f-9c05-bb12743aec49 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:23:20.018114 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f70727-6cf9-486f-9c05-bb12743aec49 service swift] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:23:20.026758 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1312/2621] 10.222.0.23 () {60 vars in 1385 bytes} [Thu Sep 23 03:23:19 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 03:24:26.505711 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68661a2-06ee-4d34-8b82-d9e405d9e4a4 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:24:26.515030 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68661a2-06ee-4d34-8b82-d9e405d9e4a4 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:24:26.518647 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a5455-34f3-4fc5-ac16-0ac4ce21fd8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:24:26.519294 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a5455-34f3-4fc5-ac16-0ac4ce21fd8b service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:24:26.519631 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a5455-34f3-4fc5-ac16-0ac4ce21fd8b service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:24:26.519914 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a5455-34f3-4fc5-ac16-0ac4ce21fd8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:24:26.521702 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-4c9a5455-34f3-4fc5-ac16-0ac4ce21fd8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:24:26.580899 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a5455-34f3-4fc5-ac16-0ac4ce21fd8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:24:26.582321 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a5455-34f3-4fc5-ac16-0ac4ce21fd8b service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:24:26.591718 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1310/2622] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:24:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:24:30.374092 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f70727-6cf9-486f-9c05-bb12743aec49 service swift] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:24:30.375651 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-06f70727-6cf9-486f-9c05-bb12743aec49 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:24:30.389794 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f70727-6cf9-486f-9c05-bb12743aec49 service swift] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:24:30.393667 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e31af-1a78-420f-8186-f482ab35142a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:24:30.394537 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e31af-1a78-420f-8186-f482ab35142a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:24:30.394813 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e31af-1a78-420f-8186-f482ab35142a admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:24:30.395085 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e31af-1a78-420f-8186-f482ab35142a admin admin] PATH_INFO: `/v3/users/bea2a7d9c3724d8b947a0a6363d2f5bd` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:24:30.396280 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e31af-1a78-420f-8186-f482ab35142a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bea2a7d9c3724d8b947a0a6363d2f5bd)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:24:30.398212 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e31af-1a78-420f-8186-f482ab35142a admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:24:30.581408 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-bb2e31af-1a78-420f-8186-f482ab35142a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bea2a7d9c3724d8b947a0a6363d2f5bd'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:24:30.582627 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-bb2e31af-1a78-420f-8186-f482ab35142a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bea2a7d9c3724d8b947a0a6363d2f5bd'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:24:30.583223 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-bb2e31af-1a78-420f-8186-f482ab35142a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bea2a7d9c3724d8b947a0a6363d2f5bd'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:24:30.590297 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-bb2e31af-1a78-420f-8186-f482ab35142a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bea2a7d9c3724d8b947a0a6363d2f5bd'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:24:30.652051 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-bb2e31af-1a78-420f-8186-f482ab35142a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bea2a7d9c3724d8b947a0a6363d2f5bd'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:24:30.669742 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1313/2623] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:24:30 2021] DELETE /identity/v3/users/bea2a7d9c3724d8b947a0a6363d2f5bd => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:24:30.922509 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a5455-34f3-4fc5-ac16-0ac4ce21fd8b service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:24:30.935136 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a5455-34f3-4fc5-ac16-0ac4ce21fd8b service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:24:30.991340 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86baffea-7bbe-449f-9344-8b218734d09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:24:30.993213 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baffea-7bbe-449f-9344-8b218734d09f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:24:30.993213 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baffea-7bbe-449f-9344-8b218734d09f admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:24:30.993213 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baffea-7bbe-449f-9344-8b218734d09f admin admin] PATH_INFO: `/v3/projects/dbfca1e34b884266a4b529b2813872ba` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:24:30.993957 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86baffea-7bbe-449f-9344-8b218734d09f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbfca1e34b884266a4b529b2813872ba)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:24:30.995838 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86baffea-7bbe-449f-9344-8b218734d09f admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:24:31.133564 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-86baffea-7bbe-449f-9344-8b218734d09f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbfca1e34b884266a4b529b2813872ba', 'request_id': 'req-86baffea-7bbe-449f-9344-8b218734d09f'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:24:31.200432 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-86baffea-7bbe-449f-9344-8b218734d09f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbfca1e34b884266a4b529b2813872ba', 'request_id': 'req-86baffea-7bbe-449f-9344-8b218734d09f'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:24:31.205854 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-86baffea-7bbe-449f-9344-8b218734d09f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbfca1e34b884266a4b529b2813872ba', 'request_id': 'req-86baffea-7bbe-449f-9344-8b218734d09f'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:24:31.217196 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-86baffea-7bbe-449f-9344-8b218734d09f admin admin] The token cache is being invalidate because project dbfca1e34b884266a4b529b2813872ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:24:31.217488 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-86baffea-7bbe-449f-9344-8b218734d09f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:24:31.218113 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-86baffea-7bbe-449f-9344-8b218734d09f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:24:31.219741 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1311/2624] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:24:30 2021] DELETE /identity/v3/projects/dbfca1e34b884266a4b529b2813872ba => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:24:31.225677 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd96747-36c8-45e8-b839-2b112521dadf None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:24:31.228821 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd96747-36c8-45e8-b839-2b112521dadf None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:24:31.228821 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd96747-36c8-45e8-b839-2b112521dadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:24:31.244339 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-7fd96747-36c8-45e8-b839-2b112521dadf None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:24:31.245591 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-7fd96747-36c8-45e8-b839-2b112521dadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:24:31.301816 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1314/2625] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:24:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:24:31.309749 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf64f61-29e7-489d-993f-561dd55f9d1c None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:24:31.310047 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf64f61-29e7-489d-993f-561dd55f9d1c None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:24:31.310325 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf64f61-29e7-489d-993f-561dd55f9d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:24:31.328534 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-fdf64f61-29e7-489d-993f-561dd55f9d1c None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:24:31.329737 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-fdf64f61-29e7-489d-993f-561dd55f9d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:24:31.338452 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1312/2626] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:24:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:24:31.342451 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd96747-36c8-45e8-b839-2b112521dadf None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:24:31.352046 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd96747-36c8-45e8-b839-2b112521dadf None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:24:31.356628 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6de65e-48d8-49bd-a429-08a945e48d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:24:31.357276 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6de65e-48d8-49bd-a429-08a945e48d9b admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:24:31.357556 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6de65e-48d8-49bd-a429-08a945e48d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:24:31.357829 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6de65e-48d8-49bd-a429-08a945e48d9b admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:24:31.358545 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6de65e-48d8-49bd-a429-08a945e48d9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:24:31.358850 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6de65e-48d8-49bd-a429-08a945e48d9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:24:31.360423 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6de65e-48d8-49bd-a429-08a945e48d9b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:24:31.371906 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1315/2627] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:24:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:24:31.376007 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf64f61-29e7-489d-993f-561dd55f9d1c None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:24:31.385483 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf64f61-29e7-489d-993f-561dd55f9d1c None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:24:31.390063 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3538b-8bdc-40ef-8092-f5362915546a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:24:31.390720 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3538b-8bdc-40ef-8092-f5362915546a admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:24:31.391004 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3538b-8bdc-40ef-8092-f5362915546a admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:24:31.391281 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3538b-8bdc-40ef-8092-f5362915546a admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:24:31.391967 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3538b-8bdc-40ef-8092-f5362915546a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:24:31.393877 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3538b-8bdc-40ef-8092-f5362915546a admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:24:31.470527 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1313/2628] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:24:31 2021] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:24:31.474683 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6de65e-48d8-49bd-a429-08a945e48d9b admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:24:31.486195 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6de65e-48d8-49bd-a429-08a945e48d9b admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:24:31.540377 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd28da-1acf-4444-bf70-a44844e1ba55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:24:31.541086 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd28da-1acf-4444-bf70-a44844e1ba55 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:24:31.541369 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd28da-1acf-4444-bf70-a44844e1ba55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:24:31.541646 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd28da-1acf-4444-bf70-a44844e1ba55 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:24:31.542331 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd28da-1acf-4444-bf70-a44844e1ba55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:24:31.544218 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd28da-1acf-4444-bf70-a44844e1ba55 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:24:31.652579 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1316/2629] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:24:31 2021] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:24:31.656785 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3538b-8bdc-40ef-8092-f5362915546a admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:24:31.667557 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3538b-8bdc-40ef-8092-f5362915546a admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:24:31.672402 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc4518-e961-4994-9a42-1cfe69cd46e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:24:31.673091 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc4518-e961-4994-9a42-1cfe69cd46e4 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:24:31.673371 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc4518-e961-4994-9a42-1cfe69cd46e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:24:31.673739 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc4518-e961-4994-9a42-1cfe69cd46e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:24:31.674465 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc4518-e961-4994-9a42-1cfe69cd46e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:24:31.676084 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc4518-e961-4994-9a42-1cfe69cd46e4 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:24:31.686447 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1314/2630] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:24:31 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:24:31.690569 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd28da-1acf-4444-bf70-a44844e1ba55 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:24:31.701003 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd28da-1acf-4444-bf70-a44844e1ba55 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:24:31.705645 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99687099-4e2b-4ecd-b595-238ce1c0ae07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:24:31.710896 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99687099-4e2b-4ecd-b595-238ce1c0ae07 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:24:31.710896 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99687099-4e2b-4ecd-b595-238ce1c0ae07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:24:31.710896 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99687099-4e2b-4ecd-b595-238ce1c0ae07 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:24:31.710896 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99687099-4e2b-4ecd-b595-238ce1c0ae07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:24:31.710896 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99687099-4e2b-4ecd-b595-238ce1c0ae07 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:24:31.719466 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1317/2631] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:24:31 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:24:31.723510 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc4518-e961-4994-9a42-1cfe69cd46e4 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:24:31.733377 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc4518-e961-4994-9a42-1cfe69cd46e4 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:24:31.738035 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ab5f2-1a5a-452d-891d-e3dcb03fc75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:24:31.738910 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ab5f2-1a5a-452d-891d-e3dcb03fc75b admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:24:31.739192 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ab5f2-1a5a-452d-891d-e3dcb03fc75b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:24:31.739468 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ab5f2-1a5a-452d-891d-e3dcb03fc75b admin admin] PATH_INFO: `/v3/projects/976c473ab2634adaa47c36dca50bf392/users/2700498241084d4aa4099e8034fbeb94/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:24:31.753182 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ab5f2-1a5a-452d-891d-e3dcb03fc75b admin admin] RBAC: Authorizing `identity:create_grant(project_id=976c473ab2634adaa47c36dca50bf392, user_id=2700498241084d4aa4099e8034fbeb94, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:24:31.756301 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ab5f2-1a5a-452d-891d-e3dcb03fc75b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:24:31.858101 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1315/2632] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:24:31 2021] PUT /identity/v3/projects/976c473ab2634adaa47c36dca50bf392/users/2700498241084d4aa4099e8034fbeb94/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:24:31.863298 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bacd0-e37f-481a-bc3c-a768f12968e2 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:24:31.865574 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bacd0-e37f-481a-bc3c-a768f12968e2 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:24:31.865574 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bacd0-e37f-481a-bc3c-a768f12968e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:24:31.881620 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-7a4bacd0-e37f-481a-bc3c-a768f12968e2 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:24:31.882807 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-7a4bacd0-e37f-481a-bc3c-a768f12968e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:24:31.939354 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1318/2633] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:24:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:24:31.948988 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ab5f2-1a5a-452d-891d-e3dcb03fc75b admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:24:31.950688 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-684ab5f2-1a5a-452d-891d-e3dcb03fc75b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:24:32.003893 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ab5f2-1a5a-452d-891d-e3dcb03fc75b admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:24:32.007475 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cef44b-372b-40d6-8f2f-6bb78bc4f587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:24:32.008112 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cef44b-372b-40d6-8f2f-6bb78bc4f587 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:24:32.008392 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cef44b-372b-40d6-8f2f-6bb78bc4f587 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:24:32.008712 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cef44b-372b-40d6-8f2f-6bb78bc4f587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:24:32.017298 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cef44b-372b-40d6-8f2f-6bb78bc4f587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:24:32.018729 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cef44b-372b-40d6-8f2f-6bb78bc4f587 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:24:32.027777 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1316/2634] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:24:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:24:37.145856 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d42a8-7fdb-47f1-8825-9b41264e2e47 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:24:37.146338 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d42a8-7fdb-47f1-8825-9b41264e2e47 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:24:37.146458 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d42a8-7fdb-47f1-8825-9b41264e2e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:24:37.174832 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-968d42a8-7fdb-47f1-8825-9b41264e2e47 None None] MFA Rules not processed for user `2700498241084d4aa4099e8034fbeb94`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:24:37.176534 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-968d42a8-7fdb-47f1-8825-9b41264e2e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:24:37.242133 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1319/2635] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:24:37 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:24:37.263801 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cef44b-372b-40d6-8f2f-6bb78bc4f587 service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:24:37.266595 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-44cef44b-372b-40d6-8f2f-6bb78bc4f587 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:24:37.339569 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cef44b-372b-40d6-8f2f-6bb78bc4f587 service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:24:37.345095 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e54d0-a634-4161-a38a-2ec9d86cea97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:24:37.345775 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e54d0-a634-4161-a38a-2ec9d86cea97 service nova] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:24:37.346074 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e54d0-a634-4161-a38a-2ec9d86cea97 service nova] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:24:37.346348 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e54d0-a634-4161-a38a-2ec9d86cea97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:24:37.354323 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e54d0-a634-4161-a38a-2ec9d86cea97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:24:37.355880 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e54d0-a634-4161-a38a-2ec9d86cea97 service nova] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:24:37.365151 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1317/2636] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:24:37 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:24:41.218585 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf53c8-dbf6-461e-9e76-65460c4ca917 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:24:41.219124 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf53c8-dbf6-461e-9e76-65460c4ca917 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:24:41.219225 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf53c8-dbf6-461e-9e76-65460c4ca917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:24:41.237382 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-9daf53c8-dbf6-461e-9e76-65460c4ca917 None None] MFA Rules not processed for user `2700498241084d4aa4099e8034fbeb94`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:24:41.239095 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-9daf53c8-dbf6-461e-9e76-65460c4ca917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:24:41.246299 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1320/2637] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:24:41 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:24:41.544446 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e54d0-a634-4161-a38a-2ec9d86cea97 service nova] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:24:41.554048 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e54d0-a634-4161-a38a-2ec9d86cea97 service nova] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:24:41.557597 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29627a-8c48-4d62-bb0e-e4b46ee8f649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:24:41.558231 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29627a-8c48-4d62-bb0e-e4b46ee8f649 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:24:41.558513 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29627a-8c48-4d62-bb0e-e4b46ee8f649 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:24:41.558786 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29627a-8c48-4d62-bb0e-e4b46ee8f649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:24:41.560509 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-0a29627a-8c48-4d62-bb0e-e4b46ee8f649 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:24:41.573689 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29627a-8c48-4d62-bb0e-e4b46ee8f649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:24:41.575094 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29627a-8c48-4d62-bb0e-e4b46ee8f649 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:24:41.583355 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1318/2638] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:24:41 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:24:41.979373 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf53c8-dbf6-461e-9e76-65460c4ca917 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:24:41.981031 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-9daf53c8-dbf6-461e-9e76-65460c4ca917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:24:42.049249 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf53c8-dbf6-461e-9e76-65460c4ca917 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:24:42.054850 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae07082-74f3-4640-9b1b-776551199494 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b7e780a23e4ee499cb7820a85feccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:24:42.055506 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae07082-74f3-4640-9b1b-776551199494 service placement] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:24:42.055795 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae07082-74f3-4640-9b1b-776551199494 service placement] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:24:42.056069 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae07082-74f3-4640-9b1b-776551199494 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:24:42.057851 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-dae07082-74f3-4640-9b1b-776551199494 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:24:42.069730 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae07082-74f3-4640-9b1b-776551199494 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:24:42.071237 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae07082-74f3-4640-9b1b-776551199494 service placement] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:24:42.080951 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1321/2639] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:24:41 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:24:46.102791 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29627a-8c48-4d62-bb0e-e4b46ee8f649 service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:24:46.115589 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29627a-8c48-4d62-bb0e-e4b46ee8f649 service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:24:46.121333 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8c65d-1f5c-49f0-8b8c-0d7df2e76aed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:24:46.122062 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8c65d-1f5c-49f0-8b8c-0d7df2e76aed service nova] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:24:46.122351 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8c65d-1f5c-49f0-8b8c-0d7df2e76aed service nova] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:24:46.122632 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8c65d-1f5c-49f0-8b8c-0d7df2e76aed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:24:46.124437 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-a4a8c65d-1f5c-49f0-8b8c-0d7df2e76aed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:24:46.137456 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8c65d-1f5c-49f0-8b8c-0d7df2e76aed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:24:46.139163 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8c65d-1f5c-49f0-8b8c-0d7df2e76aed service nova] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:24:46.151017 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1319/2640] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:24:46 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:25:06.461982 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae07082-74f3-4640-9b1b-776551199494 service placement] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:25:06.463865 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-dae07082-74f3-4640-9b1b-776551199494 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:25:06.479252 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae07082-74f3-4640-9b1b-776551199494 service placement] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:25:06.486191 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ceaf3-089a-42be-841b-50a10d1c17d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:25:06.486191 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ceaf3-089a-42be-841b-50a10d1c17d1 service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:25:06.486191 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ceaf3-089a-42be-841b-50a10d1c17d1 service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:25:06.486191 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ceaf3-089a-42be-841b-50a10d1c17d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:25:06.487963 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-896ceaf3-089a-42be-841b-50a10d1c17d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:25:06.499920 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ceaf3-089a-42be-841b-50a10d1c17d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:25:06.501525 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ceaf3-089a-42be-841b-50a10d1c17d1 service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:25:06.512719 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1322/2641] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:25:06 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:27:04.817578 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8c65d-1f5c-49f0-8b8c-0d7df2e76aed service nova] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:27:04.853415 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8c65d-1f5c-49f0-8b8c-0d7df2e76aed service nova] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:27:04.857190 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4661133-92d3-44f8-9828-9946fb45e4a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:27:04.857834 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4661133-92d3-44f8-9828-9946fb45e4a6 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:27:04.858118 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4661133-92d3-44f8-9828-9946fb45e4a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:27:04.858397 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4661133-92d3-44f8-9828-9946fb45e4a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:27:04.860137 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-a4661133-92d3-44f8-9828-9946fb45e4a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:27:04.936402 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4661133-92d3-44f8-9828-9946fb45e4a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:27:04.937851 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4661133-92d3-44f8-9828-9946fb45e4a6 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:27:04.946954 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1320/2642] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:27:04 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:27:05.869842 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ceaf3-089a-42be-841b-50a10d1c17d1 service nova] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:27:05.944068 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ceaf3-089a-42be-841b-50a10d1c17d1 service nova] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:27:05.950049 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87ec64-622e-4ebd-a93e-87fac9113d3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:27:05.953354 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87ec64-622e-4ebd-a93e-87fac9113d3c service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:27:05.953354 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87ec64-622e-4ebd-a93e-87fac9113d3c service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:27:05.953354 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87ec64-622e-4ebd-a93e-87fac9113d3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:27:05.953354 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-ee87ec64-622e-4ebd-a93e-87fac9113d3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:27:05.977165 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87ec64-622e-4ebd-a93e-87fac9113d3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:27:05.978652 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87ec64-622e-4ebd-a93e-87fac9113d3c service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:27:05.990123 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1323/2643] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:27:05 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:27:09.946860 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471f66d-fcd2-4902-aac6-8747624db94e None None] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:27:09.947303 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471f66d-fcd2-4902-aac6-8747624db94e None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:27:09.947408 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471f66d-fcd2-4902-aac6-8747624db94e None None] PATH_INFO: `/` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:27:09.949222 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1321/2644] 10.222.0.23 () {54 vars in 960 bytes} [Thu Sep 23 03:27:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 03:27:09.954482 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe6821-c2cb-4b47-9269-c598177ed2f0 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:27:09.954907 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe6821-c2cb-4b47-9269-c598177ed2f0 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:27:09.958271 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe6821-c2cb-4b47-9269-c598177ed2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:27:10.012159 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-08fe6821-c2cb-4b47-9269-c598177ed2f0 None None] MFA Rules not processed for user `58b7e780a23e4ee499cb7820a85feccb`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:27:10.013327 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-08fe6821-c2cb-4b47-9269-c598177ed2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:27:10.031834 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1324/2645] 10.222.0.23 () {58 vars in 1058 bytes} [Thu Sep 23 03:27:09 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:27:10.042308 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471f66d-fcd2-4902-aac6-8747624db94e None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:27:10.056268 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471f66d-fcd2-4902-aac6-8747624db94e None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:27:10.061277 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a818888-8b17-48b0-b8f3-f1996b07c8f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b7e780a23e4ee499cb7820a85feccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:27:10.066663 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a818888-8b17-48b0-b8f3-f1996b07c8f0 service placement] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:27:10.066663 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a818888-8b17-48b0-b8f3-f1996b07c8f0 service placement] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:27:10.066663 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a818888-8b17-48b0-b8f3-f1996b07c8f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:27:10.066663 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-0a818888-8b17-48b0-b8f3-f1996b07c8f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:27:10.075379 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a818888-8b17-48b0-b8f3-f1996b07c8f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:27:10.077031 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a818888-8b17-48b0-b8f3-f1996b07c8f0 service placement] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:27:10.087484 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1322/2646] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:27:10 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:27:12.327417 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe6821-c2cb-4b47-9269-c598177ed2f0 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:27:12.328989 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-08fe6821-c2cb-4b47-9269-c598177ed2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:27:12.353110 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe6821-c2cb-4b47-9269-c598177ed2f0 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:27:12.356980 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03dcfd-7c58-4c43-9d48-8d625dc87acc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:27:12.367143 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03dcfd-7c58-4c43-9d48-8d625dc87acc service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:27:12.367143 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03dcfd-7c58-4c43-9d48-8d625dc87acc service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:27:12.367143 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03dcfd-7c58-4c43-9d48-8d625dc87acc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:27:12.367143 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-5a03dcfd-7c58-4c43-9d48-8d625dc87acc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:27:12.392291 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03dcfd-7c58-4c43-9d48-8d625dc87acc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:27:12.393781 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03dcfd-7c58-4c43-9d48-8d625dc87acc service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:27:12.412336 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1325/2647] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:27:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:27:20.023036 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a818888-8b17-48b0-b8f3-f1996b07c8f0 service placement] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:27:20.024692 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-0a818888-8b17-48b0-b8f3-f1996b07c8f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:27:20.039424 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a818888-8b17-48b0-b8f3-f1996b07c8f0 service placement] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:27:20.043996 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d645a-b2d0-4077-9f24-c840049f8190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:27:20.044838 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d645a-b2d0-4077-9f24-c840049f8190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:27:20.045143 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d645a-b2d0-4077-9f24-c840049f8190 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:27:20.045419 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d645a-b2d0-4077-9f24-c840049f8190 admin admin] PATH_INFO: `/v3/users/e083df39fb8c475ab468e84c6134c764` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:27:20.046581 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d645a-b2d0-4077-9f24-c840049f8190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e083df39fb8c475ab468e84c6134c764)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:27:20.048467 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d645a-b2d0-4077-9f24-c840049f8190 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:27:20.232591 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-896d645a-b2d0-4077-9f24-c840049f8190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e083df39fb8c475ab468e84c6134c764'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:27:20.233265 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-896d645a-b2d0-4077-9f24-c840049f8190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e083df39fb8c475ab468e84c6134c764'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:27:20.239676 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-896d645a-b2d0-4077-9f24-c840049f8190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e083df39fb8c475ab468e84c6134c764'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:27:20.326816 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-896d645a-b2d0-4077-9f24-c840049f8190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e083df39fb8c475ab468e84c6134c764'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:27:20.340710 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-896d645a-b2d0-4077-9f24-c840049f8190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e083df39fb8c475ab468e84c6134c764'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:27:20.346619 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1323/2648] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:27:20 2021] DELETE /identity/v3/users/e083df39fb8c475ab468e84c6134c764 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:27:20.604910 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03dcfd-7c58-4c43-9d48-8d625dc87acc service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:27:20.614616 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03dcfd-7c58-4c43-9d48-8d625dc87acc service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:27:20.669406 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157db1f-7a37-4105-9134-71a67f11d790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:27:20.670266 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157db1f-7a37-4105-9134-71a67f11d790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:27:20.670549 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157db1f-7a37-4105-9134-71a67f11d790 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:27:20.670827 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157db1f-7a37-4105-9134-71a67f11d790 admin admin] PATH_INFO: `/v3/projects/6c9295094fe94cc69e88db5d29658b1b` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:27:20.672002 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157db1f-7a37-4105-9134-71a67f11d790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c9295094fe94cc69e88db5d29658b1b)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:27:20.673976 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157db1f-7a37-4105-9134-71a67f11d790 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:27:20.784584 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e157db1f-7a37-4105-9134-71a67f11d790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c9295094fe94cc69e88db5d29658b1b', 'request_id': 'req-e157db1f-7a37-4105-9134-71a67f11d790'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:27:20.842348 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e157db1f-7a37-4105-9134-71a67f11d790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c9295094fe94cc69e88db5d29658b1b', 'request_id': 'req-e157db1f-7a37-4105-9134-71a67f11d790'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:27:20.848346 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e157db1f-7a37-4105-9134-71a67f11d790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c9295094fe94cc69e88db5d29658b1b', 'request_id': 'req-e157db1f-7a37-4105-9134-71a67f11d790'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:27:20.859500 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e157db1f-7a37-4105-9134-71a67f11d790 admin admin] The token cache is being invalidate because project 6c9295094fe94cc69e88db5d29658b1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:27:20.859806 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e157db1f-7a37-4105-9134-71a67f11d790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:27:20.860428 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e157db1f-7a37-4105-9134-71a67f11d790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:27:20.862006 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1326/2649] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:27:20 2021] DELETE /identity/v3/projects/6c9295094fe94cc69e88db5d29658b1b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:27:20.866494 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d645a-b2d0-4077-9f24-c840049f8190 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:27:20.867972 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-896d645a-b2d0-4077-9f24-c840049f8190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:27:20.893668 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d645a-b2d0-4077-9f24-c840049f8190 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:27:20.937718 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f78091-094a-4fbd-81a4-22821b646e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:27:20.938600 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f78091-094a-4fbd-81a4-22821b646e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:27:20.938882 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f78091-094a-4fbd-81a4-22821b646e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:27:20.939157 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f78091-094a-4fbd-81a4-22821b646e5e admin admin] PATH_INFO: `/v3/users/be1f83167fbc41e3bd9dce3dcb2144f9` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:27:20.940339 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f78091-094a-4fbd-81a4-22821b646e5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=be1f83167fbc41e3bd9dce3dcb2144f9)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:27:20.942279 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f78091-094a-4fbd-81a4-22821b646e5e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:27:21.090789 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-c8f78091-094a-4fbd-81a4-22821b646e5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be1f83167fbc41e3bd9dce3dcb2144f9'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:27:21.091908 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-c8f78091-094a-4fbd-81a4-22821b646e5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be1f83167fbc41e3bd9dce3dcb2144f9'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:27:21.099096 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-c8f78091-094a-4fbd-81a4-22821b646e5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be1f83167fbc41e3bd9dce3dcb2144f9'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:27:21.145687 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-c8f78091-094a-4fbd-81a4-22821b646e5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be1f83167fbc41e3bd9dce3dcb2144f9'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:27:21.158192 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-c8f78091-094a-4fbd-81a4-22821b646e5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be1f83167fbc41e3bd9dce3dcb2144f9'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:27:21.164092 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1324/2650] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:27:20 2021] DELETE /identity/v3/users/be1f83167fbc41e3bd9dce3dcb2144f9 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:27:21.421856 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157db1f-7a37-4105-9134-71a67f11d790 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:27:21.423365 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-e157db1f-7a37-4105-9134-71a67f11d790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:27:21.436813 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157db1f-7a37-4105-9134-71a67f11d790 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:27:21.492646 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a396c-3952-491a-927d-11fc7c29afa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:27:21.493510 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a396c-3952-491a-927d-11fc7c29afa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:27:21.493795 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a396c-3952-491a-927d-11fc7c29afa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:27:21.494073 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a396c-3952-491a-927d-11fc7c29afa0 admin admin] PATH_INFO: `/v3/projects/c2cc9420de8f40cfbed777f55b86e5d9` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:27:21.495242 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a396c-3952-491a-927d-11fc7c29afa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2cc9420de8f40cfbed777f55b86e5d9)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:27:21.497199 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a396c-3952-491a-927d-11fc7c29afa0 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:27:21.614555 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-002a396c-3952-491a-927d-11fc7c29afa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2cc9420de8f40cfbed777f55b86e5d9', 'request_id': 'req-002a396c-3952-491a-927d-11fc7c29afa0'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:27:21.705881 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-002a396c-3952-491a-927d-11fc7c29afa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2cc9420de8f40cfbed777f55b86e5d9', 'request_id': 'req-002a396c-3952-491a-927d-11fc7c29afa0'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:27:21.712330 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-002a396c-3952-491a-927d-11fc7c29afa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2cc9420de8f40cfbed777f55b86e5d9', 'request_id': 'req-002a396c-3952-491a-927d-11fc7c29afa0'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:27:21.723452 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-002a396c-3952-491a-927d-11fc7c29afa0 admin admin] The token cache is being invalidate because project c2cc9420de8f40cfbed777f55b86e5d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:27:21.723891 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-002a396c-3952-491a-927d-11fc7c29afa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:27:21.724388 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-002a396c-3952-491a-927d-11fc7c29afa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:27:21.726532 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1327/2651] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:27:21 2021] DELETE /identity/v3/projects/c2cc9420de8f40cfbed777f55b86e5d9 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:27:57.345965 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f78091-094a-4fbd-81a4-22821b646e5e admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:27:57.347735 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-c8f78091-094a-4fbd-81a4-22821b646e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:27:57.404425 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f78091-094a-4fbd-81a4-22821b646e5e admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:27:57.450620 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39238ef6-0abf-4273-bc2e-a074e1cc2aa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:27:57.451274 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39238ef6-0abf-4273-bc2e-a074e1cc2aa5 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:27:57.451562 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39238ef6-0abf-4273-bc2e-a074e1cc2aa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:27:57.451842 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39238ef6-0abf-4273-bc2e-a074e1cc2aa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:27:57.453629 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-39238ef6-0abf-4273-bc2e-a074e1cc2aa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:27:57.518810 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39238ef6-0abf-4273-bc2e-a074e1cc2aa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:27:57.520751 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39238ef6-0abf-4273-bc2e-a074e1cc2aa5 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:27:57.531781 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1325/2652] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:27:57 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:27:59.056826 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a396c-3952-491a-927d-11fc7c29afa0 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:27:59.058285 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-002a396c-3952-491a-927d-11fc7c29afa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:27:59.071107 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a396c-3952-491a-927d-11fc7c29afa0 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:27:59.074703 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2e174-084e-4927-9b29-d95eeae7b9c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:27:59.075355 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2e174-084e-4927-9b29-d95eeae7b9c6 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:27:59.075638 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2e174-084e-4927-9b29-d95eeae7b9c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:27:59.075916 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2e174-084e-4927-9b29-d95eeae7b9c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:27:59.077674 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-eda2e174-084e-4927-9b29-d95eeae7b9c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:27:59.092057 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2e174-084e-4927-9b29-d95eeae7b9c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:27:59.093530 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2e174-084e-4927-9b29-d95eeae7b9c6 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:27:59.105923 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1328/2653] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:27:59 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:28:17.058713 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39238ef6-0abf-4273-bc2e-a074e1cc2aa5 service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:28:17.067448 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39238ef6-0abf-4273-bc2e-a074e1cc2aa5 service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:28:17.071809 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebd49c-0a06-4cde-b854-041b3217ef0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:28:17.072401 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebd49c-0a06-4cde-b854-041b3217ef0b service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:28:17.072724 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebd49c-0a06-4cde-b854-041b3217ef0b service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:28:17.073007 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebd49c-0a06-4cde-b854-041b3217ef0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:28:17.074804 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-a5ebd49c-0a06-4cde-b854-041b3217ef0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:28:17.084100 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ebd49c-0a06-4cde-b854-041b3217ef0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:28:17.085564 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ebd49c-0a06-4cde-b854-041b3217ef0b service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:28:17.093323 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1326/2654] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:28:17 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:29:12.461488 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43577860-cdd5-40b0-944f-0418b4689efc None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:29:12.462006 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43577860-cdd5-40b0-944f-0418b4689efc None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:29:12.462113 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43577860-cdd5-40b0-944f-0418b4689efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:29:12.480297 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-43577860-cdd5-40b0-944f-0418b4689efc None None] MFA Rules not processed for user `2700498241084d4aa4099e8034fbeb94`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:29:12.483084 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-43577860-cdd5-40b0-944f-0418b4689efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:29:12.536548 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1329/2655] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:29:12 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:29:12.833891 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebd49c-0a06-4cde-b854-041b3217ef0b service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:29:12.842286 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebd49c-0a06-4cde-b854-041b3217ef0b service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:29:12.846165 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfd56c-b5a1-46ca-90ee-7b95c50837de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:29:12.846809 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfd56c-b5a1-46ca-90ee-7b95c50837de service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:29:12.847093 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfd56c-b5a1-46ca-90ee-7b95c50837de service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:29:12.847371 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfd56c-b5a1-46ca-90ee-7b95c50837de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:29:12.849664 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-33dfd56c-b5a1-46ca-90ee-7b95c50837de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:29:12.858759 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfd56c-b5a1-46ca-90ee-7b95c50837de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:29:12.860171 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfd56c-b5a1-46ca-90ee-7b95c50837de service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:29:12.868440 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1327/2656] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:29:12 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:29:38.358743 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43577860-cdd5-40b0-944f-0418b4689efc None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:29:38.360142 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-43577860-cdd5-40b0-944f-0418b4689efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:29:38.375880 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43577860-cdd5-40b0-944f-0418b4689efc None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:29:38.381811 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cba865-e4ad-444a-ae5e-c2701e415791 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:29:38.382494 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cba865-e4ad-444a-ae5e-c2701e415791 service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:29:38.382776 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cba865-e4ad-444a-ae5e-c2701e415791 service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:29:38.383069 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cba865-e4ad-444a-ae5e-c2701e415791 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:29:38.384770 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-04cba865-e4ad-444a-ae5e-c2701e415791 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:29:38.397646 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cba865-e4ad-444a-ae5e-c2701e415791 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:29:38.397869 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cba865-e4ad-444a-ae5e-c2701e415791 service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:29:38.406956 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1330/2657] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:29:38 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:31:27.220861 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfd56c-b5a1-46ca-90ee-7b95c50837de service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:27.234117 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfd56c-b5a1-46ca-90ee-7b95c50837de service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:27.239682 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fcb8c1-398d-4d15-89a0-4e3e8d3b18b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:27.240344 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcb8c1-398d-4d15-89a0-4e3e8d3b18b5 service nova] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:27.240665 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcb8c1-398d-4d15-89a0-4e3e8d3b18b5 service nova] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:27.240974 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcb8c1-398d-4d15-89a0-4e3e8d3b18b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:27.242745 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-49fcb8c1-398d-4d15-89a0-4e3e8d3b18b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:27.255315 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fcb8c1-398d-4d15-89a0-4e3e8d3b18b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:27.257011 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fcb8c1-398d-4d15-89a0-4e3e8d3b18b5 service nova] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:27.268723 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1328/2658] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:31:27 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:31:33.544361 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cba865-e4ad-444a-ae5e-c2701e415791 service nova] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:33.545935 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-04cba865-e4ad-444a-ae5e-c2701e415791 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:33.557342 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cba865-e4ad-444a-ae5e-c2701e415791 service nova] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:33.560862 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fdb56b-ca41-41ae-8593-da75ebc57b54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:33.562003 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdb56b-ca41-41ae-8593-da75ebc57b54 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:33.562308 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdb56b-ca41-41ae-8593-da75ebc57b54 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:33.562584 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdb56b-ca41-41ae-8593-da75ebc57b54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:33.564245 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-58fdb56b-ca41-41ae-8593-da75ebc57b54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:33.623455 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fdb56b-ca41-41ae-8593-da75ebc57b54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:33.625424 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fdb56b-ca41-41ae-8593-da75ebc57b54 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:33.634766 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1331/2659] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:31:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:31:37.282274 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fcb8c1-398d-4d15-89a0-4e3e8d3b18b5 service nova] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:37.284348 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-49fcb8c1-398d-4d15-89a0-4e3e8d3b18b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:37.299581 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fcb8c1-398d-4d15-89a0-4e3e8d3b18b5 service nova] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:37.304213 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92cf439-7c47-42bd-bd15-bd512ba438cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:37.306547 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cf439-7c47-42bd-bd15-bd512ba438cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:37.306547 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cf439-7c47-42bd-bd15-bd512ba438cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:37.306547 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cf439-7c47-42bd-bd15-bd512ba438cd admin admin] PATH_INFO: `/v3/users/2700498241084d4aa4099e8034fbeb94` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:37.306834 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92cf439-7c47-42bd-bd15-bd512ba438cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2700498241084d4aa4099e8034fbeb94)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:37.308757 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92cf439-7c47-42bd-bd15-bd512ba438cd admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:37.464924 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-a92cf439-7c47-42bd-bd15-bd512ba438cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2700498241084d4aa4099e8034fbeb94'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:37.465510 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-a92cf439-7c47-42bd-bd15-bd512ba438cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2700498241084d4aa4099e8034fbeb94'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:37.473085 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-a92cf439-7c47-42bd-bd15-bd512ba438cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2700498241084d4aa4099e8034fbeb94'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:37.527995 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-a92cf439-7c47-42bd-bd15-bd512ba438cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2700498241084d4aa4099e8034fbeb94'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:37.539634 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-a92cf439-7c47-42bd-bd15-bd512ba438cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2700498241084d4aa4099e8034fbeb94'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:37.545514 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1329/2660] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:31:37 2021] DELETE /identity/v3/users/2700498241084d4aa4099e8034fbeb94 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:31:37.792565 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fdb56b-ca41-41ae-8593-da75ebc57b54 service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:37.804955 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fdb56b-ca41-41ae-8593-da75ebc57b54 service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:37.864864 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d090ae-80dc-40a5-a402-2f34e70c5d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:37.865720 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d090ae-80dc-40a5-a402-2f34e70c5d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:37.866012 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d090ae-80dc-40a5-a402-2f34e70c5d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:37.866268 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d090ae-80dc-40a5-a402-2f34e70c5d51 admin admin] PATH_INFO: `/v3/projects/976c473ab2634adaa47c36dca50bf392` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:37.867425 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d090ae-80dc-40a5-a402-2f34e70c5d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=976c473ab2634adaa47c36dca50bf392)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:37.869336 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d090ae-80dc-40a5-a402-2f34e70c5d51 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:37.978500 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e4d090ae-80dc-40a5-a402-2f34e70c5d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '976c473ab2634adaa47c36dca50bf392', 'request_id': 'req-e4d090ae-80dc-40a5-a402-2f34e70c5d51'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:38.053185 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e4d090ae-80dc-40a5-a402-2f34e70c5d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '976c473ab2634adaa47c36dca50bf392', 'request_id': 'req-e4d090ae-80dc-40a5-a402-2f34e70c5d51'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:38.058505 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e4d090ae-80dc-40a5-a402-2f34e70c5d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '976c473ab2634adaa47c36dca50bf392', 'request_id': 'req-e4d090ae-80dc-40a5-a402-2f34e70c5d51'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:38.070263 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e4d090ae-80dc-40a5-a402-2f34e70c5d51 admin admin] The token cache is being invalidate because project 976c473ab2634adaa47c36dca50bf392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:31:38.074130 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e4d090ae-80dc-40a5-a402-2f34e70c5d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:38.074130 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-e4d090ae-80dc-40a5-a402-2f34e70c5d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:38.074130 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1332/2661] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:31:37 2021] DELETE /identity/v3/projects/976c473ab2634adaa47c36dca50bf392 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:31:38.082450 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c4d81-b842-4d81-8654-206dee60795a None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:38.082743 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c4d81-b842-4d81-8654-206dee60795a None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:38.083025 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c4d81-b842-4d81-8654-206dee60795a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:38.128933 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-c47c4d81-b842-4d81-8654-206dee60795a None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:31:38.130128 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-c47c4d81-b842-4d81-8654-206dee60795a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:38.185755 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1330/2662] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:31:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:31:38.193819 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e0f5a-d19d-4064-870f-954e1018f8d3 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:38.194105 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e0f5a-d19d-4064-870f-954e1018f8d3 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:38.194383 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e0f5a-d19d-4064-870f-954e1018f8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:38.212057 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-219e0f5a-d19d-4064-870f-954e1018f8d3 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:31:38.213293 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-219e0f5a-d19d-4064-870f-954e1018f8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:38.221887 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1333/2663] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:31:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:31:38.225962 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c4d81-b842-4d81-8654-206dee60795a None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:38.236714 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c4d81-b842-4d81-8654-206dee60795a None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:38.241272 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedb5ff-dbda-48c2-87db-64f7d85be9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:38.241927 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedb5ff-dbda-48c2-87db-64f7d85be9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:38.242208 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedb5ff-dbda-48c2-87db-64f7d85be9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:38.242484 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedb5ff-dbda-48c2-87db-64f7d85be9c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:38.243195 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdedb5ff-dbda-48c2-87db-64f7d85be9c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:31:38.243503 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdedb5ff-dbda-48c2-87db-64f7d85be9c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:38.245120 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdedb5ff-dbda-48c2-87db-64f7d85be9c0 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:38.256256 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1331/2664] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:31:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 03:31:38.260538 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e0f5a-d19d-4064-870f-954e1018f8d3 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:38.269699 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e0f5a-d19d-4064-870f-954e1018f8d3 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:38.274476 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c49a18-0341-4ad8-b07f-11bd7a536558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:38.275091 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c49a18-0341-4ad8-b07f-11bd7a536558 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:38.275373 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c49a18-0341-4ad8-b07f-11bd7a536558 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:38.275647 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c49a18-0341-4ad8-b07f-11bd7a536558 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:38.276337 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c49a18-0341-4ad8-b07f-11bd7a536558 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:38.278255 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c49a18-0341-4ad8-b07f-11bd7a536558 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:38.410575 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1334/2665] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:31:38 2021] POST /identity/v3/projects => generated 405 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:31:38.414506 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedb5ff-dbda-48c2-87db-64f7d85be9c0 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:38.424632 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedb5ff-dbda-48c2-87db-64f7d85be9c0 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:38.477949 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba094d-d4d8-4e23-820c-28ae0a8953b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:38.478615 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba094d-d4d8-4e23-820c-28ae0a8953b2 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:38.478901 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba094d-d4d8-4e23-820c-28ae0a8953b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:38.479176 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba094d-d4d8-4e23-820c-28ae0a8953b2 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:38.479862 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba094d-d4d8-4e23-820c-28ae0a8953b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:38.481787 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba094d-d4d8-4e23-820c-28ae0a8953b2 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:38.613769 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1332/2666] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:31:38 2021] POST /identity/v3/users => generated 303 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:31:38.617693 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c49a18-0341-4ad8-b07f-11bd7a536558 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:38.628605 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c49a18-0341-4ad8-b07f-11bd7a536558 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:38.633263 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b023a6-cbf8-478c-af97-fc272fd191eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:38.633922 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b023a6-cbf8-478c-af97-fc272fd191eb admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:38.634204 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b023a6-cbf8-478c-af97-fc272fd191eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:38.634478 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b023a6-cbf8-478c-af97-fc272fd191eb admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:38.635197 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b023a6-cbf8-478c-af97-fc272fd191eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:38.636813 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b023a6-cbf8-478c-af97-fc272fd191eb admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:38.646480 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1335/2667] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:31:38 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:31:38.650459 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba094d-d4d8-4e23-820c-28ae0a8953b2 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:38.660175 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba094d-d4d8-4e23-820c-28ae0a8953b2 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:38.664844 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0bb83-15a4-4710-8029-63d2c8467136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:38.665447 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0bb83-15a4-4710-8029-63d2c8467136 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:38.665730 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0bb83-15a4-4710-8029-63d2c8467136 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:38.666008 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0bb83-15a4-4710-8029-63d2c8467136 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:38.666758 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0bb83-15a4-4710-8029-63d2c8467136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:38.668337 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0bb83-15a4-4710-8029-63d2c8467136 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:38.678435 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1333/2668] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:31:38 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:31:38.684211 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b023a6-cbf8-478c-af97-fc272fd191eb admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:38.694603 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b023a6-cbf8-478c-af97-fc272fd191eb admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:38.699161 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37f093-7a0a-43dc-9352-a34d22e11508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:38.700031 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37f093-7a0a-43dc-9352-a34d22e11508 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:38.700314 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37f093-7a0a-43dc-9352-a34d22e11508 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:38.700621 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37f093-7a0a-43dc-9352-a34d22e11508 admin admin] PATH_INFO: `/v3/projects/2365dde9262a45a3ae847a270e9b4b2b/users/b5293befe9d74bbda39aafe9b925ec28/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:38.714837 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37f093-7a0a-43dc-9352-a34d22e11508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2365dde9262a45a3ae847a270e9b4b2b, user_id=b5293befe9d74bbda39aafe9b925ec28, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:38.717786 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37f093-7a0a-43dc-9352-a34d22e11508 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:38.795576 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1336/2669] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:31:38 2021] PUT /identity/v3/projects/2365dde9262a45a3ae847a270e9b4b2b/users/b5293befe9d74bbda39aafe9b925ec28/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:31:38.806584 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ac79c-e7c9-455f-b578-5abec8251a44 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:38.808847 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ac79c-e7c9-455f-b578-5abec8251a44 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:38.808847 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ac79c-e7c9-455f-b578-5abec8251a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:38.834239 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-2a3ac79c-e7c9-455f-b578-5abec8251a44 None None] MFA Rules not processed for user `b5293befe9d74bbda39aafe9b925ec28`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:31:38.835448 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-2a3ac79c-e7c9-455f-b578-5abec8251a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:38.896859 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1334/2670] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:31:38 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:31:38.901303 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37f093-7a0a-43dc-9352-a34d22e11508 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:38.961686 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37f093-7a0a-43dc-9352-a34d22e11508 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:38.966207 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4195f1-c528-4ef5-8c1d-d45fa516680e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:38.967108 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4195f1-c528-4ef5-8c1d-d45fa516680e admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:38.967914 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4195f1-c528-4ef5-8c1d-d45fa516680e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:38.968187 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4195f1-c528-4ef5-8c1d-d45fa516680e admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:38.968913 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4195f1-c528-4ef5-8c1d-d45fa516680e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:38.970788 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4195f1-c528-4ef5-8c1d-d45fa516680e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:39.054790 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1337/2671] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:31:38 2021] POST /identity/v3/projects => generated 405 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:31:39.058787 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ac79c-e7c9-455f-b578-5abec8251a44 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:39.069500 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ac79c-e7c9-455f-b578-5abec8251a44 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:39.138182 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598984ce-18a1-4e55-89e9-74abe13bf644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:39.138863 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598984ce-18a1-4e55-89e9-74abe13bf644 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:39.139784 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598984ce-18a1-4e55-89e9-74abe13bf644 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:39.140075 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598984ce-18a1-4e55-89e9-74abe13bf644 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:39.140831 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598984ce-18a1-4e55-89e9-74abe13bf644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:39.142759 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598984ce-18a1-4e55-89e9-74abe13bf644 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:39.228374 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1335/2672] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:31:39 2021] POST /identity/v3/users => generated 309 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:31:39.229475 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4195f1-c528-4ef5-8c1d-d45fa516680e admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:39.243040 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4195f1-c528-4ef5-8c1d-d45fa516680e admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:39.248745 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e152db-7cea-4780-9358-79dbd6c81baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:39.249555 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e152db-7cea-4780-9358-79dbd6c81baf admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:39.249836 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e152db-7cea-4780-9358-79dbd6c81baf admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:39.250116 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e152db-7cea-4780-9358-79dbd6c81baf admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:39.250872 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e152db-7cea-4780-9358-79dbd6c81baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:39.252541 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e152db-7cea-4780-9358-79dbd6c81baf admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:39.263604 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1338/2673] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:31:39 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:31:39.268289 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598984ce-18a1-4e55-89e9-74abe13bf644 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:39.278151 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598984ce-18a1-4e55-89e9-74abe13bf644 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:39.283332 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931e67d-cb51-4b81-9235-af7e99720f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:39.284204 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931e67d-cb51-4b81-9235-af7e99720f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:39.284482 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931e67d-cb51-4b81-9235-af7e99720f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:39.284811 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931e67d-cb51-4b81-9235-af7e99720f2c admin admin] PATH_INFO: `/v3/projects/000b675c5cb54b5cb589c279ad53b2d7/users/bd16813da05247e199d3ec261d8265e3/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:39.300341 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931e67d-cb51-4b81-9235-af7e99720f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=000b675c5cb54b5cb589c279ad53b2d7, user_id=bd16813da05247e199d3ec261d8265e3, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:39.303003 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931e67d-cb51-4b81-9235-af7e99720f2c admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:39.396887 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1336/2674] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:31:39 2021] PUT /identity/v3/projects/000b675c5cb54b5cb589c279ad53b2d7/users/bd16813da05247e199d3ec261d8265e3/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:31:39.400969 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e152db-7cea-4780-9358-79dbd6c81baf admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:39.411436 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e152db-7cea-4780-9358-79dbd6c81baf admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:39.465506 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdf497-c7a3-4595-b197-c53c8f2df7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:39.466169 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdf497-c7a3-4595-b197-c53c8f2df7fc admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:39.466706 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdf497-c7a3-4595-b197-c53c8f2df7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:39.466986 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdf497-c7a3-4595-b197-c53c8f2df7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:39.467776 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdf497-c7a3-4595-b197-c53c8f2df7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:39.469418 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdf497-c7a3-4595-b197-c53c8f2df7fc admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:39.478799 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1339/2675] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:31:39 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:31:39.482750 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931e67d-cb51-4b81-9235-af7e99720f2c admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:39.493428 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931e67d-cb51-4b81-9235-af7e99720f2c admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:39.498422 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167c780-119a-4f4b-9875-0c4fb79e5152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:39.499881 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167c780-119a-4f4b-9875-0c4fb79e5152 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:39.500161 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167c780-119a-4f4b-9875-0c4fb79e5152 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:39.500435 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167c780-119a-4f4b-9875-0c4fb79e5152 admin admin] PATH_INFO: `/v3/projects/000b675c5cb54b5cb589c279ad53b2d7/users/bd16813da05247e199d3ec261d8265e3/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:39.502402 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167c780-119a-4f4b-9875-0c4fb79e5152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=000b675c5cb54b5cb589c279ad53b2d7, user_id=bd16813da05247e199d3ec261d8265e3, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:39.505032 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167c780-119a-4f4b-9875-0c4fb79e5152 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:39.514674 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1337/2676] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:31:39 2021] PUT /identity/v3/projects/000b675c5cb54b5cb589c279ad53b2d7/users/bd16813da05247e199d3ec261d8265e3/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:31:39.524212 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e1e5c-0523-4309-ac14-0a3a0a508436 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:39.524533 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e1e5c-0523-4309-ac14-0a3a0a508436 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:39.524821 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e1e5c-0523-4309-ac14-0a3a0a508436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:39.551050 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-b98e1e5c-0523-4309-ac14-0a3a0a508436 None None] MFA Rules not processed for user `bd16813da05247e199d3ec261d8265e3`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:31:39.552247 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-b98e1e5c-0523-4309-ac14-0a3a0a508436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:39.616342 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1340/2677] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:31:39 2021] POST /identity/v3/auth/tokens => generated 3492 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:31:39.626161 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167c780-119a-4f4b-9875-0c4fb79e5152 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:39.627881 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-5167c780-119a-4f4b-9875-0c4fb79e5152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:39.702509 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167c780-119a-4f4b-9875-0c4fb79e5152 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:39.706155 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7b015-c00f-4dec-8ecf-d8e1ec75c314 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:39.706799 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7b015-c00f-4dec-8ecf-d8e1ec75c314 service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:39.707084 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7b015-c00f-4dec-8ecf-d8e1ec75c314 service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:39.707358 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7b015-c00f-4dec-8ecf-d8e1ec75c314 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:39.716068 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7b015-c00f-4dec-8ecf-d8e1ec75c314 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:39.718298 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7b015-c00f-4dec-8ecf-d8e1ec75c314 service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:39.728085 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1338/2678] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:31:39 2021] GET /identity/v3/auth/tokens => generated 3492 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:31:39.867954 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e1e5c-0523-4309-ac14-0a3a0a508436 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:39.927103 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e1e5c-0523-4309-ac14-0a3a0a508436 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:39.931627 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c7e14-36dc-4959-9dd5-2f33e75f82f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:39.932512 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c7e14-36dc-4959-9dd5-2f33e75f82f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:39.932809 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c7e14-36dc-4959-9dd5-2f33e75f82f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:39.933090 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c7e14-36dc-4959-9dd5-2f33e75f82f2 admin admin] PATH_INFO: `/v3/users/b5293befe9d74bbda39aafe9b925ec28` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:39.934275 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c7e14-36dc-4959-9dd5-2f33e75f82f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5293befe9d74bbda39aafe9b925ec28)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:39.936189 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c7e14-36dc-4959-9dd5-2f33e75f82f2 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:40.123038 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-746c7e14-36dc-4959-9dd5-2f33e75f82f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5293befe9d74bbda39aafe9b925ec28'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:40.123691 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-746c7e14-36dc-4959-9dd5-2f33e75f82f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5293befe9d74bbda39aafe9b925ec28'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:40.124413 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-746c7e14-36dc-4959-9dd5-2f33e75f82f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5293befe9d74bbda39aafe9b925ec28'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:40.131087 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-746c7e14-36dc-4959-9dd5-2f33e75f82f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5293befe9d74bbda39aafe9b925ec28'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:40.195976 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-746c7e14-36dc-4959-9dd5-2f33e75f82f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5293befe9d74bbda39aafe9b925ec28'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:40.212917 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1341/2679] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:31:39 2021] DELETE /identity/v3/users/b5293befe9d74bbda39aafe9b925ec28 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:31:40.218355 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598c978-859a-4872-8c78-51acb61e4728 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:40.218638 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598c978-859a-4872-8c78-51acb61e4728 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:40.218914 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598c978-859a-4872-8c78-51acb61e4728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:40.235288 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-4598c978-859a-4872-8c78-51acb61e4728 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:31:40.236470 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-4598c978-859a-4872-8c78-51acb61e4728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:40.292538 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1339/2680] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:31:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:31:40.302920 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c7e14-36dc-4959-9dd5-2f33e75f82f2 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:40.304299 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-746c7e14-36dc-4959-9dd5-2f33e75f82f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:40.360133 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c7e14-36dc-4959-9dd5-2f33e75f82f2 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:40.363787 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151de7e-9878-4433-b957-9ceb8ad7d640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:40.364423 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151de7e-9878-4433-b957-9ceb8ad7d640 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:40.364748 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151de7e-9878-4433-b957-9ceb8ad7d640 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:40.365006 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151de7e-9878-4433-b957-9ceb8ad7d640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:40.374266 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151de7e-9878-4433-b957-9ceb8ad7d640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:40.375621 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151de7e-9878-4433-b957-9ceb8ad7d640 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:40.384734 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1342/2681] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:31:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:31:40.826729 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598c978-859a-4872-8c78-51acb61e4728 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:40.828167 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-4598c978-859a-4872-8c78-51acb61e4728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:40.841266 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598c978-859a-4872-8c78-51acb61e4728 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:40.846158 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9771d9-e100-4d4b-a410-d24723a93ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:40.847021 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9771d9-e100-4d4b-a410-d24723a93ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:40.847299 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9771d9-e100-4d4b-a410-d24723a93ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:40.847571 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9771d9-e100-4d4b-a410-d24723a93ac2 admin admin] PATH_INFO: `/v3/projects/2365dde9262a45a3ae847a270e9b4b2b` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:40.848775 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9771d9-e100-4d4b-a410-d24723a93ac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2365dde9262a45a3ae847a270e9b4b2b)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:40.850660 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9771d9-e100-4d4b-a410-d24723a93ac2 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:40.938554 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-8c9771d9-e100-4d4b-a410-d24723a93ac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2365dde9262a45a3ae847a270e9b4b2b', 'request_id': 'req-8c9771d9-e100-4d4b-a410-d24723a93ac2'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:41.013301 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-8c9771d9-e100-4d4b-a410-d24723a93ac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2365dde9262a45a3ae847a270e9b4b2b', 'request_id': 'req-8c9771d9-e100-4d4b-a410-d24723a93ac2'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:41.019100 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-8c9771d9-e100-4d4b-a410-d24723a93ac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2365dde9262a45a3ae847a270e9b4b2b', 'request_id': 'req-8c9771d9-e100-4d4b-a410-d24723a93ac2'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:41.030407 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-8c9771d9-e100-4d4b-a410-d24723a93ac2 admin admin] The token cache is being invalidate because project 2365dde9262a45a3ae847a270e9b4b2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:31:41.030691 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-8c9771d9-e100-4d4b-a410-d24723a93ac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:41.031314 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-8c9771d9-e100-4d4b-a410-d24723a93ac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:41.032900 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1340/2682] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:31:40 2021] DELETE /identity/v3/projects/2365dde9262a45a3ae847a270e9b4b2b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:31:41.036848 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151de7e-9878-4433-b957-9ceb8ad7d640 service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:41.046863 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151de7e-9878-4433-b957-9ceb8ad7d640 service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:41.099978 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05616088-bf5e-4d82-b8b0-66221735adde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:41.101702 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05616088-bf5e-4d82-b8b0-66221735adde admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:41.101702 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05616088-bf5e-4d82-b8b0-66221735adde admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:41.101702 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05616088-bf5e-4d82-b8b0-66221735adde admin admin] PATH_INFO: `/v3/users/bd16813da05247e199d3ec261d8265e3` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:41.102555 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05616088-bf5e-4d82-b8b0-66221735adde admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd16813da05247e199d3ec261d8265e3)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:41.104447 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05616088-bf5e-4d82-b8b0-66221735adde admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:41.289580 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-05616088-bf5e-4d82-b8b0-66221735adde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd16813da05247e199d3ec261d8265e3'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:41.290229 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-05616088-bf5e-4d82-b8b0-66221735adde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd16813da05247e199d3ec261d8265e3'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:41.290837 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-05616088-bf5e-4d82-b8b0-66221735adde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd16813da05247e199d3ec261d8265e3'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:41.298109 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-05616088-bf5e-4d82-b8b0-66221735adde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd16813da05247e199d3ec261d8265e3'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:41.407645 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-05616088-bf5e-4d82-b8b0-66221735adde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd16813da05247e199d3ec261d8265e3'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:41.424353 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1343/2683] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:31:41 2021] DELETE /identity/v3/users/bd16813da05247e199d3ec261d8265e3 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:31:41.878635 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9771d9-e100-4d4b-a410-d24723a93ac2 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:41.880077 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-8c9771d9-e100-4d4b-a410-d24723a93ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:41.893376 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9771d9-e100-4d4b-a410-d24723a93ac2 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:41.948014 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec119da-d3c0-4066-8a5f-dcb8fd3ef378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:41.948909 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec119da-d3c0-4066-8a5f-dcb8fd3ef378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:41.949197 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec119da-d3c0-4066-8a5f-dcb8fd3ef378 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:41.949478 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec119da-d3c0-4066-8a5f-dcb8fd3ef378 admin admin] PATH_INFO: `/v3/projects/000b675c5cb54b5cb589c279ad53b2d7` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:41.950656 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec119da-d3c0-4066-8a5f-dcb8fd3ef378 admin admin] RBAC: Authorizing `identity:delete_project(project_id=000b675c5cb54b5cb589c279ad53b2d7)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:41.952568 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec119da-d3c0-4066-8a5f-dcb8fd3ef378 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:42.087122 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1ec119da-d3c0-4066-8a5f-dcb8fd3ef378 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '000b675c5cb54b5cb589c279ad53b2d7', 'request_id': 'req-1ec119da-d3c0-4066-8a5f-dcb8fd3ef378'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:42.167794 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1ec119da-d3c0-4066-8a5f-dcb8fd3ef378 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '000b675c5cb54b5cb589c279ad53b2d7', 'request_id': 'req-1ec119da-d3c0-4066-8a5f-dcb8fd3ef378'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:42.173268 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1ec119da-d3c0-4066-8a5f-dcb8fd3ef378 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '000b675c5cb54b5cb589c279ad53b2d7', 'request_id': 'req-1ec119da-d3c0-4066-8a5f-dcb8fd3ef378'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:42.183916 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1ec119da-d3c0-4066-8a5f-dcb8fd3ef378 admin admin] The token cache is being invalidate because project 000b675c5cb54b5cb589c279ad53b2d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:31:42.184277 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1ec119da-d3c0-4066-8a5f-dcb8fd3ef378 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:42.184930 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1ec119da-d3c0-4066-8a5f-dcb8fd3ef378 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:42.186480 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1341/2684] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:31:41 2021] DELETE /identity/v3/projects/000b675c5cb54b5cb589c279ad53b2d7 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:31:42.192220 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f734b-bb50-4c22-844e-2b7ef4c61c96 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:42.192754 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f734b-bb50-4c22-844e-2b7ef4c61c96 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:42.192860 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f734b-bb50-4c22-844e-2b7ef4c61c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:42.210842 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-ea0f734b-bb50-4c22-844e-2b7ef4c61c96 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:31:42.212017 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-ea0f734b-bb50-4c22-844e-2b7ef4c61c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:42.268807 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1344/2685] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:31:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:31:42.277711 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f70c8-7ab2-405d-a783-d48667c726aa None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:42.277711 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f70c8-7ab2-405d-a783-d48667c726aa None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:42.277711 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f70c8-7ab2-405d-a783-d48667c726aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:42.295598 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-e80f70c8-7ab2-405d-a783-d48667c726aa None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:31:42.296921 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-e80f70c8-7ab2-405d-a783-d48667c726aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:42.304892 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1342/2686] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:31:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:31:42.309025 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f734b-bb50-4c22-844e-2b7ef4c61c96 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:42.318477 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f734b-bb50-4c22-844e-2b7ef4c61c96 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:42.327933 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f2962-72c8-4b78-b2b8-23cc9fade39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:42.327933 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f2962-72c8-4b78-b2b8-23cc9fade39d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:42.327933 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f2962-72c8-4b78-b2b8-23cc9fade39d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:42.327933 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f2962-72c8-4b78-b2b8-23cc9fade39d admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:42.328351 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f2962-72c8-4b78-b2b8-23cc9fade39d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:31:42.328351 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f2962-72c8-4b78-b2b8-23cc9fade39d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:42.328351 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f2962-72c8-4b78-b2b8-23cc9fade39d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:42.338555 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1345/2687] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:31:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 03:31:42.342955 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f70c8-7ab2-405d-a783-d48667c726aa None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:42.351873 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f70c8-7ab2-405d-a783-d48667c726aa None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:42.356669 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390639d0-d30a-4add-a0d3-ae34ce1c9c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:42.357315 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390639d0-d30a-4add-a0d3-ae34ce1c9c7e admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:42.357596 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390639d0-d30a-4add-a0d3-ae34ce1c9c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:42.358375 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390639d0-d30a-4add-a0d3-ae34ce1c9c7e admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:42.359054 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390639d0-d30a-4add-a0d3-ae34ce1c9c7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:42.361082 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390639d0-d30a-4add-a0d3-ae34ce1c9c7e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:42.482674 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1343/2688] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:31:42 2021] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:31:42.486715 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f2962-72c8-4b78-b2b8-23cc9fade39d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:42.496451 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f2962-72c8-4b78-b2b8-23cc9fade39d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:42.550306 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e09eb3-cc3b-45de-83d6-e63011139468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:42.550961 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e09eb3-cc3b-45de-83d6-e63011139468 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:42.551240 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e09eb3-cc3b-45de-83d6-e63011139468 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:42.551514 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e09eb3-cc3b-45de-83d6-e63011139468 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:42.552180 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e09eb3-cc3b-45de-83d6-e63011139468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:42.554104 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e09eb3-cc3b-45de-83d6-e63011139468 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:42.665064 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1346/2689] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:31:42 2021] POST /identity/v3/users => generated 283 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:31:42.669457 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390639d0-d30a-4add-a0d3-ae34ce1c9c7e admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:42.680006 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390639d0-d30a-4add-a0d3-ae34ce1c9c7e admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:42.684703 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8cc0d-d0c9-4cd8-86bf-f273c4e64d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:42.685367 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8cc0d-d0c9-4cd8-86bf-f273c4e64d42 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:42.685712 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8cc0d-d0c9-4cd8-86bf-f273c4e64d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:42.685995 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8cc0d-d0c9-4cd8-86bf-f273c4e64d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:42.686723 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8cc0d-d0c9-4cd8-86bf-f273c4e64d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:42.688314 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8cc0d-d0c9-4cd8-86bf-f273c4e64d42 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:42.698437 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1344/2690] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:31:42 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:31:42.702236 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e09eb3-cc3b-45de-83d6-e63011139468 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:42.712131 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e09eb3-cc3b-45de-83d6-e63011139468 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:42.717006 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88999798-0eae-41ac-b162-67041dfd4d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:42.718143 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88999798-0eae-41ac-b162-67041dfd4d52 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:42.718423 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88999798-0eae-41ac-b162-67041dfd4d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:42.718702 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88999798-0eae-41ac-b162-67041dfd4d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:42.719417 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88999798-0eae-41ac-b162-67041dfd4d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:42.721034 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88999798-0eae-41ac-b162-67041dfd4d52 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:42.730603 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1347/2691] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:31:42 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:31:42.734991 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8cc0d-d0c9-4cd8-86bf-f273c4e64d42 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:42.744659 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8cc0d-d0c9-4cd8-86bf-f273c4e64d42 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:42.749450 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060f6b1-c84e-49ec-b1ce-d169a424cc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:42.750335 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060f6b1-c84e-49ec-b1ce-d169a424cc44 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:42.750600 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060f6b1-c84e-49ec-b1ce-d169a424cc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:42.750877 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060f6b1-c84e-49ec-b1ce-d169a424cc44 admin admin] PATH_INFO: `/v3/projects/d4bd225e83ac45f8864435b8dd74a624/users/2fb780ff6bcd4167a4b5d959e088e4b7/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:42.764810 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060f6b1-c84e-49ec-b1ce-d169a424cc44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4bd225e83ac45f8864435b8dd74a624, user_id=2fb780ff6bcd4167a4b5d959e088e4b7, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:42.767434 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060f6b1-c84e-49ec-b1ce-d169a424cc44 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:42.905315 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1345/2692] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:31:42 2021] PUT /identity/v3/projects/d4bd225e83ac45f8864435b8dd74a624/users/2fb780ff6bcd4167a4b5d959e088e4b7/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:31:42.916418 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53984455-eb81-490c-91ea-79e8fef15b21 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:42.916743 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53984455-eb81-490c-91ea-79e8fef15b21 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:42.917059 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53984455-eb81-490c-91ea-79e8fef15b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:42.943815 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-53984455-eb81-490c-91ea-79e8fef15b21 None None] MFA Rules not processed for user `2fb780ff6bcd4167a4b5d959e088e4b7`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:31:42.945049 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-53984455-eb81-490c-91ea-79e8fef15b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:43.006411 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1348/2693] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:31:42 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:31:43.010710 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060f6b1-c84e-49ec-b1ce-d169a424cc44 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:43.068689 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060f6b1-c84e-49ec-b1ce-d169a424cc44 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:43.073373 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d056425-840f-493a-8c19-b812d7f47639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:43.074021 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d056425-840f-493a-8c19-b812d7f47639 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:43.074307 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d056425-840f-493a-8c19-b812d7f47639 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:43.074588 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d056425-840f-493a-8c19-b812d7f47639 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:43.075269 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d056425-840f-493a-8c19-b812d7f47639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:43.077235 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d056425-840f-493a-8c19-b812d7f47639 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:43.311912 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1346/2694] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:31:43 2021] POST /identity/v3/projects => generated 365 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:31:43.316049 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53984455-eb81-490c-91ea-79e8fef15b21 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:43.326693 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53984455-eb81-490c-91ea-79e8fef15b21 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:43.380158 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6250bb-3661-4962-8591-cc8b79e9e32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:43.380849 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6250bb-3661-4962-8591-cc8b79e9e32c admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:43.381131 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6250bb-3661-4962-8591-cc8b79e9e32c admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:43.381682 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6250bb-3661-4962-8591-cc8b79e9e32c admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:43.382360 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6250bb-3661-4962-8591-cc8b79e9e32c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:43.384294 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6250bb-3661-4962-8591-cc8b79e9e32c admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:43.504445 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1349/2695] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:31:43 2021] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:31:43.508570 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d056425-840f-493a-8c19-b812d7f47639 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:43.518732 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d056425-840f-493a-8c19-b812d7f47639 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:43.523327 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456a4e8-a04c-40fa-b0a8-776dd5227c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:43.523993 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456a4e8-a04c-40fa-b0a8-776dd5227c22 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:43.524281 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456a4e8-a04c-40fa-b0a8-776dd5227c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:43.524602 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456a4e8-a04c-40fa-b0a8-776dd5227c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:43.525331 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456a4e8-a04c-40fa-b0a8-776dd5227c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:43.526918 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456a4e8-a04c-40fa-b0a8-776dd5227c22 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:43.537666 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1347/2696] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:31:43 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:31:43.541623 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6250bb-3661-4962-8591-cc8b79e9e32c admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:43.551990 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6250bb-3661-4962-8591-cc8b79e9e32c admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:43.556804 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d969f2-909e-4246-9b1c-fa0210cf1198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:43.557683 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d969f2-909e-4246-9b1c-fa0210cf1198 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:43.557970 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d969f2-909e-4246-9b1c-fa0210cf1198 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:43.558251 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d969f2-909e-4246-9b1c-fa0210cf1198 admin admin] PATH_INFO: `/v3/projects/47c9cea6bd7c471e990b4e74bf864d25/users/29c12a957f1f45759c3ccdb536dfeca7/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:43.572562 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d969f2-909e-4246-9b1c-fa0210cf1198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47c9cea6bd7c471e990b4e74bf864d25, user_id=29c12a957f1f45759c3ccdb536dfeca7, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:43.575145 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d969f2-909e-4246-9b1c-fa0210cf1198 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:43.670095 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1350/2697] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:31:43 2021] PUT /identity/v3/projects/47c9cea6bd7c471e990b4e74bf864d25/users/29c12a957f1f45759c3ccdb536dfeca7/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:31:43.674585 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456a4e8-a04c-40fa-b0a8-776dd5227c22 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:43.684421 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456a4e8-a04c-40fa-b0a8-776dd5227c22 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:43.738461 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7861f8f-5b97-4e7f-b1f2-a2a17487d0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:43.739120 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7861f8f-5b97-4e7f-b1f2-a2a17487d0ae admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:43.739406 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7861f8f-5b97-4e7f-b1f2-a2a17487d0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:43.739686 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7861f8f-5b97-4e7f-b1f2-a2a17487d0ae admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:43.740398 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7861f8f-5b97-4e7f-b1f2-a2a17487d0ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:43.742002 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7861f8f-5b97-4e7f-b1f2-a2a17487d0ae admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:43.751661 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1348/2698] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:31:43 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:31:43.755657 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d969f2-909e-4246-9b1c-fa0210cf1198 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:43.765619 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d969f2-909e-4246-9b1c-fa0210cf1198 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:43.770184 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065169cd-c7b9-4aae-863b-b557e1d6b9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:43.771059 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065169cd-c7b9-4aae-863b-b557e1d6b9ac admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:43.771337 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065169cd-c7b9-4aae-863b-b557e1d6b9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:43.771611 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065169cd-c7b9-4aae-863b-b557e1d6b9ac admin admin] PATH_INFO: `/v3/projects/47c9cea6bd7c471e990b4e74bf864d25/users/29c12a957f1f45759c3ccdb536dfeca7/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:43.773590 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065169cd-c7b9-4aae-863b-b557e1d6b9ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=47c9cea6bd7c471e990b4e74bf864d25, user_id=29c12a957f1f45759c3ccdb536dfeca7, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:43.776194 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065169cd-c7b9-4aae-863b-b557e1d6b9ac admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:43.786013 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1351/2699] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:31:43 2021] PUT /identity/v3/projects/47c9cea6bd7c471e990b4e74bf864d25/users/29c12a957f1f45759c3ccdb536dfeca7/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:31:43.796147 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9034047-cf16-4625-9ff5-3536b30c812f None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:43.796436 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9034047-cf16-4625-9ff5-3536b30c812f None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:43.796762 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9034047-cf16-4625-9ff5-3536b30c812f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:43.822874 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-d9034047-cf16-4625-9ff5-3536b30c812f None None] MFA Rules not processed for user `29c12a957f1f45759c3ccdb536dfeca7`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:31:43.824007 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-d9034047-cf16-4625-9ff5-3536b30c812f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:43.889168 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1349/2700] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:31:43 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:31:43.899475 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065169cd-c7b9-4aae-863b-b557e1d6b9ac admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:43.901192 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-065169cd-c7b9-4aae-863b-b557e1d6b9ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:43.956167 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065169cd-c7b9-4aae-863b-b557e1d6b9ac admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:43.959883 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b701e-c399-4ccd-a7a2-d79450e1dece service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:43.960548 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b701e-c399-4ccd-a7a2-d79450e1dece service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:43.960837 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b701e-c399-4ccd-a7a2-d79450e1dece service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:43.961116 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b701e-c399-4ccd-a7a2-d79450e1dece service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:43.970218 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b701e-c399-4ccd-a7a2-d79450e1dece service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:43.971642 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b701e-c399-4ccd-a7a2-d79450e1dece service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:43.980942 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1352/2701] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:31:43 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:31:44.345609 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9034047-cf16-4625-9ff5-3536b30c812f None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:44.405882 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9034047-cf16-4625-9ff5-3536b30c812f None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:44.411003 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28ec57-e088-4760-9f29-59e1789c9c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:44.411864 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28ec57-e088-4760-9f29-59e1789c9c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:44.412183 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28ec57-e088-4760-9f29-59e1789c9c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:44.412458 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28ec57-e088-4760-9f29-59e1789c9c93 admin admin] PATH_INFO: `/v3/users/2fb780ff6bcd4167a4b5d959e088e4b7` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:44.413703 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28ec57-e088-4760-9f29-59e1789c9c93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fb780ff6bcd4167a4b5d959e088e4b7)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:44.415594 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28ec57-e088-4760-9f29-59e1789c9c93 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:44.620042 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-9d28ec57-e088-4760-9f29-59e1789c9c93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fb780ff6bcd4167a4b5d959e088e4b7'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:44.620723 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-9d28ec57-e088-4760-9f29-59e1789c9c93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fb780ff6bcd4167a4b5d959e088e4b7'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:44.627309 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-9d28ec57-e088-4760-9f29-59e1789c9c93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fb780ff6bcd4167a4b5d959e088e4b7'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:44.693115 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-9d28ec57-e088-4760-9f29-59e1789c9c93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fb780ff6bcd4167a4b5d959e088e4b7'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:44.705266 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-9d28ec57-e088-4760-9f29-59e1789c9c93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fb780ff6bcd4167a4b5d959e088e4b7'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:44.711018 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1350/2702] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:31:44 2021] DELETE /identity/v3/users/2fb780ff6bcd4167a4b5d959e088e4b7 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:31:44.715591 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e045f-d79a-4e3c-a35a-b2a66b46efd6 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:44.716076 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e045f-d79a-4e3c-a35a-b2a66b46efd6 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:44.716202 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e045f-d79a-4e3c-a35a-b2a66b46efd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:44.733997 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-538e045f-d79a-4e3c-a35a-b2a66b46efd6 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:31:44.735176 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-538e045f-d79a-4e3c-a35a-b2a66b46efd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:44.790696 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1353/2703] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:31:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:31:44.801005 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28ec57-e088-4760-9f29-59e1789c9c93 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:44.802437 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-9d28ec57-e088-4760-9f29-59e1789c9c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:44.857373 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28ec57-e088-4760-9f29-59e1789c9c93 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:44.861927 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1cae3-6cae-4796-9ff4-e006f4334e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:44.862574 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1cae3-6cae-4796-9ff4-e006f4334e98 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:44.862873 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1cae3-6cae-4796-9ff4-e006f4334e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:44.863133 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1cae3-6cae-4796-9ff4-e006f4334e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:44.872049 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1cae3-6cae-4796-9ff4-e006f4334e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:44.873468 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1cae3-6cae-4796-9ff4-e006f4334e98 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:44.882682 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1351/2704] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:31:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:31:45.302754 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e045f-d79a-4e3c-a35a-b2a66b46efd6 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:45.305308 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-538e045f-d79a-4e3c-a35a-b2a66b46efd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:45.320285 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e045f-d79a-4e3c-a35a-b2a66b46efd6 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:45.327032 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f79069-baf9-45d7-b142-ff9dc18c7f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:45.328079 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f79069-baf9-45d7-b142-ff9dc18c7f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:45.328252 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f79069-baf9-45d7-b142-ff9dc18c7f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:45.328548 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f79069-baf9-45d7-b142-ff9dc18c7f64 admin admin] PATH_INFO: `/v3/projects/d4bd225e83ac45f8864435b8dd74a624` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:45.334646 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f79069-baf9-45d7-b142-ff9dc18c7f64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4bd225e83ac45f8864435b8dd74a624)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:45.334646 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f79069-baf9-45d7-b142-ff9dc18c7f64 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:45.469798 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-a6f79069-baf9-45d7-b142-ff9dc18c7f64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4bd225e83ac45f8864435b8dd74a624', 'request_id': 'req-a6f79069-baf9-45d7-b142-ff9dc18c7f64'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:45.538876 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-a6f79069-baf9-45d7-b142-ff9dc18c7f64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4bd225e83ac45f8864435b8dd74a624', 'request_id': 'req-a6f79069-baf9-45d7-b142-ff9dc18c7f64'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:45.545050 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-a6f79069-baf9-45d7-b142-ff9dc18c7f64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4bd225e83ac45f8864435b8dd74a624', 'request_id': 'req-a6f79069-baf9-45d7-b142-ff9dc18c7f64'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:45.556581 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-a6f79069-baf9-45d7-b142-ff9dc18c7f64 admin admin] The token cache is being invalidate because project d4bd225e83ac45f8864435b8dd74a624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:31:45.556862 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-a6f79069-baf9-45d7-b142-ff9dc18c7f64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:45.557478 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-a6f79069-baf9-45d7-b142-ff9dc18c7f64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:45.558994 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1354/2705] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:31:45 2021] DELETE /identity/v3/projects/d4bd225e83ac45f8864435b8dd74a624 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:31:45.562994 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1cae3-6cae-4796-9ff4-e006f4334e98 service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:45.572448 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1cae3-6cae-4796-9ff4-e006f4334e98 service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:45.631419 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbe97c-01f0-45c1-81e5-ae299919fe07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:45.632295 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbe97c-01f0-45c1-81e5-ae299919fe07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:45.632609 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbe97c-01f0-45c1-81e5-ae299919fe07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:45.632889 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbe97c-01f0-45c1-81e5-ae299919fe07 admin admin] PATH_INFO: `/v3/users/29c12a957f1f45759c3ccdb536dfeca7` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:45.634070 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbe97c-01f0-45c1-81e5-ae299919fe07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29c12a957f1f45759c3ccdb536dfeca7)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:45.636019 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbe97c-01f0-45c1-81e5-ae299919fe07 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:45.831951 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-e9cbe97c-01f0-45c1-81e5-ae299919fe07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29c12a957f1f45759c3ccdb536dfeca7'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:45.832637 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-e9cbe97c-01f0-45c1-81e5-ae299919fe07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29c12a957f1f45759c3ccdb536dfeca7'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:45.839252 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-e9cbe97c-01f0-45c1-81e5-ae299919fe07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29c12a957f1f45759c3ccdb536dfeca7'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:45.916243 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-e9cbe97c-01f0-45c1-81e5-ae299919fe07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29c12a957f1f45759c3ccdb536dfeca7'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:45.928307 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-e9cbe97c-01f0-45c1-81e5-ae299919fe07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29c12a957f1f45759c3ccdb536dfeca7'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:45.934200 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1352/2706] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:31:45 2021] DELETE /identity/v3/users/29c12a957f1f45759c3ccdb536dfeca7 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:31:46.387623 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f79069-baf9-45d7-b142-ff9dc18c7f64 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:46.388078 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-a6f79069-baf9-45d7-b142-ff9dc18c7f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:46.400745 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f79069-baf9-45d7-b142-ff9dc18c7f64 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:46.456219 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fcf93-8573-47d6-b79e-e54f6f04fcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:46.457107 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fcf93-8573-47d6-b79e-e54f6f04fcbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:46.457390 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fcf93-8573-47d6-b79e-e54f6f04fcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:46.457696 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fcf93-8573-47d6-b79e-e54f6f04fcbb admin admin] PATH_INFO: `/v3/projects/47c9cea6bd7c471e990b4e74bf864d25` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:46.458868 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fcf93-8573-47d6-b79e-e54f6f04fcbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=47c9cea6bd7c471e990b4e74bf864d25)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:46.460786 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fcf93-8573-47d6-b79e-e54f6f04fcbb admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:46.601767 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-da5fcf93-8573-47d6-b79e-e54f6f04fcbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47c9cea6bd7c471e990b4e74bf864d25', 'request_id': 'req-da5fcf93-8573-47d6-b79e-e54f6f04fcbb'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:46.693253 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-da5fcf93-8573-47d6-b79e-e54f6f04fcbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47c9cea6bd7c471e990b4e74bf864d25', 'request_id': 'req-da5fcf93-8573-47d6-b79e-e54f6f04fcbb'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:46.698602 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-da5fcf93-8573-47d6-b79e-e54f6f04fcbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47c9cea6bd7c471e990b4e74bf864d25', 'request_id': 'req-da5fcf93-8573-47d6-b79e-e54f6f04fcbb'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:46.709774 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-da5fcf93-8573-47d6-b79e-e54f6f04fcbb admin admin] The token cache is being invalidate because project 47c9cea6bd7c471e990b4e74bf864d25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:31:46.710060 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-da5fcf93-8573-47d6-b79e-e54f6f04fcbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:46.710691 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-da5fcf93-8573-47d6-b79e-e54f6f04fcbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:46.712212 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1355/2707] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:31:46 2021] DELETE /identity/v3/projects/47c9cea6bd7c471e990b4e74bf864d25 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:31:46.718819 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588dc74-45cf-43d8-be3a-52dd00aa1187 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:46.719335 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588dc74-45cf-43d8-be3a-52dd00aa1187 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:46.719445 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588dc74-45cf-43d8-be3a-52dd00aa1187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:46.736445 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-1588dc74-45cf-43d8-be3a-52dd00aa1187 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:31:46.737690 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-1588dc74-45cf-43d8-be3a-52dd00aa1187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:46.793683 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1353/2708] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:31:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:31:46.801303 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d4105-b8d0-47f3-97db-37d84219fbaf None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:46.801583 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d4105-b8d0-47f3-97db-37d84219fbaf None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:46.801854 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d4105-b8d0-47f3-97db-37d84219fbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:46.820106 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-3f7d4105-b8d0-47f3-97db-37d84219fbaf None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:31:46.821914 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-3f7d4105-b8d0-47f3-97db-37d84219fbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:46.829833 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1356/2709] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:31:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:31:46.834000 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588dc74-45cf-43d8-be3a-52dd00aa1187 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:46.844322 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588dc74-45cf-43d8-be3a-52dd00aa1187 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:46.848946 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f77f24-78e3-4f0c-bba4-c4b1210c918f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:46.849584 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f77f24-78e3-4f0c-bba4-c4b1210c918f admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:46.849866 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f77f24-78e3-4f0c-bba4-c4b1210c918f admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:46.850168 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f77f24-78e3-4f0c-bba4-c4b1210c918f admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:46.850877 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f77f24-78e3-4f0c-bba4-c4b1210c918f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:31:46.851186 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f77f24-78e3-4f0c-bba4-c4b1210c918f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:46.852791 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f77f24-78e3-4f0c-bba4-c4b1210c918f admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:46.863923 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1354/2710] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:31:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:31:46.867895 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d4105-b8d0-47f3-97db-37d84219fbaf None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:46.877029 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d4105-b8d0-47f3-97db-37d84219fbaf None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:46.881759 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8b2f0-7902-4acf-b820-d2432f5d9a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:46.882441 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8b2f0-7902-4acf-b820-d2432f5d9a3e admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:46.882726 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8b2f0-7902-4acf-b820-d2432f5d9a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:46.883005 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8b2f0-7902-4acf-b820-d2432f5d9a3e admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:46.883711 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8b2f0-7902-4acf-b820-d2432f5d9a3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:46.885637 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8b2f0-7902-4acf-b820-d2432f5d9a3e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:46.997734 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1357/2711] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:31:46 2021] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:31:47.002208 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f77f24-78e3-4f0c-bba4-c4b1210c918f admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:47.012288 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f77f24-78e3-4f0c-bba4-c4b1210c918f admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:47.067831 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df933030-037c-4cf5-9785-79fe257e2d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:47.068531 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df933030-037c-4cf5-9785-79fe257e2d8c admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:47.068823 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df933030-037c-4cf5-9785-79fe257e2d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:47.069106 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df933030-037c-4cf5-9785-79fe257e2d8c admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:47.069803 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df933030-037c-4cf5-9785-79fe257e2d8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:47.071712 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df933030-037c-4cf5-9785-79fe257e2d8c admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:47.219768 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1355/2712] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:31:47 2021] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:31:47.223788 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8b2f0-7902-4acf-b820-d2432f5d9a3e admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:47.234320 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8b2f0-7902-4acf-b820-d2432f5d9a3e admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:47.238839 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5a1b2-9fe8-4db4-93b7-70b5627f49d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:47.239496 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5a1b2-9fe8-4db4-93b7-70b5627f49d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:47.239774 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5a1b2-9fe8-4db4-93b7-70b5627f49d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:47.240077 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5a1b2-9fe8-4db4-93b7-70b5627f49d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:47.240834 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5a1b2-9fe8-4db4-93b7-70b5627f49d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:47.242407 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5a1b2-9fe8-4db4-93b7-70b5627f49d0 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:47.253512 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1358/2713] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:31:47 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:31:47.257312 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df933030-037c-4cf5-9785-79fe257e2d8c admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:47.267594 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df933030-037c-4cf5-9785-79fe257e2d8c admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:47.272135 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6c7e3-3856-4bf2-97c0-5c8f35c0b5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:47.272821 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6c7e3-3856-4bf2-97c0-5c8f35c0b5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:47.273100 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6c7e3-3856-4bf2-97c0-5c8f35c0b5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:47.273374 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6c7e3-3856-4bf2-97c0-5c8f35c0b5c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:47.274088 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6c7e3-3856-4bf2-97c0-5c8f35c0b5c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:47.275659 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6c7e3-3856-4bf2-97c0-5c8f35c0b5c1 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:47.285237 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1356/2714] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:31:47 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:31:47.289744 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5a1b2-9fe8-4db4-93b7-70b5627f49d0 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:47.299760 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5a1b2-9fe8-4db4-93b7-70b5627f49d0 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:47.304611 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59437d-a919-4ced-9738-88525da80f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:47.305501 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59437d-a919-4ced-9738-88525da80f27 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:47.305782 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59437d-a919-4ced-9738-88525da80f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:47.306066 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59437d-a919-4ced-9738-88525da80f27 admin admin] PATH_INFO: `/v3/projects/bbb99560cb204ec29e24fb0f73010517/users/759e75e104094c128ce6748ac9ffda72/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:47.320911 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59437d-a919-4ced-9738-88525da80f27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb99560cb204ec29e24fb0f73010517, user_id=759e75e104094c128ce6748ac9ffda72, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:47.323539 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59437d-a919-4ced-9738-88525da80f27 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:47.413289 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1359/2715] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:31:47 2021] PUT /identity/v3/projects/bbb99560cb204ec29e24fb0f73010517/users/759e75e104094c128ce6748ac9ffda72/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:31:47.424891 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698cbbf-7cb1-4d5b-9cf4-f9f476854935 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:47.425184 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698cbbf-7cb1-4d5b-9cf4-f9f476854935 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:47.425495 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698cbbf-7cb1-4d5b-9cf4-f9f476854935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:47.451733 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-b698cbbf-7cb1-4d5b-9cf4-f9f476854935 None None] MFA Rules not processed for user `759e75e104094c128ce6748ac9ffda72`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:31:47.452966 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-b698cbbf-7cb1-4d5b-9cf4-f9f476854935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:47.512759 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1357/2716] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:31:47 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:31:47.517121 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59437d-a919-4ced-9738-88525da80f27 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:47.577228 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59437d-a919-4ced-9738-88525da80f27 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:47.582128 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c432eee-8b3f-4896-9524-5ba2162bd47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:47.582777 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c432eee-8b3f-4896-9524-5ba2162bd47b admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:47.583054 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c432eee-8b3f-4896-9524-5ba2162bd47b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:47.583380 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c432eee-8b3f-4896-9524-5ba2162bd47b admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:47.584328 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c432eee-8b3f-4896-9524-5ba2162bd47b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:47.586877 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c432eee-8b3f-4896-9524-5ba2162bd47b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:47.682604 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1360/2717] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:31:47 2021] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:31:47.686725 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698cbbf-7cb1-4d5b-9cf4-f9f476854935 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:47.697300 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698cbbf-7cb1-4d5b-9cf4-f9f476854935 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:47.751822 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab458d43-21c5-4676-97e1-263e9f39d0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:47.752482 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab458d43-21c5-4676-97e1-263e9f39d0d2 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:47.752796 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab458d43-21c5-4676-97e1-263e9f39d0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:47.753076 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab458d43-21c5-4676-97e1-263e9f39d0d2 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:47.753748 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab458d43-21c5-4676-97e1-263e9f39d0d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:47.755643 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab458d43-21c5-4676-97e1-263e9f39d0d2 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:47.842471 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1358/2718] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:31:47 2021] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:31:47.846544 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c432eee-8b3f-4896-9524-5ba2162bd47b admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:47.856996 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c432eee-8b3f-4896-9524-5ba2162bd47b admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:47.861841 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6c903-5864-4c57-9f5e-01ca134474ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:47.862502 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6c903-5864-4c57-9f5e-01ca134474ec admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:47.862785 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6c903-5864-4c57-9f5e-01ca134474ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:47.863063 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6c903-5864-4c57-9f5e-01ca134474ec admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:47.863829 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6c903-5864-4c57-9f5e-01ca134474ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:47.865485 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6c903-5864-4c57-9f5e-01ca134474ec admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:47.876282 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1361/2719] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:31:47 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:31:47.880055 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab458d43-21c5-4676-97e1-263e9f39d0d2 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:47.890274 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab458d43-21c5-4676-97e1-263e9f39d0d2 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:47.895150 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0c2c4-eff3-4d99-abf2-8e0f0b8cf37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:47.895804 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0c2c4-eff3-4d99-abf2-8e0f0b8cf37b admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:47.896081 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0c2c4-eff3-4d99-abf2-8e0f0b8cf37b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:47.896355 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0c2c4-eff3-4d99-abf2-8e0f0b8cf37b admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:47.897101 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0c2c4-eff3-4d99-abf2-8e0f0b8cf37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:47.898664 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0c2c4-eff3-4d99-abf2-8e0f0b8cf37b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:47.908302 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1359/2720] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:31:47 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:31:47.912280 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6c903-5864-4c57-9f5e-01ca134474ec admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:47.921910 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6c903-5864-4c57-9f5e-01ca134474ec admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:47.926435 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6186b-13af-42f1-92c0-e9157c3a98c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:47.927294 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6186b-13af-42f1-92c0-e9157c3a98c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:47.927573 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6186b-13af-42f1-92c0-e9157c3a98c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:47.927846 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6186b-13af-42f1-92c0-e9157c3a98c4 admin admin] PATH_INFO: `/v3/projects/decca4db2f8d4e58aa8ca78d1d96f205/users/01fec895884349468056784d3e54cdcb/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:47.942168 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6186b-13af-42f1-92c0-e9157c3a98c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=decca4db2f8d4e58aa8ca78d1d96f205, user_id=01fec895884349468056784d3e54cdcb, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:47.944867 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6186b-13af-42f1-92c0-e9157c3a98c4 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:48.035858 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1362/2721] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:31:47 2021] PUT /identity/v3/projects/decca4db2f8d4e58aa8ca78d1d96f205/users/01fec895884349468056784d3e54cdcb/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:31:48.045863 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1959da8-d693-484e-a5a3-11186ed9d863 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:48.046186 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1959da8-d693-484e-a5a3-11186ed9d863 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:48.046466 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1959da8-d693-484e-a5a3-11186ed9d863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:48.079113 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-d1959da8-d693-484e-a5a3-11186ed9d863 None None] MFA Rules not processed for user `01fec895884349468056784d3e54cdcb`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:31:48.080249 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-d1959da8-d693-484e-a5a3-11186ed9d863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:48.141541 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1360/2722] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:31:48 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:31:48.146078 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6186b-13af-42f1-92c0-e9157c3a98c4 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:48.204291 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6186b-13af-42f1-92c0-e9157c3a98c4 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:48.208906 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041b38e-a517-493e-bbf0-f71237f468c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:48.209562 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041b38e-a517-493e-bbf0-f71237f468c3 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:48.209839 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041b38e-a517-493e-bbf0-f71237f468c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:48.210112 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041b38e-a517-493e-bbf0-f71237f468c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:48.210797 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041b38e-a517-493e-bbf0-f71237f468c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:48.212692 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041b38e-a517-493e-bbf0-f71237f468c3 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:48.311948 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1363/2723] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:31:48 2021] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:31:48.316247 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1959da8-d693-484e-a5a3-11186ed9d863 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:48.326748 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1959da8-d693-484e-a5a3-11186ed9d863 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:48.380136 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28da076-3dde-4268-bbbd-903ad414fc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:48.380756 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28da076-3dde-4268-bbbd-903ad414fc25 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:48.381038 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28da076-3dde-4268-bbbd-903ad414fc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:48.381318 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28da076-3dde-4268-bbbd-903ad414fc25 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:48.381996 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28da076-3dde-4268-bbbd-903ad414fc25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:48.383927 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28da076-3dde-4268-bbbd-903ad414fc25 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:48.561607 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1361/2724] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:31:48 2021] POST /identity/v3/users => generated 299 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:31:48.565537 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041b38e-a517-493e-bbf0-f71237f468c3 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:48.575592 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041b38e-a517-493e-bbf0-f71237f468c3 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:48.580161 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36304dfc-54ef-464f-94f8-569baadb4c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:48.580858 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36304dfc-54ef-464f-94f8-569baadb4c06 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:48.581150 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36304dfc-54ef-464f-94f8-569baadb4c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:48.581431 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36304dfc-54ef-464f-94f8-569baadb4c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:48.582149 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36304dfc-54ef-464f-94f8-569baadb4c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:48.583747 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36304dfc-54ef-464f-94f8-569baadb4c06 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:48.594748 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1364/2725] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:31:48 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:31:48.609024 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28da076-3dde-4268-bbbd-903ad414fc25 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:48.618681 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28da076-3dde-4268-bbbd-903ad414fc25 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:48.623282 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912ba87-e69c-4b54-8b63-807243a94dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:48.624220 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912ba87-e69c-4b54-8b63-807243a94dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:48.624524 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912ba87-e69c-4b54-8b63-807243a94dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:48.624811 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912ba87-e69c-4b54-8b63-807243a94dd6 admin admin] PATH_INFO: `/v3/projects/3a3c430e93d14c0085207c2897cd0c3b/users/1830187b64e64aeb863e5a1abfa6253b/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:48.639346 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912ba87-e69c-4b54-8b63-807243a94dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a3c430e93d14c0085207c2897cd0c3b, user_id=1830187b64e64aeb863e5a1abfa6253b, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:48.641931 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912ba87-e69c-4b54-8b63-807243a94dd6 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:48.739337 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1362/2726] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:31:48 2021] PUT /identity/v3/projects/3a3c430e93d14c0085207c2897cd0c3b/users/1830187b64e64aeb863e5a1abfa6253b/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:31:48.743140 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36304dfc-54ef-464f-94f8-569baadb4c06 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:48.752768 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36304dfc-54ef-464f-94f8-569baadb4c06 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:48.807965 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323d40f-016f-41e4-ba53-e793315a7700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:48.808786 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323d40f-016f-41e4-ba53-e793315a7700 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:48.809070 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323d40f-016f-41e4-ba53-e793315a7700 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:48.809344 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323d40f-016f-41e4-ba53-e793315a7700 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:48.810060 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323d40f-016f-41e4-ba53-e793315a7700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:48.811666 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323d40f-016f-41e4-ba53-e793315a7700 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:48.821753 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1365/2727] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:31:48 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:31:48.825492 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912ba87-e69c-4b54-8b63-807243a94dd6 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:48.837253 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912ba87-e69c-4b54-8b63-807243a94dd6 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:48.842632 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c08e8-7d74-41ba-b1d5-4dee5f9814e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:48.843505 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c08e8-7d74-41ba-b1d5-4dee5f9814e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:48.843783 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c08e8-7d74-41ba-b1d5-4dee5f9814e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:48.844057 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c08e8-7d74-41ba-b1d5-4dee5f9814e7 admin admin] PATH_INFO: `/v3/projects/3a3c430e93d14c0085207c2897cd0c3b/users/1830187b64e64aeb863e5a1abfa6253b/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:48.846060 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c08e8-7d74-41ba-b1d5-4dee5f9814e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a3c430e93d14c0085207c2897cd0c3b, user_id=1830187b64e64aeb863e5a1abfa6253b, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:48.848696 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c08e8-7d74-41ba-b1d5-4dee5f9814e7 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:48.859298 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1363/2728] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:31:48 2021] PUT /identity/v3/projects/3a3c430e93d14c0085207c2897cd0c3b/users/1830187b64e64aeb863e5a1abfa6253b/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:31:48.870201 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd0245-a16b-4775-a16b-476a008fe59f None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:48.870488 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd0245-a16b-4775-a16b-476a008fe59f None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:48.870764 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd0245-a16b-4775-a16b-476a008fe59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:48.896668 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-75cd0245-a16b-4775-a16b-476a008fe59f None None] MFA Rules not processed for user `1830187b64e64aeb863e5a1abfa6253b`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:31:48.897817 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-75cd0245-a16b-4775-a16b-476a008fe59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:48.967616 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1366/2729] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:31:48 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:31:48.977410 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c08e8-7d74-41ba-b1d5-4dee5f9814e7 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:48.979153 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-f12c08e8-7d74-41ba-b1d5-4dee5f9814e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:49.033752 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c08e8-7d74-41ba-b1d5-4dee5f9814e7 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:49.037428 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578f762-3c16-4526-b4d4-564178b696f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:49.038072 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578f762-3c16-4526-b4d4-564178b696f3 service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:49.038356 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578f762-3c16-4526-b4d4-564178b696f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:49.038636 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578f762-3c16-4526-b4d4-564178b696f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:49.047353 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578f762-3c16-4526-b4d4-564178b696f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:49.048877 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578f762-3c16-4526-b4d4-564178b696f3 service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:49.058054 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1364/2730] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:31:48 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:31:50.086836 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd0245-a16b-4775-a16b-476a008fe59f None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:50.088214 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-75cd0245-a16b-4775-a16b-476a008fe59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:50.100621 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd0245-a16b-4775-a16b-476a008fe59f None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:50.104180 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2dc2b-0ce7-40f7-ab05-3938a45beae9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:50.104847 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2dc2b-0ce7-40f7-ab05-3938a45beae9 service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:50.105130 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2dc2b-0ce7-40f7-ab05-3938a45beae9 service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:50.105407 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2dc2b-0ce7-40f7-ab05-3938a45beae9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:50.160179 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2dc2b-0ce7-40f7-ab05-3938a45beae9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:50.161643 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2dc2b-0ce7-40f7-ab05-3938a45beae9 service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:50.170894 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1367/2731] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:31:50 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:31:55.214849 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578f762-3c16-4526-b4d4-564178b696f3 service cinder] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:55.224269 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578f762-3c16-4526-b4d4-564178b696f3 service cinder] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:55.227904 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461078ce-df30-4f3e-a995-eaad9205fcf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:55.228575 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461078ce-df30-4f3e-a995-eaad9205fcf5 service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:55.228860 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461078ce-df30-4f3e-a995-eaad9205fcf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:55.229193 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461078ce-df30-4f3e-a995-eaad9205fcf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:55.284474 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461078ce-df30-4f3e-a995-eaad9205fcf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:55.285958 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461078ce-df30-4f3e-a995-eaad9205fcf5 service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:55.295495 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1365/2732] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:31:55 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:31:59.384927 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2dc2b-0ce7-40f7-ab05-3938a45beae9 service cinder] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:59.444103 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2dc2b-0ce7-40f7-ab05-3938a45beae9 service cinder] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:59.448684 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881979bf-8413-4ac1-98fa-091ce3b8406b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:59.449544 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881979bf-8413-4ac1-98fa-091ce3b8406b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:59.449827 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881979bf-8413-4ac1-98fa-091ce3b8406b admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:59.450104 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881979bf-8413-4ac1-98fa-091ce3b8406b admin admin] PATH_INFO: `/v3/users/759e75e104094c128ce6748ac9ffda72` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:59.451789 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881979bf-8413-4ac1-98fa-091ce3b8406b admin admin] RBAC: Authorizing `identity:delete_user(user_id=759e75e104094c128ce6748ac9ffda72)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:59.453714 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881979bf-8413-4ac1-98fa-091ce3b8406b admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:59.625772 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-881979bf-8413-4ac1-98fa-091ce3b8406b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '759e75e104094c128ce6748ac9ffda72'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:59.626367 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-881979bf-8413-4ac1-98fa-091ce3b8406b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '759e75e104094c128ce6748ac9ffda72'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:59.626974 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-881979bf-8413-4ac1-98fa-091ce3b8406b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '759e75e104094c128ce6748ac9ffda72'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:59.633656 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-881979bf-8413-4ac1-98fa-091ce3b8406b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '759e75e104094c128ce6748ac9ffda72'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:59.726971 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-881979bf-8413-4ac1-98fa-091ce3b8406b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '759e75e104094c128ce6748ac9ffda72'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:31:59.743582 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1368/2733] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:31:59 2021] DELETE /identity/v3/users/759e75e104094c128ce6748ac9ffda72 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:31:59.748659 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbbbbf-9128-4667-9784-e1c8502cd222 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:59.749150 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbbbbf-9128-4667-9784-e1c8502cd222 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:59.749246 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbbbbf-9128-4667-9784-e1c8502cd222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:59.766211 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-43dbbbbf-9128-4667-9784-e1c8502cd222 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:31:59.767421 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-43dbbbbf-9128-4667-9784-e1c8502cd222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:59.822219 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1366/2734] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:31:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:31:59.832591 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881979bf-8413-4ac1-98fa-091ce3b8406b admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:31:59.834073 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-881979bf-8413-4ac1-98fa-091ce3b8406b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:31:59.888308 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881979bf-8413-4ac1-98fa-091ce3b8406b admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:31:59.892419 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a0a92-4ca0-4088-ad96-71da611a5fda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:31:59.893086 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a0a92-4ca0-4088-ad96-71da611a5fda service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:31:59.893369 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a0a92-4ca0-4088-ad96-71da611a5fda service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:31:59.893645 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a0a92-4ca0-4088-ad96-71da611a5fda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:31:59.902335 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a0a92-4ca0-4088-ad96-71da611a5fda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:31:59.903752 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a0a92-4ca0-4088-ad96-71da611a5fda service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:31:59.912956 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1369/2735] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:31:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:32:00.322666 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbbbbf-9128-4667-9784-e1c8502cd222 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:00.324101 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-43dbbbbf-9128-4667-9784-e1c8502cd222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:00.337193 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbbbbf-9128-4667-9784-e1c8502cd222 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:00.343047 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1805c4d-acbd-4354-9347-a13a3b66925e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:00.343916 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1805c4d-acbd-4354-9347-a13a3b66925e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:00.344337 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1805c4d-acbd-4354-9347-a13a3b66925e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:00.344662 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1805c4d-acbd-4354-9347-a13a3b66925e admin admin] PATH_INFO: `/v3/projects/bbb99560cb204ec29e24fb0f73010517` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:00.345946 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1805c4d-acbd-4354-9347-a13a3b66925e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbb99560cb204ec29e24fb0f73010517)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:00.347867 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1805c4d-acbd-4354-9347-a13a3b66925e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:00.509828 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-f1805c4d-acbd-4354-9347-a13a3b66925e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbb99560cb204ec29e24fb0f73010517', 'request_id': 'req-f1805c4d-acbd-4354-9347-a13a3b66925e'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:00.578525 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-f1805c4d-acbd-4354-9347-a13a3b66925e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbb99560cb204ec29e24fb0f73010517', 'request_id': 'req-f1805c4d-acbd-4354-9347-a13a3b66925e'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:00.584229 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-f1805c4d-acbd-4354-9347-a13a3b66925e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbb99560cb204ec29e24fb0f73010517', 'request_id': 'req-f1805c4d-acbd-4354-9347-a13a3b66925e'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:00.595254 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-f1805c4d-acbd-4354-9347-a13a3b66925e admin admin] The token cache is being invalidate because project bbb99560cb204ec29e24fb0f73010517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:32:00.595542 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-f1805c4d-acbd-4354-9347-a13a3b66925e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:00.596181 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-f1805c4d-acbd-4354-9347-a13a3b66925e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:00.597742 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1367/2736] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:32:00 2021] DELETE /identity/v3/projects/bbb99560cb204ec29e24fb0f73010517 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:32:00.602000 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a0a92-4ca0-4088-ad96-71da611a5fda service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:00.611918 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a0a92-4ca0-4088-ad96-71da611a5fda service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:00.667875 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d8ffb-7a39-4017-9de5-b420fabfdebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:00.668771 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d8ffb-7a39-4017-9de5-b420fabfdebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:00.669055 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d8ffb-7a39-4017-9de5-b420fabfdebc admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:00.669327 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d8ffb-7a39-4017-9de5-b420fabfdebc admin admin] PATH_INFO: `/v3/users/01fec895884349468056784d3e54cdcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:00.670689 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d8ffb-7a39-4017-9de5-b420fabfdebc admin admin] RBAC: Authorizing `identity:delete_user(user_id=01fec895884349468056784d3e54cdcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:00.672634 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d8ffb-7a39-4017-9de5-b420fabfdebc admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:00.877702 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-149d8ffb-7a39-4017-9de5-b420fabfdebc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01fec895884349468056784d3e54cdcb'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:00.878350 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-149d8ffb-7a39-4017-9de5-b420fabfdebc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01fec895884349468056784d3e54cdcb'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:00.878949 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-149d8ffb-7a39-4017-9de5-b420fabfdebc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01fec895884349468056784d3e54cdcb'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:00.885778 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-149d8ffb-7a39-4017-9de5-b420fabfdebc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01fec895884349468056784d3e54cdcb'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:00.950084 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-149d8ffb-7a39-4017-9de5-b420fabfdebc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01fec895884349468056784d3e54cdcb'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:00.967844 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1370/2737] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:32:00 2021] DELETE /identity/v3/users/01fec895884349468056784d3e54cdcb => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:32:01.448440 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1805c4d-acbd-4354-9347-a13a3b66925e admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:01.449990 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-f1805c4d-acbd-4354-9347-a13a3b66925e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:01.462613 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1805c4d-acbd-4354-9347-a13a3b66925e admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:01.517317 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629953b-0c0b-41e9-8e5b-160df2a6aabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:01.518178 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629953b-0c0b-41e9-8e5b-160df2a6aabc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:01.518464 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629953b-0c0b-41e9-8e5b-160df2a6aabc admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:01.518740 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629953b-0c0b-41e9-8e5b-160df2a6aabc admin admin] PATH_INFO: `/v3/projects/decca4db2f8d4e58aa8ca78d1d96f205` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:01.519914 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629953b-0c0b-41e9-8e5b-160df2a6aabc admin admin] RBAC: Authorizing `identity:delete_project(project_id=decca4db2f8d4e58aa8ca78d1d96f205)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:01.521812 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629953b-0c0b-41e9-8e5b-160df2a6aabc admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:01.629837 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1629953b-0c0b-41e9-8e5b-160df2a6aabc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'decca4db2f8d4e58aa8ca78d1d96f205', 'request_id': 'req-1629953b-0c0b-41e9-8e5b-160df2a6aabc'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:01.778685 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1629953b-0c0b-41e9-8e5b-160df2a6aabc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'decca4db2f8d4e58aa8ca78d1d96f205', 'request_id': 'req-1629953b-0c0b-41e9-8e5b-160df2a6aabc'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:01.784143 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1629953b-0c0b-41e9-8e5b-160df2a6aabc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'decca4db2f8d4e58aa8ca78d1d96f205', 'request_id': 'req-1629953b-0c0b-41e9-8e5b-160df2a6aabc'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:01.795404 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1629953b-0c0b-41e9-8e5b-160df2a6aabc admin admin] The token cache is being invalidate because project decca4db2f8d4e58aa8ca78d1d96f205 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:32:01.795692 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1629953b-0c0b-41e9-8e5b-160df2a6aabc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:01.796315 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1629953b-0c0b-41e9-8e5b-160df2a6aabc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:01.797889 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1368/2738] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:32:01 2021] DELETE /identity/v3/projects/decca4db2f8d4e58aa8ca78d1d96f205 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:32:01.801792 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d8ffb-7a39-4017-9de5-b420fabfdebc admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:01.803183 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-149d8ffb-7a39-4017-9de5-b420fabfdebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:01.816659 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d8ffb-7a39-4017-9de5-b420fabfdebc admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:01.870593 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81eb9b-1df8-44fb-a456-f4685211abf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:01.871477 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81eb9b-1df8-44fb-a456-f4685211abf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:01.871761 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81eb9b-1df8-44fb-a456-f4685211abf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:01.872052 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81eb9b-1df8-44fb-a456-f4685211abf3 admin admin] PATH_INFO: `/v3/users/1830187b64e64aeb863e5a1abfa6253b` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:01.873799 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81eb9b-1df8-44fb-a456-f4685211abf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1830187b64e64aeb863e5a1abfa6253b)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:01.875732 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81eb9b-1df8-44fb-a456-f4685211abf3 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:02.048990 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-cf81eb9b-1df8-44fb-a456-f4685211abf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1830187b64e64aeb863e5a1abfa6253b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:02.049764 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-cf81eb9b-1df8-44fb-a456-f4685211abf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1830187b64e64aeb863e5a1abfa6253b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:02.050460 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-cf81eb9b-1df8-44fb-a456-f4685211abf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1830187b64e64aeb863e5a1abfa6253b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:02.057425 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-cf81eb9b-1df8-44fb-a456-f4685211abf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1830187b64e64aeb863e5a1abfa6253b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:02.207298 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-cf81eb9b-1df8-44fb-a456-f4685211abf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1830187b64e64aeb863e5a1abfa6253b'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:02.225676 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1371/2739] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:32:01 2021] DELETE /identity/v3/users/1830187b64e64aeb863e5a1abfa6253b => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:32:02.740719 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629953b-0c0b-41e9-8e5b-160df2a6aabc admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:02.742233 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-1629953b-0c0b-41e9-8e5b-160df2a6aabc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:02.756002 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629953b-0c0b-41e9-8e5b-160df2a6aabc admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:02.810308 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a37b1-2f2e-4bb4-98ae-d45fcefd2ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:02.811185 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a37b1-2f2e-4bb4-98ae-d45fcefd2ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:02.811471 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a37b1-2f2e-4bb4-98ae-d45fcefd2ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:02.811749 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a37b1-2f2e-4bb4-98ae-d45fcefd2ab8 admin admin] PATH_INFO: `/v3/projects/3a3c430e93d14c0085207c2897cd0c3b` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:02.813050 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a37b1-2f2e-4bb4-98ae-d45fcefd2ab8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a3c430e93d14c0085207c2897cd0c3b)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:02.815093 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a37b1-2f2e-4bb4-98ae-d45fcefd2ab8 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:02.937414 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-da2a37b1-2f2e-4bb4-98ae-d45fcefd2ab8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a3c430e93d14c0085207c2897cd0c3b', 'request_id': 'req-da2a37b1-2f2e-4bb4-98ae-d45fcefd2ab8'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:03.012892 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-da2a37b1-2f2e-4bb4-98ae-d45fcefd2ab8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a3c430e93d14c0085207c2897cd0c3b', 'request_id': 'req-da2a37b1-2f2e-4bb4-98ae-d45fcefd2ab8'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:03.018578 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-da2a37b1-2f2e-4bb4-98ae-d45fcefd2ab8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a3c430e93d14c0085207c2897cd0c3b', 'request_id': 'req-da2a37b1-2f2e-4bb4-98ae-d45fcefd2ab8'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:03.029803 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-da2a37b1-2f2e-4bb4-98ae-d45fcefd2ab8 admin admin] The token cache is being invalidate because project 3a3c430e93d14c0085207c2897cd0c3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:32:03.030085 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-da2a37b1-2f2e-4bb4-98ae-d45fcefd2ab8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:03.030719 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-da2a37b1-2f2e-4bb4-98ae-d45fcefd2ab8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:03.032244 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1369/2740] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:32:02 2021] DELETE /identity/v3/projects/3a3c430e93d14c0085207c2897cd0c3b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:32:03.038892 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8385df1-90e2-469b-869b-676aed6267d9 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:03.039370 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8385df1-90e2-469b-869b-676aed6267d9 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:03.039479 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8385df1-90e2-469b-869b-676aed6267d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:03.057898 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-f8385df1-90e2-469b-869b-676aed6267d9 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:32:03.059141 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-f8385df1-90e2-469b-869b-676aed6267d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:03.115800 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1372/2741] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:32:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:32:03.124038 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299539d-46f2-4165-9876-c3a0629c4608 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:03.124332 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299539d-46f2-4165-9876-c3a0629c4608 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:03.124651 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299539d-46f2-4165-9876-c3a0629c4608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:03.144723 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-3299539d-46f2-4165-9876-c3a0629c4608 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:32:03.145951 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-3299539d-46f2-4165-9876-c3a0629c4608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:03.154746 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1370/2742] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:32:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:32:03.158945 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8385df1-90e2-469b-869b-676aed6267d9 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:03.168579 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8385df1-90e2-469b-869b-676aed6267d9 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:03.173236 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e8406-af1e-4e02-9692-d99541fdcb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:03.173893 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e8406-af1e-4e02-9692-d99541fdcb1d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:03.174177 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e8406-af1e-4e02-9692-d99541fdcb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:03.174457 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e8406-af1e-4e02-9692-d99541fdcb1d admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:03.175185 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e8406-af1e-4e02-9692-d99541fdcb1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:32:03.175498 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e8406-af1e-4e02-9692-d99541fdcb1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:03.177140 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e8406-af1e-4e02-9692-d99541fdcb1d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:03.188377 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1373/2743] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:32:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:32:03.192364 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299539d-46f2-4165-9876-c3a0629c4608 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:03.201730 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299539d-46f2-4165-9876-c3a0629c4608 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:03.206358 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d290cd9-2edf-49bc-9066-80f010b2a670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:03.207001 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d290cd9-2edf-49bc-9066-80f010b2a670 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:03.207290 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d290cd9-2edf-49bc-9066-80f010b2a670 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:03.207565 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d290cd9-2edf-49bc-9066-80f010b2a670 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:03.208255 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d290cd9-2edf-49bc-9066-80f010b2a670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:03.210181 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d290cd9-2edf-49bc-9066-80f010b2a670 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:03.323753 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1371/2744] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:32:03 2021] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:32:03.327093 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e8406-af1e-4e02-9692-d99541fdcb1d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:03.337391 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e8406-af1e-4e02-9692-d99541fdcb1d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:03.392322 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab157c6-733b-4df2-b4eb-e6c5c58b4c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:03.393024 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab157c6-733b-4df2-b4eb-e6c5c58b4c96 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:03.393309 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab157c6-733b-4df2-b4eb-e6c5c58b4c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:03.393583 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab157c6-733b-4df2-b4eb-e6c5c58b4c96 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:03.394274 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab157c6-733b-4df2-b4eb-e6c5c58b4c96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:03.396266 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab157c6-733b-4df2-b4eb-e6c5c58b4c96 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:03.492256 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1374/2745] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:32:03 2021] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 03:32:03.496482 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d290cd9-2edf-49bc-9066-80f010b2a670 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:03.507305 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d290cd9-2edf-49bc-9066-80f010b2a670 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:03.512002 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68780853-34ba-4f18-bc0c-d0edce1c9807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:03.512702 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68780853-34ba-4f18-bc0c-d0edce1c9807 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:03.512986 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68780853-34ba-4f18-bc0c-d0edce1c9807 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:03.513264 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68780853-34ba-4f18-bc0c-d0edce1c9807 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:03.513992 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68780853-34ba-4f18-bc0c-d0edce1c9807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:03.515613 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68780853-34ba-4f18-bc0c-d0edce1c9807 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:03.525683 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1372/2746] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:32:03 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:32:03.529983 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab157c6-733b-4df2-b4eb-e6c5c58b4c96 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:03.539750 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab157c6-733b-4df2-b4eb-e6c5c58b4c96 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:03.544407 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce95e04-fe96-4d01-bfa5-075769660203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:03.545674 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce95e04-fe96-4d01-bfa5-075769660203 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:03.545960 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce95e04-fe96-4d01-bfa5-075769660203 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:03.546237 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce95e04-fe96-4d01-bfa5-075769660203 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:03.546957 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce95e04-fe96-4d01-bfa5-075769660203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:03.548571 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce95e04-fe96-4d01-bfa5-075769660203 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:03.558481 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1375/2747] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:32:03 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:32:03.562823 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68780853-34ba-4f18-bc0c-d0edce1c9807 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:03.572399 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68780853-34ba-4f18-bc0c-d0edce1c9807 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:03.577707 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7755e-6ccd-4b08-8b63-83712dd53261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:03.578515 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7755e-6ccd-4b08-8b63-83712dd53261 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:03.578797 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7755e-6ccd-4b08-8b63-83712dd53261 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:03.579074 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7755e-6ccd-4b08-8b63-83712dd53261 admin admin] PATH_INFO: `/v3/projects/21d0cf8b4dcd46ac9bba47d13c422e52/users/890a013c7aa445fc9bb7fa99af3c8357/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:03.593245 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7755e-6ccd-4b08-8b63-83712dd53261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d0cf8b4dcd46ac9bba47d13c422e52, user_id=890a013c7aa445fc9bb7fa99af3c8357, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:03.596002 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7755e-6ccd-4b08-8b63-83712dd53261 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:03.681887 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1373/2748] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:32:03 2021] PUT /identity/v3/projects/21d0cf8b4dcd46ac9bba47d13c422e52/users/890a013c7aa445fc9bb7fa99af3c8357/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:32:03.693038 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dd764-9c0a-4812-a69e-ec6d2c2f477f None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:03.693326 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dd764-9c0a-4812-a69e-ec6d2c2f477f None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:03.693606 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dd764-9c0a-4812-a69e-ec6d2c2f477f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:03.719535 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-9e6dd764-9c0a-4812-a69e-ec6d2c2f477f None None] MFA Rules not processed for user `890a013c7aa445fc9bb7fa99af3c8357`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:32:03.720769 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-9e6dd764-9c0a-4812-a69e-ec6d2c2f477f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:03.780796 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1376/2749] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:32:03 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:32:03.785187 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7755e-6ccd-4b08-8b63-83712dd53261 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:03.844334 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7755e-6ccd-4b08-8b63-83712dd53261 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:03.849123 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0936de-772e-4fbf-8525-d0def8c61771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:03.849784 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0936de-772e-4fbf-8525-d0def8c61771 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:03.850064 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0936de-772e-4fbf-8525-d0def8c61771 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:03.850340 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0936de-772e-4fbf-8525-d0def8c61771 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:03.851036 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0936de-772e-4fbf-8525-d0def8c61771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:03.852992 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0936de-772e-4fbf-8525-d0def8c61771 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:03.961977 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1374/2750] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:32:03 2021] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:32:03.966266 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6dd764-9c0a-4812-a69e-ec6d2c2f477f None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:03.976918 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6dd764-9c0a-4812-a69e-ec6d2c2f477f None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:04.031538 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ac1bf-bfe0-44ea-957d-f3e63fd40322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:04.032213 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ac1bf-bfe0-44ea-957d-f3e63fd40322 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:04.032559 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ac1bf-bfe0-44ea-957d-f3e63fd40322 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:04.032787 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ac1bf-bfe0-44ea-957d-f3e63fd40322 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:04.033479 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ac1bf-bfe0-44ea-957d-f3e63fd40322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:04.035371 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ac1bf-bfe0-44ea-957d-f3e63fd40322 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:04.127006 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1377/2751] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:32:03 2021] POST /identity/v3/users => generated 294 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:32:04.131049 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0936de-772e-4fbf-8525-d0def8c61771 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:04.141358 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0936de-772e-4fbf-8525-d0def8c61771 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:04.146030 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f5a29-61dd-42a3-8840-42b748cf2786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:04.150003 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f5a29-61dd-42a3-8840-42b748cf2786 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:04.150003 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f5a29-61dd-42a3-8840-42b748cf2786 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:04.150003 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f5a29-61dd-42a3-8840-42b748cf2786 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:04.150003 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f5a29-61dd-42a3-8840-42b748cf2786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:04.150003 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f5a29-61dd-42a3-8840-42b748cf2786 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:04.160236 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1375/2752] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:32:04 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:32:04.164143 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ac1bf-bfe0-44ea-957d-f3e63fd40322 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:04.174543 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ac1bf-bfe0-44ea-957d-f3e63fd40322 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:04.179186 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4331b-66a8-4ed0-9c98-b3356ea2e49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:04.180041 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4331b-66a8-4ed0-9c98-b3356ea2e49f admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:04.180328 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4331b-66a8-4ed0-9c98-b3356ea2e49f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:04.180646 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4331b-66a8-4ed0-9c98-b3356ea2e49f admin admin] PATH_INFO: `/v3/projects/8257ada8ee8c4d42b4e3f37f85921772/users/3db6754087c547dc9264d427e2ceb404/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:04.195534 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4331b-66a8-4ed0-9c98-b3356ea2e49f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8257ada8ee8c4d42b4e3f37f85921772, user_id=3db6754087c547dc9264d427e2ceb404, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:04.198269 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4331b-66a8-4ed0-9c98-b3356ea2e49f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:04.270076 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1378/2753] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:32:04 2021] PUT /identity/v3/projects/8257ada8ee8c4d42b4e3f37f85921772/users/3db6754087c547dc9264d427e2ceb404/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:32:04.274113 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f5a29-61dd-42a3-8840-42b748cf2786 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:04.284438 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f5a29-61dd-42a3-8840-42b748cf2786 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:04.339067 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc026328-1969-4c8b-b266-74db8e22ab50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:04.339767 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc026328-1969-4c8b-b266-74db8e22ab50 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:04.340054 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc026328-1969-4c8b-b266-74db8e22ab50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:04.340335 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc026328-1969-4c8b-b266-74db8e22ab50 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:04.341348 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc026328-1969-4c8b-b266-74db8e22ab50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:04.342942 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc026328-1969-4c8b-b266-74db8e22ab50 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:04.352348 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1376/2754] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:32:04 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:32:04.356433 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4331b-66a8-4ed0-9c98-b3356ea2e49f admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:04.366485 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4331b-66a8-4ed0-9c98-b3356ea2e49f admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:04.371103 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceacfb3-efbe-4486-9767-11de06112b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:04.371974 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceacfb3-efbe-4486-9767-11de06112b6f admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:04.372252 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceacfb3-efbe-4486-9767-11de06112b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:04.373051 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceacfb3-efbe-4486-9767-11de06112b6f admin admin] PATH_INFO: `/v3/projects/8257ada8ee8c4d42b4e3f37f85921772/users/3db6754087c547dc9264d427e2ceb404/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:04.375035 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceacfb3-efbe-4486-9767-11de06112b6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8257ada8ee8c4d42b4e3f37f85921772, user_id=3db6754087c547dc9264d427e2ceb404, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:04.377735 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceacfb3-efbe-4486-9767-11de06112b6f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:04.387725 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1379/2755] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:32:04 2021] PUT /identity/v3/projects/8257ada8ee8c4d42b4e3f37f85921772/users/3db6754087c547dc9264d427e2ceb404/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:32:04.398833 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0517a-f42c-4cf4-9a79-8faf77d14a72 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:04.399124 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0517a-f42c-4cf4-9a79-8faf77d14a72 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:04.399408 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0517a-f42c-4cf4-9a79-8faf77d14a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:04.425152 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-fdb0517a-f42c-4cf4-9a79-8faf77d14a72 None None] MFA Rules not processed for user `3db6754087c547dc9264d427e2ceb404`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:32:04.426378 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-fdb0517a-f42c-4cf4-9a79-8faf77d14a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:04.490256 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1377/2756] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:32:04 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:32:04.501041 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceacfb3-efbe-4486-9767-11de06112b6f admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:04.502711 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-4ceacfb3-efbe-4486-9767-11de06112b6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:04.558449 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceacfb3-efbe-4486-9767-11de06112b6f admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:04.562635 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f3877-b88d-4324-92b3-bf52dc86c7b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:04.563275 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f3877-b88d-4324-92b3-bf52dc86c7b1 service cinder] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:04.563557 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f3877-b88d-4324-92b3-bf52dc86c7b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:04.563832 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f3877-b88d-4324-92b3-bf52dc86c7b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:04.616679 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f3877-b88d-4324-92b3-bf52dc86c7b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:04.618133 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f3877-b88d-4324-92b3-bf52dc86c7b1 service cinder] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:04.627376 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1380/2757] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:32:04 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:32:07.720500 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0517a-f42c-4cf4-9a79-8faf77d14a72 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:07.779175 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0517a-f42c-4cf4-9a79-8faf77d14a72 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:07.783671 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c2544-366e-4edf-a5e7-d5524dbd3002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:07.784553 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c2544-366e-4edf-a5e7-d5524dbd3002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:07.784836 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c2544-366e-4edf-a5e7-d5524dbd3002 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:07.785109 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c2544-366e-4edf-a5e7-d5524dbd3002 admin admin] PATH_INFO: `/v3/users/890a013c7aa445fc9bb7fa99af3c8357` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:07.786307 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c2544-366e-4edf-a5e7-d5524dbd3002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=890a013c7aa445fc9bb7fa99af3c8357)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:07.788202 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c2544-366e-4edf-a5e7-d5524dbd3002 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:07.946021 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1e7c2544-366e-4edf-a5e7-d5524dbd3002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '890a013c7aa445fc9bb7fa99af3c8357'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:07.946697 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1e7c2544-366e-4edf-a5e7-d5524dbd3002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '890a013c7aa445fc9bb7fa99af3c8357'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:07.953307 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1e7c2544-366e-4edf-a5e7-d5524dbd3002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '890a013c7aa445fc9bb7fa99af3c8357'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:08.023722 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1e7c2544-366e-4edf-a5e7-d5524dbd3002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '890a013c7aa445fc9bb7fa99af3c8357'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:08.035570 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1e7c2544-366e-4edf-a5e7-d5524dbd3002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '890a013c7aa445fc9bb7fa99af3c8357'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:08.041316 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1378/2758] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:32:07 2021] DELETE /identity/v3/users/890a013c7aa445fc9bb7fa99af3c8357 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:32:08.075606 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ea6f5-0723-44d3-941a-4a1f66187523 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:08.075606 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ea6f5-0723-44d3-941a-4a1f66187523 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:08.075606 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ea6f5-0723-44d3-941a-4a1f66187523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:08.075606 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-9b6ea6f5-0723-44d3-941a-4a1f66187523 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:32:08.075606 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-9b6ea6f5-0723-44d3-941a-4a1f66187523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:08.121664 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1381/2759] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:32:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 03:32:08.131792 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c2544-366e-4edf-a5e7-d5524dbd3002 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:08.135284 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-1e7c2544-366e-4edf-a5e7-d5524dbd3002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:08.199667 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c2544-366e-4edf-a5e7-d5524dbd3002 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:08.203390 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f24f9-e177-4dd7-910c-985d2180b940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:08.204042 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f24f9-e177-4dd7-910c-985d2180b940 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:08.204325 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f24f9-e177-4dd7-910c-985d2180b940 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:08.204635 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f24f9-e177-4dd7-910c-985d2180b940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:08.213348 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f24f9-e177-4dd7-910c-985d2180b940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:08.214774 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f24f9-e177-4dd7-910c-985d2180b940 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:08.224790 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1379/2760] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:32:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:32:08.642864 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ea6f5-0723-44d3-941a-4a1f66187523 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:08.644341 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-9b6ea6f5-0723-44d3-941a-4a1f66187523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:08.656535 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ea6f5-0723-44d3-941a-4a1f66187523 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:08.661234 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed88a7a-0d9f-48d0-8fd9-4a6487e8ae7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:08.662095 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed88a7a-0d9f-48d0-8fd9-4a6487e8ae7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:08.662376 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed88a7a-0d9f-48d0-8fd9-4a6487e8ae7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:08.662652 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed88a7a-0d9f-48d0-8fd9-4a6487e8ae7a admin admin] PATH_INFO: `/v3/projects/21d0cf8b4dcd46ac9bba47d13c422e52` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:08.663896 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed88a7a-0d9f-48d0-8fd9-4a6487e8ae7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=21d0cf8b4dcd46ac9bba47d13c422e52)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:08.665863 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed88a7a-0d9f-48d0-8fd9-4a6487e8ae7a admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:08.786022 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-6ed88a7a-0d9f-48d0-8fd9-4a6487e8ae7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21d0cf8b4dcd46ac9bba47d13c422e52', 'request_id': 'req-6ed88a7a-0d9f-48d0-8fd9-4a6487e8ae7a'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:08.859126 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-6ed88a7a-0d9f-48d0-8fd9-4a6487e8ae7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21d0cf8b4dcd46ac9bba47d13c422e52', 'request_id': 'req-6ed88a7a-0d9f-48d0-8fd9-4a6487e8ae7a'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:08.865292 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-6ed88a7a-0d9f-48d0-8fd9-4a6487e8ae7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21d0cf8b4dcd46ac9bba47d13c422e52', 'request_id': 'req-6ed88a7a-0d9f-48d0-8fd9-4a6487e8ae7a'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:08.876132 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-6ed88a7a-0d9f-48d0-8fd9-4a6487e8ae7a admin admin] The token cache is being invalidate because project 21d0cf8b4dcd46ac9bba47d13c422e52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:32:08.876437 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-6ed88a7a-0d9f-48d0-8fd9-4a6487e8ae7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:08.877088 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-6ed88a7a-0d9f-48d0-8fd9-4a6487e8ae7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:08.878653 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1382/2761] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:32:08 2021] DELETE /identity/v3/projects/21d0cf8b4dcd46ac9bba47d13c422e52 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:32:08.882641 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f24f9-e177-4dd7-910c-985d2180b940 service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:08.892245 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f24f9-e177-4dd7-910c-985d2180b940 service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:08.946117 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3282a-39ad-495a-9d7a-3e3719c5c686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:08.947019 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3282a-39ad-495a-9d7a-3e3719c5c686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:08.947303 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3282a-39ad-495a-9d7a-3e3719c5c686 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:08.947577 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3282a-39ad-495a-9d7a-3e3719c5c686 admin admin] PATH_INFO: `/v3/users/3db6754087c547dc9264d427e2ceb404` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:08.948792 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3282a-39ad-495a-9d7a-3e3719c5c686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3db6754087c547dc9264d427e2ceb404)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:08.950737 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3282a-39ad-495a-9d7a-3e3719c5c686 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:09.141069 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-3bd3282a-39ad-495a-9d7a-3e3719c5c686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3db6754087c547dc9264d427e2ceb404'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:09.141726 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-3bd3282a-39ad-495a-9d7a-3e3719c5c686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3db6754087c547dc9264d427e2ceb404'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:09.152139 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-3bd3282a-39ad-495a-9d7a-3e3719c5c686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3db6754087c547dc9264d427e2ceb404'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:09.218127 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-3bd3282a-39ad-495a-9d7a-3e3719c5c686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3db6754087c547dc9264d427e2ceb404'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:09.230347 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-3bd3282a-39ad-495a-9d7a-3e3719c5c686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3db6754087c547dc9264d427e2ceb404'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:09.236697 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1380/2762] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:32:08 2021] DELETE /identity/v3/users/3db6754087c547dc9264d427e2ceb404 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:32:09.630984 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed88a7a-0d9f-48d0-8fd9-4a6487e8ae7a admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:09.632453 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-6ed88a7a-0d9f-48d0-8fd9-4a6487e8ae7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:09.646146 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed88a7a-0d9f-48d0-8fd9-4a6487e8ae7a admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:09.700070 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44a298-a733-4c23-ae54-c412e0f40d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:09.700970 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44a298-a733-4c23-ae54-c412e0f40d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:09.701253 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44a298-a733-4c23-ae54-c412e0f40d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:09.701528 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44a298-a733-4c23-ae54-c412e0f40d2f admin admin] PATH_INFO: `/v3/projects/8257ada8ee8c4d42b4e3f37f85921772` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:09.702681 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44a298-a733-4c23-ae54-c412e0f40d2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8257ada8ee8c4d42b4e3f37f85921772)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:09.704578 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44a298-a733-4c23-ae54-c412e0f40d2f admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:09.806551 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-9e44a298-a733-4c23-ae54-c412e0f40d2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8257ada8ee8c4d42b4e3f37f85921772', 'request_id': 'req-9e44a298-a733-4c23-ae54-c412e0f40d2f'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:09.858717 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-9e44a298-a733-4c23-ae54-c412e0f40d2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8257ada8ee8c4d42b4e3f37f85921772', 'request_id': 'req-9e44a298-a733-4c23-ae54-c412e0f40d2f'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:09.864384 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-9e44a298-a733-4c23-ae54-c412e0f40d2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8257ada8ee8c4d42b4e3f37f85921772', 'request_id': 'req-9e44a298-a733-4c23-ae54-c412e0f40d2f'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:09.875484 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-9e44a298-a733-4c23-ae54-c412e0f40d2f admin admin] The token cache is being invalidate because project 8257ada8ee8c4d42b4e3f37f85921772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:32:09.875767 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-9e44a298-a733-4c23-ae54-c412e0f40d2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:09.876425 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-9e44a298-a733-4c23-ae54-c412e0f40d2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:32:09.878317 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1383/2763] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:32:09 2021] DELETE /identity/v3/projects/8257ada8ee8c4d42b4e3f37f85921772 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:32:09.886212 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac1056-dc4d-48b0-b66f-e1f9da692b1a None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:09.886683 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac1056-dc4d-48b0-b66f-e1f9da692b1a None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:09.886793 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac1056-dc4d-48b0-b66f-e1f9da692b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:09.904860 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-11ac1056-dc4d-48b0-b66f-e1f9da692b1a None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:32:09.906059 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-11ac1056-dc4d-48b0-b66f-e1f9da692b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:09.961714 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1381/2764] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:32:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:32:09.970589 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856d1ea-fdaa-48c4-9cbe-43de66a34966 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:09.970874 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856d1ea-fdaa-48c4-9cbe-43de66a34966 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:09.971151 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856d1ea-fdaa-48c4-9cbe-43de66a34966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:09.989104 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-5856d1ea-fdaa-48c4-9cbe-43de66a34966 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:32:09.990281 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-5856d1ea-fdaa-48c4-9cbe-43de66a34966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:09.998011 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1384/2765] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:32:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:32:10.001999 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac1056-dc4d-48b0-b66f-e1f9da692b1a None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:10.011373 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac1056-dc4d-48b0-b66f-e1f9da692b1a None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:10.016568 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cecb9-4865-4dd5-91d6-c099cdb5f14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:10.017222 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cecb9-4865-4dd5-91d6-c099cdb5f14b admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:10.017503 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cecb9-4865-4dd5-91d6-c099cdb5f14b admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:10.017780 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cecb9-4865-4dd5-91d6-c099cdb5f14b admin admin] PATH_INFO: `/v3/domains` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:10.018493 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51cecb9-4865-4dd5-91d6-c099cdb5f14b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73781) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:32:10.018807 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51cecb9-4865-4dd5-91d6-c099cdb5f14b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:10.020391 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51cecb9-4865-4dd5-91d6-c099cdb5f14b admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:10.032547 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1382/2766] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:32:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:32:10.036708 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856d1ea-fdaa-48c4-9cbe-43de66a34966 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:10.045571 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856d1ea-fdaa-48c4-9cbe-43de66a34966 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:10.050186 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1e833-b709-4307-9394-5cd8eada2197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:10.050828 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1e833-b709-4307-9394-5cd8eada2197 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:10.051106 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1e833-b709-4307-9394-5cd8eada2197 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:10.051378 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1e833-b709-4307-9394-5cd8eada2197 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:10.052064 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1e833-b709-4307-9394-5cd8eada2197 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:10.054007 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1e833-b709-4307-9394-5cd8eada2197 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:10.121827 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1385/2767] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:32:10 2021] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:32:10.125870 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cecb9-4865-4dd5-91d6-c099cdb5f14b admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:10.135614 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cecb9-4865-4dd5-91d6-c099cdb5f14b admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:10.191537 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964b6cb-a006-4a2f-bf56-e1b03ec771b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:10.191537 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964b6cb-a006-4a2f-bf56-e1b03ec771b1 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:10.191537 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964b6cb-a006-4a2f-bf56-e1b03ec771b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:10.191537 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964b6cb-a006-4a2f-bf56-e1b03ec771b1 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:10.191946 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964b6cb-a006-4a2f-bf56-e1b03ec771b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:10.192779 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964b6cb-a006-4a2f-bf56-e1b03ec771b1 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:10.253058 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1383/2768] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:32:10 2021] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:32:10.257017 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1e833-b709-4307-9394-5cd8eada2197 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:10.267788 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1e833-b709-4307-9394-5cd8eada2197 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:10.272370 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112861e-0972-4f83-b755-e611fed0d601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:10.273058 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112861e-0972-4f83-b755-e611fed0d601 admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:10.273336 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112861e-0972-4f83-b755-e611fed0d601 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:10.273607 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112861e-0972-4f83-b755-e611fed0d601 admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:10.274319 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112861e-0972-4f83-b755-e611fed0d601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:10.275893 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112861e-0972-4f83-b755-e611fed0d601 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:10.286079 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1386/2769] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:32:10 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:32:10.289850 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964b6cb-a006-4a2f-bf56-e1b03ec771b1 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:10.299804 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964b6cb-a006-4a2f-bf56-e1b03ec771b1 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:10.304695 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0bb38-8a60-46f4-9194-f38600986826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:10.305354 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0bb38-8a60-46f4-9194-f38600986826 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:10.305641 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0bb38-8a60-46f4-9194-f38600986826 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:10.305923 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0bb38-8a60-46f4-9194-f38600986826 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:10.306644 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0bb38-8a60-46f4-9194-f38600986826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:10.308224 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0bb38-8a60-46f4-9194-f38600986826 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:10.318455 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1384/2770] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:32:10 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:32:10.322232 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112861e-0972-4f83-b755-e611fed0d601 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:10.333663 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112861e-0972-4f83-b755-e611fed0d601 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:10.338336 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2334c-f705-4dd9-8469-5b1ae107f7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:10.339237 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2334c-f705-4dd9-8469-5b1ae107f7ef admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:10.341571 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2334c-f705-4dd9-8469-5b1ae107f7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:10.341571 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2334c-f705-4dd9-8469-5b1ae107f7ef admin admin] PATH_INFO: `/v3/projects/d44cc135efd34c2ebd0b06caba26bca7/users/9f095853fa9e478699437602d269e7df/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:10.354080 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2334c-f705-4dd9-8469-5b1ae107f7ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=d44cc135efd34c2ebd0b06caba26bca7, user_id=9f095853fa9e478699437602d269e7df, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:10.356727 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2334c-f705-4dd9-8469-5b1ae107f7ef admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:10.435439 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1387/2771] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:32:10 2021] PUT /identity/v3/projects/d44cc135efd34c2ebd0b06caba26bca7/users/9f095853fa9e478699437602d269e7df/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:32:10.440628 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc484b-ce2c-4afa-a68c-9cf6577dabdf None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:10.440925 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc484b-ce2c-4afa-a68c-9cf6577dabdf None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:10.441210 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc484b-ce2c-4afa-a68c-9cf6577dabdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:10.459309 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-f1dc484b-ce2c-4afa-a68c-9cf6577dabdf None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:32:10.460543 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-f1dc484b-ce2c-4afa-a68c-9cf6577dabdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:10.516277 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1385/2772] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:32:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:32:10.525905 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2334c-f705-4dd9-8469-5b1ae107f7ef admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:10.527573 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-49a2334c-f705-4dd9-8469-5b1ae107f7ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:10.582267 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2334c-f705-4dd9-8469-5b1ae107f7ef admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:10.585956 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c09bf-3a1d-4962-a62e-d8fb57993b3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:10.586598 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c09bf-3a1d-4962-a62e-d8fb57993b3e service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:10.586883 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c09bf-3a1d-4962-a62e-d8fb57993b3e service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:10.587162 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c09bf-3a1d-4962-a62e-d8fb57993b3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:10.596357 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c09bf-3a1d-4962-a62e-d8fb57993b3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:10.597811 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c09bf-3a1d-4962-a62e-d8fb57993b3e service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:10.607138 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1388/2773] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:32:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:32:15.869676 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8331e2-cbef-41d1-9631-c6e6c2ad66a7 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:15.870158 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8331e2-cbef-41d1-9631-c6e6c2ad66a7 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:15.870258 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8331e2-cbef-41d1-9631-c6e6c2ad66a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:15.898913 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-db8331e2-cbef-41d1-9631-c6e6c2ad66a7 None None] MFA Rules not processed for user `9f095853fa9e478699437602d269e7df`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:32:15.900182 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-db8331e2-cbef-41d1-9631-c6e6c2ad66a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:15.978653 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1386/2774] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:32:15 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:32:15.983840 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c09bf-3a1d-4962-a62e-d8fb57993b3e service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:15.994158 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c09bf-3a1d-4962-a62e-d8fb57993b3e service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:15.999094 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ffb41-06b5-40ca-8ab2-26f5e27ce758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:15.999762 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ffb41-06b5-40ca-8ab2-26f5e27ce758 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:16.000042 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ffb41-06b5-40ca-8ab2-26f5e27ce758 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:16.000316 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ffb41-06b5-40ca-8ab2-26f5e27ce758 admin admin] PATH_INFO: `/v3/projects` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:16.001078 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ffb41-06b5-40ca-8ab2-26f5e27ce758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:16.002974 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ffb41-06b5-40ca-8ab2-26f5e27ce758 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:16.129006 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1389/2775] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:32:15 2021] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:32:16.132849 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8331e2-cbef-41d1-9631-c6e6c2ad66a7 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:16.144299 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8331e2-cbef-41d1-9631-c6e6c2ad66a7 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:16.198927 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed4e2c-5ad2-4c37-a292-4f1881860a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:16.199628 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed4e2c-5ad2-4c37-a292-4f1881860a91 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:16.199914 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed4e2c-5ad2-4c37-a292-4f1881860a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:16.200741 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed4e2c-5ad2-4c37-a292-4f1881860a91 admin admin] PATH_INFO: `/v3/users` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:16.201458 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed4e2c-5ad2-4c37-a292-4f1881860a91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:16.203574 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed4e2c-5ad2-4c37-a292-4f1881860a91 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:16.338466 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1387/2776] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:32:16 2021] POST /identity/v3/users => generated 299 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:32:16.342960 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ffb41-06b5-40ca-8ab2-26f5e27ce758 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:16.353182 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ffb41-06b5-40ca-8ab2-26f5e27ce758 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:16.357888 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7e3bd-db87-454d-a10b-84a484acdb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:16.359600 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7e3bd-db87-454d-a10b-84a484acdb9d admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:16.359600 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7e3bd-db87-454d-a10b-84a484acdb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:16.359600 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7e3bd-db87-454d-a10b-84a484acdb9d admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:16.359929 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7e3bd-db87-454d-a10b-84a484acdb9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:16.361464 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7e3bd-db87-454d-a10b-84a484acdb9d admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:16.371904 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1390/2777] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:32:16 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 03:32:16.376632 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed4e2c-5ad2-4c37-a292-4f1881860a91 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:16.386703 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed4e2c-5ad2-4c37-a292-4f1881860a91 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:16.392181 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ff187-9659-415f-8688-66828f620b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:16.393170 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ff187-9659-415f-8688-66828f620b4d admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:16.393540 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ff187-9659-415f-8688-66828f620b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:16.393845 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ff187-9659-415f-8688-66828f620b4d admin admin] PATH_INFO: `/v3/projects/310ac3cbcd994b1b9899ade1af4dd1d3/users/eede7b0ee9f24c7cabe73417235977c9/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:16.408657 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ff187-9659-415f-8688-66828f620b4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=310ac3cbcd994b1b9899ade1af4dd1d3, user_id=eede7b0ee9f24c7cabe73417235977c9, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:16.411360 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ff187-9659-415f-8688-66828f620b4d admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:16.538694 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1388/2778] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:32:16 2021] PUT /identity/v3/projects/310ac3cbcd994b1b9899ade1af4dd1d3/users/eede7b0ee9f24c7cabe73417235977c9/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:32:16.542637 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7e3bd-db87-454d-a10b-84a484acdb9d admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:16.552429 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7e3bd-db87-454d-a10b-84a484acdb9d admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:16.607044 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f6066-c009-49e1-95e3-de44634b6a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:16.607726 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f6066-c009-49e1-95e3-de44634b6a6e admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:16.608010 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f6066-c009-49e1-95e3-de44634b6a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:16.608286 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f6066-c009-49e1-95e3-de44634b6a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:16.609082 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f6066-c009-49e1-95e3-de44634b6a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:16.610685 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f6066-c009-49e1-95e3-de44634b6a6e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:16.620922 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1391/2779] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:32:16 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:32:16.625586 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ff187-9659-415f-8688-66828f620b4d admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:16.636214 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ff187-9659-415f-8688-66828f620b4d admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:16.641892 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6d4b0-19a3-47bf-a394-f61daf758a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:16.642788 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6d4b0-19a3-47bf-a394-f61daf758a70 admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:16.643070 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6d4b0-19a3-47bf-a394-f61daf758a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:16.643347 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6d4b0-19a3-47bf-a394-f61daf758a70 admin admin] PATH_INFO: `/v3/projects/310ac3cbcd994b1b9899ade1af4dd1d3/users/eede7b0ee9f24c7cabe73417235977c9/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:16.645360 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6d4b0-19a3-47bf-a394-f61daf758a70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=310ac3cbcd994b1b9899ade1af4dd1d3, user_id=eede7b0ee9f24c7cabe73417235977c9, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:16.648027 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6d4b0-19a3-47bf-a394-f61daf758a70 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:16.658689 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1389/2780] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:32:16 2021] PUT /identity/v3/projects/310ac3cbcd994b1b9899ade1af4dd1d3/users/eede7b0ee9f24c7cabe73417235977c9/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:32:22.091334 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16bf77-3fba-47e3-b64d-4940e576c569 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:22.091805 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16bf77-3fba-47e3-b64d-4940e576c569 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:22.091916 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16bf77-3fba-47e3-b64d-4940e576c569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:22.122997 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-aa16bf77-3fba-47e3-b64d-4940e576c569 None None] MFA Rules not processed for user `eede7b0ee9f24c7cabe73417235977c9`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:32:22.124171 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-aa16bf77-3fba-47e3-b64d-4940e576c569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:22.192675 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1392/2781] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:32:22 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:32:22.205820 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6d4b0-19a3-47bf-a394-f61daf758a70 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:22.207608 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-9bd6d4b0-19a3-47bf-a394-f61daf758a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:22.308871 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6d4b0-19a3-47bf-a394-f61daf758a70 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:22.312690 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41ed8e-ace8-449a-a232-51676adfb110 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83242c1ef12d4a5b800e67346f4ad963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:22.313351 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41ed8e-ace8-449a-a232-51676adfb110 service glance] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:22.313637 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41ed8e-ace8-449a-a232-51676adfb110 service glance] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:22.314076 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41ed8e-ace8-449a-a232-51676adfb110 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:22.373629 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41ed8e-ace8-449a-a232-51676adfb110 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:22.375065 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41ed8e-ace8-449a-a232-51676adfb110 service glance] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:22.384394 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1390/2782] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:32:22 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:32:22.614387 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab85653-6db6-423c-aeea-b8276d8d23a7 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:22.614895 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab85653-6db6-423c-aeea-b8276d8d23a7 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:22.615287 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab85653-6db6-423c-aeea-b8276d8d23a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:22.696442 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-cab85653-6db6-423c-aeea-b8276d8d23a7 None None] MFA Rules not processed for user `96c9b76133d74b79a0d2da9a884651e1`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:32:22.697781 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-cab85653-6db6-423c-aeea-b8276d8d23a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:22.766554 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1393/2783] 10.222.0.23 () {58 vars in 1010 bytes} [Thu Sep 23 03:32:22 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:32:22.909008 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41ed8e-ace8-449a-a232-51676adfb110 service glance] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:22.910457 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-4d41ed8e-ace8-449a-a232-51676adfb110 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:23.001384 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41ed8e-ace8-449a-a232-51676adfb110 service glance] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:23.006525 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6e6d6-2077-4b19-933b-f99ccd59255f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df051fd059b34fe0993f501546d1610f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:23.007176 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6e6d6-2077-4b19-933b-f99ccd59255f service swift] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:23.007457 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6e6d6-2077-4b19-933b-f99ccd59255f service swift] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:23.007727 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6e6d6-2077-4b19-933b-f99ccd59255f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:23.016848 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6e6d6-2077-4b19-933b-f99ccd59255f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:23.018433 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6e6d6-2077-4b19-933b-f99ccd59255f service swift] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:23.028480 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1391/2784] 10.222.0.23 () {60 vars in 1385 bytes} [Thu Sep 23 03:32:22 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 03:32:27.101161 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab85653-6db6-423c-aeea-b8276d8d23a7 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:27.103275 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-cab85653-6db6-423c-aeea-b8276d8d23a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:27.248111 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab85653-6db6-423c-aeea-b8276d8d23a7 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:27.254027 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0a24a-417f-4d26-bd28-cd5559f4b798 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b7e780a23e4ee499cb7820a85feccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:27.254949 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0a24a-417f-4d26-bd28-cd5559f4b798 service placement] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:27.255351 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0a24a-417f-4d26-bd28-cd5559f4b798 service placement] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:27.255697 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0a24a-417f-4d26-bd28-cd5559f4b798 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:27.258062 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-91a0a24a-417f-4d26-bd28-cd5559f4b798 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:27.274194 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0a24a-417f-4d26-bd28-cd5559f4b798 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:27.276297 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0a24a-417f-4d26-bd28-cd5559f4b798 service placement] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:27.289702 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1394/2785] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:32:27 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:32:34.186710 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85585b-236b-4e6d-9543-54f7565e19f4 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:34.189974 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85585b-236b-4e6d-9543-54f7565e19f4 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:34.189974 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85585b-236b-4e6d-9543-54f7565e19f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:34.204397 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-7b85585b-236b-4e6d-9543-54f7565e19f4 None None] MFA Rules not processed for user `9f095853fa9e478699437602d269e7df`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:32:34.205614 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-7b85585b-236b-4e6d-9543-54f7565e19f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:34.212919 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1392/2786] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:32:34 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:32:34.461194 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0a24a-417f-4d26-bd28-cd5559f4b798 service placement] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:34.512641 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0a24a-417f-4d26-bd28-cd5559f4b798 service placement] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:34.516425 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df849c24-de25-4000-8cae-26340660ce70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:34.517087 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df849c24-de25-4000-8cae-26340660ce70 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:34.517367 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df849c24-de25-4000-8cae-26340660ce70 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:34.517641 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df849c24-de25-4000-8cae-26340660ce70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:34.519371 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-df849c24-de25-4000-8cae-26340660ce70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:34.528543 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df849c24-de25-4000-8cae-26340660ce70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:34.529949 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df849c24-de25-4000-8cae-26340660ce70 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:34.537707 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1395/2787] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:32:34 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:32:35.141528 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85585b-236b-4e6d-9543-54f7565e19f4 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:35.142934 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-7b85585b-236b-4e6d-9543-54f7565e19f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:35.158397 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85585b-236b-4e6d-9543-54f7565e19f4 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:35.163464 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0dd192-7b24-4463-958b-b27a67176c25 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b7e780a23e4ee499cb7820a85feccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:35.164122 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dd192-7b24-4463-958b-b27a67176c25 service placement] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:35.164405 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dd192-7b24-4463-958b-b27a67176c25 service placement] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:35.164722 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dd192-7b24-4463-958b-b27a67176c25 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:35.166463 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-fb0dd192-7b24-4463-958b-b27a67176c25 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:35.178681 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0dd192-7b24-4463-958b-b27a67176c25 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:35.180127 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0dd192-7b24-4463-958b-b27a67176c25 service placement] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:35.189988 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1393/2788] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:32:35 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:32:38.320653 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c325539-64fa-4d1c-8380-5539a12fa8bf None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:38.321163 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c325539-64fa-4d1c-8380-5539a12fa8bf None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:38.321273 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c325539-64fa-4d1c-8380-5539a12fa8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:38.340708 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-5c325539-64fa-4d1c-8380-5539a12fa8bf None None] MFA Rules not processed for user `96c9b76133d74b79a0d2da9a884651e1`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:32:38.342042 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-5c325539-64fa-4d1c-8380-5539a12fa8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:38.349812 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1396/2789] 10.222.0.23 () {58 vars in 1010 bytes} [Thu Sep 23 03:32:38 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:32:38.364391 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0dd192-7b24-4463-958b-b27a67176c25 service placement] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:38.382723 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0dd192-7b24-4463-958b-b27a67176c25 service placement] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:38.393268 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195d4e3-9675-4194-b0ab-77dc4a18afca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df051fd059b34fe0993f501546d1610f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:38.394019 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195d4e3-9675-4194-b0ab-77dc4a18afca service swift] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:38.394514 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195d4e3-9675-4194-b0ab-77dc4a18afca service swift] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:38.395009 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195d4e3-9675-4194-b0ab-77dc4a18afca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:38.404907 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195d4e3-9675-4194-b0ab-77dc4a18afca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:38.406575 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195d4e3-9675-4194-b0ab-77dc4a18afca service swift] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:38.421743 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1394/2790] 10.222.0.23 () {60 vars in 1385 bytes} [Thu Sep 23 03:32:38 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 03:32:56.864878 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c325539-64fa-4d1c-8380-5539a12fa8bf None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:56.866457 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-5c325539-64fa-4d1c-8380-5539a12fa8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:56.935343 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c325539-64fa-4d1c-8380-5539a12fa8bf None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:56.940904 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2491adf-cf6b-447b-9f7e-090d79f52f58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:56.941560 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2491adf-cf6b-447b-9f7e-090d79f52f58 service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:56.941840 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2491adf-cf6b-447b-9f7e-090d79f52f58 service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:56.942119 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2491adf-cf6b-447b-9f7e-090d79f52f58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:56.943937 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-a2491adf-cf6b-447b-9f7e-090d79f52f58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:56.957182 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2491adf-cf6b-447b-9f7e-090d79f52f58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:56.958882 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2491adf-cf6b-447b-9f7e-090d79f52f58 service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:56.971756 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1397/2791] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:32:56 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:32:56.988141 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195d4e3-9675-4194-b0ab-77dc4a18afca service swift] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:57.000777 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195d4e3-9675-4194-b0ab-77dc4a18afca service swift] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:57.006989 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13fe8d-fab8-481d-b7c4-68244481c9ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:57.007744 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13fe8d-fab8-481d-b7c4-68244481c9ae service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:57.008020 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13fe8d-fab8-481d-b7c4-68244481c9ae service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:57.008301 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13fe8d-fab8-481d-b7c4-68244481c9ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:57.010621 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-ab13fe8d-fab8-481d-b7c4-68244481c9ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:57.024810 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13fe8d-fab8-481d-b7c4-68244481c9ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:57.026232 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13fe8d-fab8-481d-b7c4-68244481c9ae service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:57.037828 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1395/2792] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:32:56 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:32:58.206397 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2491adf-cf6b-447b-9f7e-090d79f52f58 service nova] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:32:58.207865 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-a2491adf-cf6b-447b-9f7e-090d79f52f58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:58.219959 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2491adf-cf6b-447b-9f7e-090d79f52f58 service nova] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:32:58.223545 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03365d29-d1e1-4278-ad65-35ce627d6c32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:32:58.224177 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03365d29-d1e1-4278-ad65-35ce627d6c32 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:32:58.224456 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03365d29-d1e1-4278-ad65-35ce627d6c32 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:32:58.224794 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03365d29-d1e1-4278-ad65-35ce627d6c32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:32:58.226495 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-03365d29-d1e1-4278-ad65-35ce627d6c32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:32:58.239339 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03365d29-d1e1-4278-ad65-35ce627d6c32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:32:58.240778 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03365d29-d1e1-4278-ad65-35ce627d6c32 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:32:58.253672 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1398/2793] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:32:58 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:33:12.583401 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13fe8d-fab8-481d-b7c4-68244481c9ae service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:33:12.592169 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13fe8d-fab8-481d-b7c4-68244481c9ae service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:33:12.595862 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fc072-c062-4a32-a62f-3a84bf3dd9f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:33:12.596537 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fc072-c062-4a32-a62f-3a84bf3dd9f4 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:33:12.596828 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fc072-c062-4a32-a62f-3a84bf3dd9f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:33:12.597108 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fc072-c062-4a32-a62f-3a84bf3dd9f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:33:12.605741 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fc072-c062-4a32-a62f-3a84bf3dd9f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:33:12.607156 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fc072-c062-4a32-a62f-3a84bf3dd9f4 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:33:12.616308 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1396/2794] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:33:12 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:33:17.563992 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03365d29-d1e1-4278-ad65-35ce627d6c32 service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:33:17.576200 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03365d29-d1e1-4278-ad65-35ce627d6c32 service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:33:17.585605 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbde32-8af5-44a7-a3d3-f9e51737ddba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:33:17.586600 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbde32-8af5-44a7-a3d3-f9e51737ddba service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:33:17.587166 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbde32-8af5-44a7-a3d3-f9e51737ddba service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:33:17.588814 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbde32-8af5-44a7-a3d3-f9e51737ddba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:33:17.591193 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-9acbde32-8af5-44a7-a3d3-f9e51737ddba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:33:17.601963 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbde32-8af5-44a7-a3d3-f9e51737ddba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:33:17.603873 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbde32-8af5-44a7-a3d3-f9e51737ddba service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:33:17.617656 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1399/2795] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:33:17 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:35:19.755044 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fc072-c062-4a32-a62f-3a84bf3dd9f4 service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:35:19.775021 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fc072-c062-4a32-a62f-3a84bf3dd9f4 service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:35:19.781905 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a6da4-793e-4241-a767-9afc89fbd09c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:35:19.782887 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a6da4-793e-4241-a767-9afc89fbd09c service nova] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:35:19.783340 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a6da4-793e-4241-a767-9afc89fbd09c service nova] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:35:19.783831 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a6da4-793e-4241-a767-9afc89fbd09c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:35:19.786510 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-791a6da4-793e-4241-a767-9afc89fbd09c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:35:19.819573 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a6da4-793e-4241-a767-9afc89fbd09c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:35:19.823103 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a6da4-793e-4241-a767-9afc89fbd09c service nova] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:35:19.835656 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1397/2796] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:35:19 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:35:28.985034 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291d344-9cb0-47a6-8389-36d8357bef36 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:35:28.985529 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291d344-9cb0-47a6-8389-36d8357bef36 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:35:28.985633 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291d344-9cb0-47a6-8389-36d8357bef36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:35:29.002836 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-f291d344-9cb0-47a6-8389-36d8357bef36 None None] MFA Rules not processed for user `96c9b76133d74b79a0d2da9a884651e1`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:35:29.004005 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-f291d344-9cb0-47a6-8389-36d8357bef36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:35:29.011112 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1400/2797] 10.222.0.23 () {58 vars in 968 bytes} [Thu Sep 23 03:35:28 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:35:29.051532 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a6da4-793e-4241-a767-9afc89fbd09c service nova] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:35:29.062761 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a6da4-793e-4241-a767-9afc89fbd09c service nova] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:35:29.067835 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffdac7-0f7a-4e79-9c85-2c016229c2c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df051fd059b34fe0993f501546d1610f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:35:29.068476 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffdac7-0f7a-4e79-9c85-2c016229c2c9 service swift] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:35:29.068834 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffdac7-0f7a-4e79-9c85-2c016229c2c9 service swift] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:35:29.069063 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffdac7-0f7a-4e79-9c85-2c016229c2c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:35:29.076858 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ffdac7-0f7a-4e79-9c85-2c016229c2c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:35:29.078451 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ffdac7-0f7a-4e79-9c85-2c016229c2c9 service swift] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:35:29.086793 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1398/2798] 10.222.0.23 () {60 vars in 1385 bytes} [Thu Sep 23 03:35:29 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 03:35:37.572272 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291d344-9cb0-47a6-8389-36d8357bef36 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:35:37.636587 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291d344-9cb0-47a6-8389-36d8357bef36 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:35:37.641115 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77195af3-755b-4ea7-9017-97a4a99e0ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:35:37.641987 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77195af3-755b-4ea7-9017-97a4a99e0ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:35:37.642271 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77195af3-755b-4ea7-9017-97a4a99e0ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:35:37.642552 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77195af3-755b-4ea7-9017-97a4a99e0ff9 admin admin] PATH_INFO: `/v3/users/9f095853fa9e478699437602d269e7df` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:35:37.643737 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77195af3-755b-4ea7-9017-97a4a99e0ff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f095853fa9e478699437602d269e7df)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:35:37.645722 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77195af3-755b-4ea7-9017-97a4a99e0ff9 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:35:37.880707 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-77195af3-755b-4ea7-9017-97a4a99e0ff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f095853fa9e478699437602d269e7df'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:35:37.881379 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-77195af3-755b-4ea7-9017-97a4a99e0ff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f095853fa9e478699437602d269e7df'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:35:37.882186 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-77195af3-755b-4ea7-9017-97a4a99e0ff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f095853fa9e478699437602d269e7df'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:35:37.889479 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-77195af3-755b-4ea7-9017-97a4a99e0ff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f095853fa9e478699437602d269e7df'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:35:37.956972 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-77195af3-755b-4ea7-9017-97a4a99e0ff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f095853fa9e478699437602d269e7df'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:35:37.976742 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1401/2799] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:35:37 2021] DELETE /identity/v3/users/9f095853fa9e478699437602d269e7df => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:35:38.244949 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffdac7-0f7a-4e79-9c85-2c016229c2c9 service swift] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:35:38.256612 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffdac7-0f7a-4e79-9c85-2c016229c2c9 service swift] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:35:38.314483 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd50ee-cb9d-4216-ac82-68d5f866b12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:35:38.315344 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd50ee-cb9d-4216-ac82-68d5f866b12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:35:38.315741 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd50ee-cb9d-4216-ac82-68d5f866b12e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:35:38.316118 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd50ee-cb9d-4216-ac82-68d5f866b12e admin admin] PATH_INFO: `/v3/projects/d44cc135efd34c2ebd0b06caba26bca7` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:35:38.317325 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd50ee-cb9d-4216-ac82-68d5f866b12e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d44cc135efd34c2ebd0b06caba26bca7)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:35:38.319205 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd50ee-cb9d-4216-ac82-68d5f866b12e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:35:38.448871 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1bdd50ee-cb9d-4216-ac82-68d5f866b12e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd44cc135efd34c2ebd0b06caba26bca7', 'request_id': 'req-1bdd50ee-cb9d-4216-ac82-68d5f866b12e'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:35:38.544968 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1bdd50ee-cb9d-4216-ac82-68d5f866b12e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd44cc135efd34c2ebd0b06caba26bca7', 'request_id': 'req-1bdd50ee-cb9d-4216-ac82-68d5f866b12e'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:35:38.550771 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1bdd50ee-cb9d-4216-ac82-68d5f866b12e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd44cc135efd34c2ebd0b06caba26bca7', 'request_id': 'req-1bdd50ee-cb9d-4216-ac82-68d5f866b12e'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:35:38.562188 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1bdd50ee-cb9d-4216-ac82-68d5f866b12e admin admin] The token cache is being invalidate because project d44cc135efd34c2ebd0b06caba26bca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:35:38.562478 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1bdd50ee-cb9d-4216-ac82-68d5f866b12e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:35:38.563106 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1bdd50ee-cb9d-4216-ac82-68d5f866b12e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:35:38.564684 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1399/2800] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:35:38 2021] DELETE /identity/v3/projects/d44cc135efd34c2ebd0b06caba26bca7 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:35:38.568648 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77195af3-755b-4ea7-9017-97a4a99e0ff9 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:35:38.570089 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-77195af3-755b-4ea7-9017-97a4a99e0ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:35:38.582839 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77195af3-755b-4ea7-9017-97a4a99e0ff9 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:35:38.638832 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756d497-eb2d-4019-9e26-2e79f84163ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:35:38.639705 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756d497-eb2d-4019-9e26-2e79f84163ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:35:38.639988 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756d497-eb2d-4019-9e26-2e79f84163ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:35:38.640263 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756d497-eb2d-4019-9e26-2e79f84163ab admin admin] PATH_INFO: `/v3/users/eede7b0ee9f24c7cabe73417235977c9` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:35:38.641553 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4756d497-eb2d-4019-9e26-2e79f84163ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=eede7b0ee9f24c7cabe73417235977c9)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:35:38.643449 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4756d497-eb2d-4019-9e26-2e79f84163ab admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:35:38.883813 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-4756d497-eb2d-4019-9e26-2e79f84163ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eede7b0ee9f24c7cabe73417235977c9'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:35:38.884444 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-4756d497-eb2d-4019-9e26-2e79f84163ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eede7b0ee9f24c7cabe73417235977c9'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:35:38.885071 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-4756d497-eb2d-4019-9e26-2e79f84163ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eede7b0ee9f24c7cabe73417235977c9'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:35:38.891818 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-4756d497-eb2d-4019-9e26-2e79f84163ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eede7b0ee9f24c7cabe73417235977c9'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:35:38.962588 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-4756d497-eb2d-4019-9e26-2e79f84163ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eede7b0ee9f24c7cabe73417235977c9'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:35:38.980365 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1402/2801] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:35:38 2021] DELETE /identity/v3/users/eede7b0ee9f24c7cabe73417235977c9 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 03:35:39.216044 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd50ee-cb9d-4216-ac82-68d5f866b12e admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:35:39.218086 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-1bdd50ee-cb9d-4216-ac82-68d5f866b12e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:35:39.233812 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd50ee-cb9d-4216-ac82-68d5f866b12e admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:35:39.294917 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52f1fd-1c25-407b-bc9e-44c59d0f08f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:35:39.295800 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52f1fd-1c25-407b-bc9e-44c59d0f08f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:35:39.296083 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52f1fd-1c25-407b-bc9e-44c59d0f08f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:35:39.296375 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52f1fd-1c25-407b-bc9e-44c59d0f08f5 admin admin] PATH_INFO: `/v3/projects/310ac3cbcd994b1b9899ade1af4dd1d3` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:35:39.297633 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52f1fd-1c25-407b-bc9e-44c59d0f08f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=310ac3cbcd994b1b9899ade1af4dd1d3)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:35:39.299547 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52f1fd-1c25-407b-bc9e-44c59d0f08f5 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:35:39.413112 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1c52f1fd-1c25-407b-bc9e-44c59d0f08f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '310ac3cbcd994b1b9899ade1af4dd1d3', 'request_id': 'req-1c52f1fd-1c25-407b-bc9e-44c59d0f08f5'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:35:39.493282 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1c52f1fd-1c25-407b-bc9e-44c59d0f08f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '310ac3cbcd994b1b9899ade1af4dd1d3', 'request_id': 'req-1c52f1fd-1c25-407b-bc9e-44c59d0f08f5'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:35:39.498804 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1c52f1fd-1c25-407b-bc9e-44c59d0f08f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '310ac3cbcd994b1b9899ade1af4dd1d3', 'request_id': 'req-1c52f1fd-1c25-407b-bc9e-44c59d0f08f5'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:35:39.510221 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1c52f1fd-1c25-407b-bc9e-44c59d0f08f5 admin admin] The token cache is being invalidate because project 310ac3cbcd994b1b9899ade1af4dd1d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73781) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:35:39.510508 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1c52f1fd-1c25-407b-bc9e-44c59d0f08f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:35:39.511132 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-1c52f1fd-1c25-407b-bc9e-44c59d0f08f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:35:39.512715 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1400/2802] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:35:39 2021] DELETE /identity/v3/projects/310ac3cbcd994b1b9899ade1af4dd1d3 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:35:39.518452 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943788b-670b-4a69-94c8-714b533f7fb4 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:35:39.518751 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943788b-670b-4a69-94c8-714b533f7fb4 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:35:39.519051 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943788b-670b-4a69-94c8-714b533f7fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:35:39.536842 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-4943788b-670b-4a69-94c8-714b533f7fb4 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:35:39.538036 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-4943788b-670b-4a69-94c8-714b533f7fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:35:39.594391 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1403/2803] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:35:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:35:39.602019 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7c069-1d93-4c41-9488-aa1dbcb624c9 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:35:39.602396 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7c069-1d93-4c41-9488-aa1dbcb624c9 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:35:39.602686 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7c069-1d93-4c41-9488-aa1dbcb624c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:35:39.621013 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-dbb7c069-1d93-4c41-9488-aa1dbcb624c9 None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:35:39.622208 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-dbb7c069-1d93-4c41-9488-aa1dbcb624c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:35:39.630216 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1401/2804] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:35:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:35:39.634727 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943788b-670b-4a69-94c8-714b533f7fb4 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:35:39.644091 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943788b-670b-4a69-94c8-714b533f7fb4 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:35:39.648767 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcceac-2595-4ca6-9507-584f6d24e0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:35:39.649419 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcceac-2595-4ca6-9507-584f6d24e0fc admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:35:39.649704 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcceac-2595-4ca6-9507-584f6d24e0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:35:39.649985 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcceac-2595-4ca6-9507-584f6d24e0fc admin admin] PATH_INFO: `/v3/domains` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:35:39.650699 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfcceac-2595-4ca6-9507-584f6d24e0fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73780) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 03:35:39.651006 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfcceac-2595-4ca6-9507-584f6d24e0fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:35:39.652612 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfcceac-2595-4ca6-9507-584f6d24e0fc admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:35:39.663798 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1404/2805] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 23 03:35:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 03:35:39.667837 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7c069-1d93-4c41-9488-aa1dbcb624c9 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:35:39.676849 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7c069-1d93-4c41-9488-aa1dbcb624c9 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:35:39.682034 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edf95c-f566-4a5f-a000-16d77d7b3ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:35:39.682680 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edf95c-f566-4a5f-a000-16d77d7b3ccc admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:35:39.682964 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edf95c-f566-4a5f-a000-16d77d7b3ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:35:39.683242 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edf95c-f566-4a5f-a000-16d77d7b3ccc admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:35:39.683924 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59edf95c-f566-4a5f-a000-16d77d7b3ccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:35:39.685836 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59edf95c-f566-4a5f-a000-16d77d7b3ccc admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:35:39.786324 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1402/2806] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:35:39 2021] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:35:39.790971 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcceac-2595-4ca6-9507-584f6d24e0fc admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:35:39.800820 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcceac-2595-4ca6-9507-584f6d24e0fc admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:35:39.858615 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb4b76-dc8d-45ca-96b0-15071752aff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:35:39.859291 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb4b76-dc8d-45ca-96b0-15071752aff8 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:35:39.859581 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb4b76-dc8d-45ca-96b0-15071752aff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:35:39.859862 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb4b76-dc8d-45ca-96b0-15071752aff8 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:35:39.860596 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb4b76-dc8d-45ca-96b0-15071752aff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:35:39.862768 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb4b76-dc8d-45ca-96b0-15071752aff8 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:35:39.956139 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1405/2807] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:35:39 2021] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:35:39.960653 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edf95c-f566-4a5f-a000-16d77d7b3ccc admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:35:39.970729 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edf95c-f566-4a5f-a000-16d77d7b3ccc admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:35:39.975417 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5bd1d-9b6b-4beb-b8f6-bfe0c09a26bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:35:39.976658 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5bd1d-9b6b-4beb-b8f6-bfe0c09a26bc admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:35:39.976947 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5bd1d-9b6b-4beb-b8f6-bfe0c09a26bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:35:39.977228 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5bd1d-9b6b-4beb-b8f6-bfe0c09a26bc admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:35:39.978000 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5bd1d-9b6b-4beb-b8f6-bfe0c09a26bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:35:39.979609 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5bd1d-9b6b-4beb-b8f6-bfe0c09a26bc admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:35:39.989826 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1403/2808] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:35:39 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:35:39.994121 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb4b76-dc8d-45ca-96b0-15071752aff8 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:35:40.003941 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb4b76-dc8d-45ca-96b0-15071752aff8 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:35:40.008608 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96041c38-7f11-4586-8fd2-a367910e7b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:35:40.009259 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96041c38-7f11-4586-8fd2-a367910e7b1e admin admin] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:35:40.009543 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96041c38-7f11-4586-8fd2-a367910e7b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:35:40.009821 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96041c38-7f11-4586-8fd2-a367910e7b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:35:40.010538 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96041c38-7f11-4586-8fd2-a367910e7b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:35:40.012114 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96041c38-7f11-4586-8fd2-a367910e7b1e admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:35:40.021837 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1406/2809] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:35:39 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:35:40.027217 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5bd1d-9b6b-4beb-b8f6-bfe0c09a26bc admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:35:40.039550 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5bd1d-9b6b-4beb-b8f6-bfe0c09a26bc admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:35:40.044218 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570ab35-c20d-411d-88ba-5fdec512912e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:35:40.045146 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570ab35-c20d-411d-88ba-5fdec512912e admin admin] REQUEST_METHOD: `PUT` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:35:40.045430 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570ab35-c20d-411d-88ba-5fdec512912e admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:35:40.045706 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570ab35-c20d-411d-88ba-5fdec512912e admin admin] PATH_INFO: `/v3/projects/ef0ca626043a48c88655009268a6ce40/users/eb1d7b6df9554a2da3ccd85d982cd8a7/roles/99e1944a08bf4c13b6c228cd63b66bcb` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:35:40.060920 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570ab35-c20d-411d-88ba-5fdec512912e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef0ca626043a48c88655009268a6ce40, user_id=eb1d7b6df9554a2da3ccd85d982cd8a7, role_id=99e1944a08bf4c13b6c228cd63b66bcb)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:35:40.063777 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570ab35-c20d-411d-88ba-5fdec512912e admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:35:40.139318 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1404/2810] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:35:40 2021] PUT /identity/v3/projects/ef0ca626043a48c88655009268a6ce40/users/eb1d7b6df9554a2da3ccd85d982cd8a7/roles/99e1944a08bf4c13b6c228cd63b66bcb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:35:40.144710 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1cc2e-24ed-436f-ab91-a91dc8ee193e None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:35:40.145000 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1cc2e-24ed-436f-ab91-a91dc8ee193e None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:35:40.145281 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1cc2e-24ed-436f-ab91-a91dc8ee193e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:35:40.171755 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-99e1cc2e-24ed-436f-ab91-a91dc8ee193e None None] MFA Rules not processed for user `2a7711e2d0394daf9335168cae6f091d`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:35:40.173002 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-99e1cc2e-24ed-436f-ab91-a91dc8ee193e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:35:40.228571 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1407/2811] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:35:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:35:40.238281 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570ab35-c20d-411d-88ba-5fdec512912e admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:35:40.239946 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-d570ab35-c20d-411d-88ba-5fdec512912e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:35:40.294294 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570ab35-c20d-411d-88ba-5fdec512912e admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:35:40.297955 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cf232-07f4-4f5f-9f39-40dc83c13541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:35:40.298599 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cf232-07f4-4f5f-9f39-40dc83c13541 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:35:40.298883 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cf232-07f4-4f5f-9f39-40dc83c13541 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:35:40.299159 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cf232-07f4-4f5f-9f39-40dc83c13541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:35:40.308438 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09cf232-07f4-4f5f-9f39-40dc83c13541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:35:40.309894 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09cf232-07f4-4f5f-9f39-40dc83c13541 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:35:40.319069 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1405/2812] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:35:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 03:35:45.610363 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9378e-5f8d-4869-a420-c86ba438f599 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:35:45.610874 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9378e-5f8d-4869-a420-c86ba438f599 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:35:45.611009 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9378e-5f8d-4869-a420-c86ba438f599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:35:45.657215 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-e6c9378e-5f8d-4869-a420-c86ba438f599 None None] MFA Rules not processed for user `eb1d7b6df9554a2da3ccd85d982cd8a7`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:35:45.658453 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-e6c9378e-5f8d-4869-a420-c86ba438f599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:35:45.732130 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1408/2813] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:35:45 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:35:45.736632 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cf232-07f4-4f5f-9f39-40dc83c13541 service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:35:45.746886 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cf232-07f4-4f5f-9f39-40dc83c13541 service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:35:45.751675 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d398094-6e3e-43c1-bc29-47053fd5f174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:35:45.752347 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d398094-6e3e-43c1-bc29-47053fd5f174 admin admin] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:35:45.752664 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d398094-6e3e-43c1-bc29-47053fd5f174 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:35:45.752947 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d398094-6e3e-43c1-bc29-47053fd5f174 admin admin] PATH_INFO: `/v3/projects` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:35:45.753644 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d398094-6e3e-43c1-bc29-47053fd5f174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:35:45.755558 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d398094-6e3e-43c1-bc29-47053fd5f174 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:35:45.838633 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1406/2814] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 23 03:35:45 2021] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:35:45.842614 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9378e-5f8d-4869-a420-c86ba438f599 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:35:45.854467 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9378e-5f8d-4869-a420-c86ba438f599 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:35:45.914044 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6e755-b384-4e6a-8cf8-dd64eb464079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:35:45.914660 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6e755-b384-4e6a-8cf8-dd64eb464079 admin admin] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:35:45.914942 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6e755-b384-4e6a-8cf8-dd64eb464079 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:35:45.915215 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6e755-b384-4e6a-8cf8-dd64eb464079 admin admin] PATH_INFO: `/v3/users` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:35:45.915908 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6e755-b384-4e6a-8cf8-dd64eb464079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:35:45.917854 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6e755-b384-4e6a-8cf8-dd64eb464079 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:35:46.003367 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1409/2815] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 23 03:35:45 2021] POST /identity/v3/users => generated 295 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 03:35:46.007707 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d398094-6e3e-43c1-bc29-47053fd5f174 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:35:46.018104 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d398094-6e3e-43c1-bc29-47053fd5f174 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:35:46.022738 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bce37-4bba-4277-81fb-f27fb1572e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:35:46.023407 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bce37-4bba-4277-81fb-f27fb1572e91 admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:35:46.023690 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bce37-4bba-4277-81fb-f27fb1572e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:35:46.023966 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bce37-4bba-4277-81fb-f27fb1572e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:35:46.024997 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bce37-4bba-4277-81fb-f27fb1572e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:35:46.026584 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bce37-4bba-4277-81fb-f27fb1572e91 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:35:46.041357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1407/2816] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:35:46 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:35:46.045505 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6e755-b384-4e6a-8cf8-dd64eb464079 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:35:46.058010 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6e755-b384-4e6a-8cf8-dd64eb464079 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:35:46.068752 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e44f6-b774-453e-a4f2-16a99c062753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:35:46.069700 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e44f6-b774-453e-a4f2-16a99c062753 admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:35:46.069958 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e44f6-b774-453e-a4f2-16a99c062753 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:35:46.070411 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e44f6-b774-453e-a4f2-16a99c062753 admin admin] PATH_INFO: `/v3/projects/4a9e3941d11746fd9b5cc61875ae9db7/users/8182f7fe4aed44b9befc9a5f860cae59/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:35:46.086595 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e44f6-b774-453e-a4f2-16a99c062753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a9e3941d11746fd9b5cc61875ae9db7, user_id=8182f7fe4aed44b9befc9a5f860cae59, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:35:46.089456 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e44f6-b774-453e-a4f2-16a99c062753 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:35:46.219860 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1410/2817] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:35:46 2021] PUT /identity/v3/projects/4a9e3941d11746fd9b5cc61875ae9db7/users/8182f7fe4aed44b9befc9a5f860cae59/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:35:46.223874 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bce37-4bba-4277-81fb-f27fb1572e91 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:35:46.234557 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bce37-4bba-4277-81fb-f27fb1572e91 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:35:46.293498 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60029b01-157d-49f5-832d-83dc532ee6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:35:46.295864 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60029b01-157d-49f5-832d-83dc532ee6af admin admin] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:35:46.295864 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60029b01-157d-49f5-832d-83dc532ee6af admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:35:46.295864 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60029b01-157d-49f5-832d-83dc532ee6af admin admin] PATH_INFO: `/v3/roles` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:35:46.295864 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60029b01-157d-49f5-832d-83dc532ee6af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:35:46.297281 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60029b01-157d-49f5-832d-83dc532ee6af admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:35:46.307531 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1408/2818] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 23 03:35:46 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 03:35:46.311659 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e44f6-b774-453e-a4f2-16a99c062753 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:35:46.322898 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e44f6-b774-453e-a4f2-16a99c062753 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:35:46.328026 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82c447-84c3-47ce-bd9c-c581df53befb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:35:46.329010 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82c447-84c3-47ce-bd9c-c581df53befb admin admin] REQUEST_METHOD: `PUT` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:35:46.329444 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82c447-84c3-47ce-bd9c-c581df53befb admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:35:46.329730 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82c447-84c3-47ce-bd9c-c581df53befb admin admin] PATH_INFO: `/v3/projects/4a9e3941d11746fd9b5cc61875ae9db7/users/8182f7fe4aed44b9befc9a5f860cae59/roles/3e7d7427203a4a4097e2c9a642b9bf69` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:35:46.331769 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82c447-84c3-47ce-bd9c-c581df53befb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a9e3941d11746fd9b5cc61875ae9db7, user_id=8182f7fe4aed44b9befc9a5f860cae59, role_id=3e7d7427203a4a4097e2c9a642b9bf69)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:35:46.335749 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82c447-84c3-47ce-bd9c-c581df53befb admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:35:46.346882 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1411/2819] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 23 03:35:46 2021] PUT /identity/v3/projects/4a9e3941d11746fd9b5cc61875ae9db7/users/8182f7fe4aed44b9befc9a5f860cae59/roles/3e7d7427203a4a4097e2c9a642b9bf69 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:35:51.762821 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956defbe-545b-4335-9754-e431ee838d06 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:35:51.763300 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956defbe-545b-4335-9754-e431ee838d06 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:35:51.763416 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956defbe-545b-4335-9754-e431ee838d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:35:51.794916 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-956defbe-545b-4335-9754-e431ee838d06 None None] MFA Rules not processed for user `8182f7fe4aed44b9befc9a5f860cae59`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:35:51.796269 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-956defbe-545b-4335-9754-e431ee838d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:35:51.863271 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1409/2820] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:35:51 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:35:51.875346 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82c447-84c3-47ce-bd9c-c581df53befb admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:35:51.877521 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-4a82c447-84c3-47ce-bd9c-c581df53befb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:35:51.960577 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82c447-84c3-47ce-bd9c-c581df53befb admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:35:51.968802 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f9a55-2d37-4e0b-87ea-1377572cb9a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:35:51.971419 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f9a55-2d37-4e0b-87ea-1377572cb9a4 service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:35:51.971419 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f9a55-2d37-4e0b-87ea-1377572cb9a4 service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:35:51.971419 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f9a55-2d37-4e0b-87ea-1377572cb9a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:35:52.027841 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f9a55-2d37-4e0b-87ea-1377572cb9a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:35:52.029488 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f9a55-2d37-4e0b-87ea-1377572cb9a4 service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:35:52.039393 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1412/2821] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:35:51 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:36:19.032426 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01159883-ffe7-43c0-8d96-3807d869f958 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:36:19.032946 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01159883-ffe7-43c0-8d96-3807d869f958 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:36:19.033051 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01159883-ffe7-43c0-8d96-3807d869f958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:36:19.050322 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-01159883-ffe7-43c0-8d96-3807d869f958 None None] MFA Rules not processed for user `eb1d7b6df9554a2da3ccd85d982cd8a7`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:36:19.051500 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-01159883-ffe7-43c0-8d96-3807d869f958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:36:19.058759 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1410/2822] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:36:19 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:36:19.357563 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f9a55-2d37-4e0b-87ea-1377572cb9a4 service nova] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:36:19.358946 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-df8f9a55-2d37-4e0b-87ea-1377572cb9a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:36:19.413247 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f9a55-2d37-4e0b-87ea-1377572cb9a4 service nova] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:36:19.416888 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7f746-9cc3-403e-9cec-2efc5be97dd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:36:19.417531 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7f746-9cc3-403e-9cec-2efc5be97dd5 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:36:19.417815 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7f746-9cc3-403e-9cec-2efc5be97dd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:36:19.418093 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7f746-9cc3-403e-9cec-2efc5be97dd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:36:19.419792 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-dae7f746-9cc3-403e-9cec-2efc5be97dd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:36:19.429022 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7f746-9cc3-403e-9cec-2efc5be97dd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:36:19.430449 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7f746-9cc3-403e-9cec-2efc5be97dd5 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:36:19.438659 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1413/2823] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:36:19 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:36:38.985148 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01159883-ffe7-43c0-8d96-3807d869f958 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:36:38.995994 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01159883-ffe7-43c0-8d96-3807d869f958 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:36:39.003320 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f0ffa-ba4a-403c-bc6b-a2f0085463f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:36:39.003994 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f0ffa-ba4a-403c-bc6b-a2f0085463f4 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:36:39.004260 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f0ffa-ba4a-403c-bc6b-a2f0085463f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:36:39.004577 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f0ffa-ba4a-403c-bc6b-a2f0085463f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:36:39.014424 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f0ffa-ba4a-403c-bc6b-a2f0085463f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:36:39.015849 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f0ffa-ba4a-403c-bc6b-a2f0085463f4 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:36:39.030306 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1411/2824] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:36:38 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:36:41.189154 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7f746-9cc3-403e-9cec-2efc5be97dd5 service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:36:41.202783 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7f746-9cc3-403e-9cec-2efc5be97dd5 service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:36:41.208482 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e15a2-3c6e-45d4-b77c-30d9e0fe40f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:36:41.209575 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e15a2-3c6e-45d4-b77c-30d9e0fe40f3 service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:36:41.209865 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e15a2-3c6e-45d4-b77c-30d9e0fe40f3 service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:36:41.210261 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e15a2-3c6e-45d4-b77c-30d9e0fe40f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:36:41.212032 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-d39e15a2-3c6e-45d4-b77c-30d9e0fe40f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:36:41.224383 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e15a2-3c6e-45d4-b77c-30d9e0fe40f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:36:41.226019 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e15a2-3c6e-45d4-b77c-30d9e0fe40f3 service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:36:41.236773 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1414/2825] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:36:41 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:37:32.104908 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f0ffa-ba4a-403c-bc6b-a2f0085463f4 service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:37:32.106357 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-3b9f0ffa-ba4a-403c-bc6b-a2f0085463f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:37:32.238728 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f0ffa-ba4a-403c-bc6b-a2f0085463f4 service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:37:32.243901 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75b442-2734-40d5-ae52-075e50e97b16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b7e780a23e4ee499cb7820a85feccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:37:32.244578 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75b442-2734-40d5-ae52-075e50e97b16 service placement] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:37:32.244878 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75b442-2734-40d5-ae52-075e50e97b16 service placement] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:37:32.245152 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75b442-2734-40d5-ae52-075e50e97b16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:37:32.246883 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-4b75b442-2734-40d5-ae52-075e50e97b16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:37:32.257885 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75b442-2734-40d5-ae52-075e50e97b16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:37:32.259437 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75b442-2734-40d5-ae52-075e50e97b16 service placement] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:37:32.268963 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1412/2826] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:37:32 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:38:28.766325 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e15a2-3c6e-45d4-b77c-30d9e0fe40f3 service nova] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:38:28.805750 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e15a2-3c6e-45d4-b77c-30d9e0fe40f3 service nova] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:38:28.809557 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5265344-ac0c-41b0-8e71-eeaf7c8ae08d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:38:28.810211 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5265344-ac0c-41b0-8e71-eeaf7c8ae08d service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:38:28.810492 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5265344-ac0c-41b0-8e71-eeaf7c8ae08d service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:38:28.810754 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5265344-ac0c-41b0-8e71-eeaf7c8ae08d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:38:28.812642 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-f5265344-ac0c-41b0-8e71-eeaf7c8ae08d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:38:28.837033 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5265344-ac0c-41b0-8e71-eeaf7c8ae08d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:38:28.838636 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5265344-ac0c-41b0-8e71-eeaf7c8ae08d service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:38:28.847054 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1415/2827] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:38:28 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:38:55.243495 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75b442-2734-40d5-ae52-075e50e97b16 service placement] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:38:55.253178 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75b442-2734-40d5-ae52-075e50e97b16 service placement] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:38:55.256784 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ce50e-1d07-4b39-85af-53cd7630531a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:38:55.257419 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ce50e-1d07-4b39-85af-53cd7630531a service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:38:55.257704 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ce50e-1d07-4b39-85af-53cd7630531a service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:38:55.257985 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ce50e-1d07-4b39-85af-53cd7630531a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:38:55.260371 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-239ce50e-1d07-4b39-85af-53cd7630531a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:38:55.293376 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ce50e-1d07-4b39-85af-53cd7630531a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:38:55.294816 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ce50e-1d07-4b39-85af-53cd7630531a service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:38:55.314849 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1413/2828] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:38:55 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:38:56.475260 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5265344-ac0c-41b0-8e71-eeaf7c8ae08d service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:38:56.484259 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5265344-ac0c-41b0-8e71-eeaf7c8ae08d service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:38:56.487870 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0603b6c-74a9-4f83-8ce8-f2e6b06108c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:38:56.488529 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0603b6c-74a9-4f83-8ce8-f2e6b06108c8 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:38:56.488816 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0603b6c-74a9-4f83-8ce8-f2e6b06108c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:38:56.489086 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0603b6c-74a9-4f83-8ce8-f2e6b06108c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:38:56.490779 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-c0603b6c-74a9-4f83-8ce8-f2e6b06108c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:38:56.504220 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0603b6c-74a9-4f83-8ce8-f2e6b06108c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:38:56.505867 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0603b6c-74a9-4f83-8ce8-f2e6b06108c8 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:38:56.517414 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1416/2829] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:38:56 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:38:59.885471 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e67db9-4118-40ba-a7de-e646d18d2644 None None] REQUEST_METHOD: `POST` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:38:59.885994 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e67db9-4118-40ba-a7de-e646d18d2644 None None] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:38:59.886101 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e67db9-4118-40ba-a7de-e646d18d2644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:38:59.902569 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.auth.core [None req-02e67db9-4118-40ba-a7de-e646d18d2644 None None] MFA Rules not processed for user `eb1d7b6df9554a2da3ccd85d982cd8a7`. Rule list: `[]` (Enabled: `True`). {{(pid=73781) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:38:59.903769 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-02e67db9-4118-40ba-a7de-e646d18d2644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:38:59.910641 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1414/2830] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:38:59 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:39:00.209384 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0603b6c-74a9-4f83-8ce8-f2e6b06108c8 service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:39:00.217774 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0603b6c-74a9-4f83-8ce8-f2e6b06108c8 service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:39:00.221395 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1748f18-8692-4e52-bda3-9154acd153a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:39:00.222039 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1748f18-8692-4e52-bda3-9154acd153a4 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:39:00.222319 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1748f18-8692-4e52-bda3-9154acd153a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:39:00.222592 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1748f18-8692-4e52-bda3-9154acd153a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:39:00.224334 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-a1748f18-8692-4e52-bda3-9154acd153a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:39:00.234357 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1748f18-8692-4e52-bda3-9154acd153a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:39:00.235776 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1748f18-8692-4e52-bda3-9154acd153a4 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:39:00.244112 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1417/2831] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:39:00 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:39:00.988528 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e67db9-4118-40ba-a7de-e646d18d2644 None None] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:39:00.989969 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-02e67db9-4118-40ba-a7de-e646d18d2644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:39:01.004430 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e67db9-4118-40ba-a7de-e646d18d2644 None None] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:39:01.009910 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c703fb1-3344-43fd-8104-ad779eaf6a92 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b7e780a23e4ee499cb7820a85feccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:39:01.010562 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c703fb1-3344-43fd-8104-ad779eaf6a92 service placement] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:39:01.010843 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c703fb1-3344-43fd-8104-ad779eaf6a92 service placement] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:39:01.011124 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c703fb1-3344-43fd-8104-ad779eaf6a92 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:39:01.012899 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-1c703fb1-3344-43fd-8104-ad779eaf6a92 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:39:01.026223 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c703fb1-3344-43fd-8104-ad779eaf6a92 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:39:01.028251 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c703fb1-3344-43fd-8104-ad779eaf6a92 service placement] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:39:01.038450 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1415/2832] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:39:00 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:39:15.025377 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1748f18-8692-4e52-bda3-9154acd153a4 service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:39:15.026957 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-a1748f18-8692-4e52-bda3-9154acd153a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:39:15.043361 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1748f18-8692-4e52-bda3-9154acd153a4 service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:39:15.048886 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234b648-01b7-4183-8c87-6eea220d936f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:39:15.049528 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234b648-01b7-4183-8c87-6eea220d936f service nova] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:39:15.049811 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234b648-01b7-4183-8c87-6eea220d936f service nova] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:39:15.050089 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234b648-01b7-4183-8c87-6eea220d936f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:39:15.051983 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-8234b648-01b7-4183-8c87-6eea220d936f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:39:15.064107 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234b648-01b7-4183-8c87-6eea220d936f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:39:15.065695 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234b648-01b7-4183-8c87-6eea220d936f service nova] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:39:15.076053 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1418/2833] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:39:15 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:41:09.202886 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c703fb1-3344-43fd-8104-ad779eaf6a92 service placement] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:41:09.204214 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-1c703fb1-3344-43fd-8104-ad779eaf6a92 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:41:09.257942 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c703fb1-3344-43fd-8104-ad779eaf6a92 service placement] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:41:09.261556 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7d59c-cf41-4f38-b140-9e7c330c145c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a435fd22fdc4160888f942e634c0a08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:41:09.262197 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7d59c-cf41-4f38-b140-9e7c330c145c service cinder] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:41:09.262478 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7d59c-cf41-4f38-b140-9e7c330c145c service cinder] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:41:09.262753 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7d59c-cf41-4f38-b140-9e7c330c145c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:41:09.270715 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7d59c-cf41-4f38-b140-9e7c330c145c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:41:09.272126 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7d59c-cf41-4f38-b140-9e7c330c145c service cinder] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:41:09.280561 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1416/2834] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:41:09 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:41:20.787273 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0badd-6348-4134-99bf-5ad16c695f71 None None] REQUEST_METHOD: `POST` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:41:20.787764 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0badd-6348-4134-99bf-5ad16c695f71 None None] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:41:20.787966 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0badd-6348-4134-99bf-5ad16c695f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:41:20.805331 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.auth.core [None req-95b0badd-6348-4134-99bf-5ad16c695f71 None None] MFA Rules not processed for user `eb1d7b6df9554a2da3ccd85d982cd8a7`. Rule list: `[]` (Enabled: `True`). {{(pid=73780) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 03:41:20.806551 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-95b0badd-6348-4134-99bf-5ad16c695f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:41:20.813492 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1419/2835] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 23 03:41:20 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 03:41:21.114286 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7d59c-cf41-4f38-b140-9e7c330c145c service cinder] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:41:21.123500 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7d59c-cf41-4f38-b140-9e7c330c145c service cinder] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:41:21.127075 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d56fcc-5580-4d91-b8b2-a6ef0bd9a648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:41:21.127708 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d56fcc-5580-4d91-b8b2-a6ef0bd9a648 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:41:21.127986 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d56fcc-5580-4d91-b8b2-a6ef0bd9a648 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:41:21.128262 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d56fcc-5580-4d91-b8b2-a6ef0bd9a648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:41:21.135834 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d56fcc-5580-4d91-b8b2-a6ef0bd9a648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:41:21.137275 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d56fcc-5580-4d91-b8b2-a6ef0bd9a648 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:41:21.144955 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1417/2836] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:41:21 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:41:41.910546 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0badd-6348-4134-99bf-5ad16c695f71 None None] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:41:41.920685 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0badd-6348-4134-99bf-5ad16c695f71 None None] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:41:41.924254 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68786cc-014c-4605-bc05-7ac21cbf516f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:41:41.924943 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68786cc-014c-4605-bc05-7ac21cbf516f service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:41:41.925227 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68786cc-014c-4605-bc05-7ac21cbf516f service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:41:41.925507 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68786cc-014c-4605-bc05-7ac21cbf516f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:41:41.934955 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68786cc-014c-4605-bc05-7ac21cbf516f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:41:41.936394 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68786cc-014c-4605-bc05-7ac21cbf516f service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:41:41.945831 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1420/2837] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:41:41 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:41:44.080747 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d56fcc-5580-4d91-b8b2-a6ef0bd9a648 service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:41:44.093998 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d56fcc-5580-4d91-b8b2-a6ef0bd9a648 service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:41:44.100385 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a334eb-c961-4c83-80cb-0c58d9d89448 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83aa47f723434143b22aac1b96b6a610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:41:44.101078 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a334eb-c961-4c83-80cb-0c58d9d89448 service nova] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:41:44.101363 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a334eb-c961-4c83-80cb-0c58d9d89448 service nova] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:41:44.101840 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a334eb-c961-4c83-80cb-0c58d9d89448 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:41:44.111706 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a334eb-c961-4c83-80cb-0c58d9d89448 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:41:44.113315 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a334eb-c961-4c83-80cb-0c58d9d89448 service nova] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:41:44.123747 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1418/2838] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:41:44 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:42:37.048002 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68786cc-014c-4605-bc05-7ac21cbf516f service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:42:37.059110 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68786cc-014c-4605-bc05-7ac21cbf516f service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:42:37.064021 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e3058-0f13-4d9b-8ee8-8e5edafdb2bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b7e780a23e4ee499cb7820a85feccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:42:37.064695 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e3058-0f13-4d9b-8ee8-8e5edafdb2bd service placement] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:42:37.064978 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e3058-0f13-4d9b-8ee8-8e5edafdb2bd service placement] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:42:37.065252 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e3058-0f13-4d9b-8ee8-8e5edafdb2bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:42:37.074210 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e3058-0f13-4d9b-8ee8-8e5edafdb2bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:42:37.075708 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e3058-0f13-4d9b-8ee8-8e5edafdb2bd service placement] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:42:37.085453 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1421/2839] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:42:37 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:43:32.789278 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a334eb-c961-4c83-80cb-0c58d9d89448 service nova] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:43:32.798269 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a334eb-c961-4c83-80cb-0c58d9d89448 service nova] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:43:32.801812 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165773c-e769-4f92-bd73-10fabe07a66c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:43:32.802444 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165773c-e769-4f92-bd73-10fabe07a66c service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:43:32.802726 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165773c-e769-4f92-bd73-10fabe07a66c service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:43:32.803002 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165773c-e769-4f92-bd73-10fabe07a66c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:43:32.810185 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7165773c-e769-4f92-bd73-10fabe07a66c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:43:32.811654 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7165773c-e769-4f92-bd73-10fabe07a66c service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:43:32.819757 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1419/2840] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:43:32 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:43:55.941183 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e3058-0f13-4d9b-8ee8-8e5edafdb2bd service placement] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:43:55.951945 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e3058-0f13-4d9b-8ee8-8e5edafdb2bd service placement] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:43:55.955719 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc28535-37a1-43ff-9737-d611c00da34a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:43:55.956373 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc28535-37a1-43ff-9737-d611c00da34a service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:43:55.956689 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc28535-37a1-43ff-9737-d611c00da34a service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:43:55.957165 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc28535-37a1-43ff-9737-d611c00da34a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:43:55.969102 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc28535-37a1-43ff-9737-d611c00da34a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:43:55.970826 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc28535-37a1-43ff-9737-d611c00da34a service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:43:55.982220 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1422/2841] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:43:55 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:43:57.257957 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165773c-e769-4f92-bd73-10fabe07a66c service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:43:57.266525 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165773c-e769-4f92-bd73-10fabe07a66c service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:43:57.270252 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354e215-19e1-450d-a538-28d909214dd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:43:57.273484 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354e215-19e1-450d-a538-28d909214dd7 service neutron] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:43:57.273484 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354e215-19e1-450d-a538-28d909214dd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:43:57.273484 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354e215-19e1-450d-a538-28d909214dd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:43:57.282052 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354e215-19e1-450d-a538-28d909214dd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:43:57.283607 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354e215-19e1-450d-a538-28d909214dd7 service neutron] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:43:57.295491 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1420/2842] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:43:57 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:44:01.747335 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc28535-37a1-43ff-9737-d611c00da34a service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:44:01.755952 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc28535-37a1-43ff-9737-d611c00da34a service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:44:01.759582 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d5dfb-a4dc-42f5-99fc-3fe94bcae376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '621e97bd0914448c8afadba25510053d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:44:01.760219 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d5dfb-a4dc-42f5-99fc-3fe94bcae376 service neutron] REQUEST_METHOD: `GET` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:44:01.760511 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d5dfb-a4dc-42f5-99fc-3fe94bcae376 service neutron] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:44:01.760804 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d5dfb-a4dc-42f5-99fc-3fe94bcae376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:44:01.830545 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d5dfb-a4dc-42f5-99fc-3fe94bcae376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:44:01.831968 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d5dfb-a4dc-42f5-99fc-3fe94bcae376 service neutron] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:44:01.849981 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1423/2843] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:44:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 03:44:09.145459 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354e215-19e1-450d-a538-28d909214dd7 service neutron] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:44:09.157078 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354e215-19e1-450d-a538-28d909214dd7 service neutron] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:44:09.165034 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e60b37-ed59-4c30-9701-678828b1d28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:44:09.166030 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e60b37-ed59-4c30-9701-678828b1d28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:44:09.166379 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e60b37-ed59-4c30-9701-678828b1d28f admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:44:09.166837 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e60b37-ed59-4c30-9701-678828b1d28f admin admin] PATH_INFO: `/v3/users/eb1d7b6df9554a2da3ccd85d982cd8a7` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:44:09.168325 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e60b37-ed59-4c30-9701-678828b1d28f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb1d7b6df9554a2da3ccd85d982cd8a7)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:44:09.170441 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e60b37-ed59-4c30-9701-678828b1d28f admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:44:09.348565 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-25e60b37-ed59-4c30-9701-678828b1d28f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb1d7b6df9554a2da3ccd85d982cd8a7'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:44:09.349229 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-25e60b37-ed59-4c30-9701-678828b1d28f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb1d7b6df9554a2da3ccd85d982cd8a7'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:44:09.355751 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-25e60b37-ed59-4c30-9701-678828b1d28f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb1d7b6df9554a2da3ccd85d982cd8a7'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:44:09.419520 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-25e60b37-ed59-4c30-9701-678828b1d28f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb1d7b6df9554a2da3ccd85d982cd8a7'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:44:09.431833 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-25e60b37-ed59-4c30-9701-678828b1d28f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb1d7b6df9554a2da3ccd85d982cd8a7'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:44:09.441269 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1421/2844] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:44:09 2021] DELETE /identity/v3/users/eb1d7b6df9554a2da3ccd85d982cd8a7 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:44:09.696072 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d5dfb-a4dc-42f5-99fc-3fe94bcae376 service neutron] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:44:09.708157 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d5dfb-a4dc-42f5-99fc-3fe94bcae376 service neutron] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:44:09.764798 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ddf52b-15f7-4620-9d08-973afd94ffa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:44:09.765659 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ddf52b-15f7-4620-9d08-973afd94ffa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:44:09.765943 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ddf52b-15f7-4620-9d08-973afd94ffa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:44:09.766221 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ddf52b-15f7-4620-9d08-973afd94ffa3 admin admin] PATH_INFO: `/v3/projects/ef0ca626043a48c88655009268a6ce40` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:44:09.767392 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ddf52b-15f7-4620-9d08-973afd94ffa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef0ca626043a48c88655009268a6ce40)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:44:09.769319 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ddf52b-15f7-4620-9d08-973afd94ffa3 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:44:09.864186 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-68ddf52b-15f7-4620-9d08-973afd94ffa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef0ca626043a48c88655009268a6ce40', 'request_id': 'req-68ddf52b-15f7-4620-9d08-973afd94ffa3'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:44:09.941462 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-68ddf52b-15f7-4620-9d08-973afd94ffa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef0ca626043a48c88655009268a6ce40', 'request_id': 'req-68ddf52b-15f7-4620-9d08-973afd94ffa3'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:44:09.947919 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-68ddf52b-15f7-4620-9d08-973afd94ffa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef0ca626043a48c88655009268a6ce40', 'request_id': 'req-68ddf52b-15f7-4620-9d08-973afd94ffa3'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:44:09.970500 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-68ddf52b-15f7-4620-9d08-973afd94ffa3 admin admin] The token cache is being invalidate because project ef0ca626043a48c88655009268a6ce40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:44:09.970787 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-68ddf52b-15f7-4620-9d08-973afd94ffa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:44:09.971406 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-68ddf52b-15f7-4620-9d08-973afd94ffa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:44:09.973026 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1424/2845] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:44:09 2021] DELETE /identity/v3/projects/ef0ca626043a48c88655009268a6ce40 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:44:09.977584 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e60b37-ed59-4c30-9701-678828b1d28f admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:44:09.978972 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-25e60b37-ed59-4c30-9701-678828b1d28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:44:09.992207 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e60b37-ed59-4c30-9701-678828b1d28f admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:44:10.053715 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19f0c4-8635-417e-9920-86c2ef2afdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:44:10.055127 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19f0c4-8635-417e-9920-86c2ef2afdd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:44:10.055409 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19f0c4-8635-417e-9920-86c2ef2afdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:44:10.055685 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19f0c4-8635-417e-9920-86c2ef2afdd6 admin admin] PATH_INFO: `/v3/users/8182f7fe4aed44b9befc9a5f860cae59` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:44:10.056905 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19f0c4-8635-417e-9920-86c2ef2afdd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8182f7fe4aed44b9befc9a5f860cae59)` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:44:10.058822 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19f0c4-8635-417e-9920-86c2ef2afdd6 admin admin] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:44:10.217024 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-cc19f0c4-8635-417e-9920-86c2ef2afdd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8182f7fe4aed44b9befc9a5f860cae59'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:44:10.217703 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-cc19f0c4-8635-417e-9920-86c2ef2afdd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8182f7fe4aed44b9befc9a5f860cae59'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:44:10.224038 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-cc19f0c4-8635-417e-9920-86c2ef2afdd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8182f7fe4aed44b9befc9a5f860cae59'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:44:10.301221 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-cc19f0c4-8635-417e-9920-86c2ef2afdd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8182f7fe4aed44b9befc9a5f860cae59'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:44:10.313463 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.notifications [None req-cc19f0c4-8635-417e-9920-86c2ef2afdd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8182f7fe4aed44b9befc9a5f860cae59'} {{(pid=73781) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:44:10.319262 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1422/2846] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 23 03:44:09 2021] DELETE /identity/v3/users/8182f7fe4aed44b9befc9a5f860cae59 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:44:10.563844 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ddf52b-15f7-4620-9d08-973afd94ffa3 admin admin] Authenticating user token {{(pid=73780) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:44:10.566417 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.fernet_utils [None req-68ddf52b-15f7-4620-9d08-973afd94ffa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73780) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:44:10.578591 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ddf52b-15f7-4620-9d08-973afd94ffa3 admin admin] Validating token access rules against request {{(pid=73780) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:44:10.633760 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4db38-d3d2-4752-b596-14f3863217d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a7711e2d0394daf9335168cae6f091d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34432677fed4984bbce7291bad96cc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73780) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:44:10.634616 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4db38-d3d2-4752-b596-14f3863217d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:44:10.634900 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4db38-d3d2-4752-b596-14f3863217d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:44:10.635179 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4db38-d3d2-4752-b596-14f3863217d2 admin admin] PATH_INFO: `/v3/projects/4a9e3941d11746fd9b5cc61875ae9db7` {{(pid=73780) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:44:10.636352 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4db38-d3d2-4752-b596-14f3863217d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a9e3941d11746fd9b5cc61875ae9db7)` {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:44:10.638282 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4db38-d3d2-4752-b596-14f3863217d2 admin admin] RBAC: Authorization granted {{(pid=73780) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:44:10.733669 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-05a4db38-d3d2-4752-b596-14f3863217d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a9e3941d11746fd9b5cc61875ae9db7', 'request_id': 'req-05a4db38-d3d2-4752-b596-14f3863217d2'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:44:10.802391 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-05a4db38-d3d2-4752-b596-14f3863217d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a9e3941d11746fd9b5cc61875ae9db7', 'request_id': 'req-05a4db38-d3d2-4752-b596-14f3863217d2'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:44:10.808154 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-05a4db38-d3d2-4752-b596-14f3863217d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a9e3941d11746fd9b5cc61875ae9db7', 'request_id': 'req-05a4db38-d3d2-4752-b596-14f3863217d2'} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:44:10.819211 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-05a4db38-d3d2-4752-b596-14f3863217d2 admin admin] The token cache is being invalidate because project 4a9e3941d11746fd9b5cc61875ae9db7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73780) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 03:44:10.819991 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-05a4db38-d3d2-4752-b596-14f3863217d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:44:10.820690 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: DEBUG keystone.notifications [None req-05a4db38-d3d2-4752-b596-14f3863217d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73780) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 03:44:10.824079 dv-cinder-768458-9-iscsi devstack@keystone.service[73780]: [pid: 73780|app: 0|req: 1425/2847] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 23 03:44:10 2021] DELETE /identity/v3/projects/4a9e3941d11746fd9b5cc61875ae9db7 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 03:47:41.999515 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19f0c4-8635-417e-9920-86c2ef2afdd6 admin admin] Authenticating user token {{(pid=73781) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 03:47:42.000935 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-cc19f0c4-8635-417e-9920-86c2ef2afdd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:47:42.116183 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19f0c4-8635-417e-9920-86c2ef2afdd6 admin admin] Validating token access rules against request {{(pid=73781) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 03:47:42.178146 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ed8f9-d78e-48cc-bc1f-9e7d8215b032 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b7e780a23e4ee499cb7820a85feccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73dcb70ac3714a428a717707e6be8201', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73781) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 03:47:42.178804 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ed8f9-d78e-48cc-bc1f-9e7d8215b032 service placement] REQUEST_METHOD: `GET` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 03:47:42.179088 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ed8f9-d78e-48cc-bc1f-9e7d8215b032 service placement] SCRIPT_NAME: `/identity` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 03:47:42.179363 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ed8f9-d78e-48cc-bc1f-9e7d8215b032 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73781) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 03:47:42.181262 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.fernet_utils [None req-ae3ed8f9-d78e-48cc-bc1f-9e7d8215b032 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73781) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 03:47:42.193347 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ed8f9-d78e-48cc-bc1f-9e7d8215b032 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 03:47:42.195446 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ed8f9-d78e-48cc-bc1f-9e7d8215b032 service placement] RBAC: Authorization granted {{(pid=73781) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 03:47:42.205721 dv-cinder-768458-9-iscsi devstack@keystone.service[73781]: [pid: 73781|app: 0|req: 1423/2848] 10.222.0.23 () {60 vars in 1366 bytes} [Thu Sep 23 03:47:41 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)